0s autopkgtest [23:26:43]: starting date and time: 2025-02-20 23:26:43+0000 0s autopkgtest [23:26:43]: git checkout: 325255d2 Merge branch 'pin-any-arch' into 'ubuntu/production' 0s autopkgtest [23:26:43]: host juju-7f2275-prod-proposed-migration-environment-15; command line: /home/ubuntu/autopkgtest/runner/autopkgtest --output-dir /tmp/autopkgtest-work.1e7riwj1/out --timeout-copy=6000 --setup-commands /home/ubuntu/autopkgtest-cloud/worker-config-production/setup-canonical.sh --apt-pocket=proposed=src:numpy,src:geophar,src:mpi4py,src:onnxruntime,src:petsc4py,src:pyinstaller,src:sympy,src:umap-learn --apt-upgrade dask.distributed --timeout-short=300 --timeout-copy=20000 --timeout-test=20000 --timeout-build=20000 '--env=ADT_TEST_TRIGGERS=numpy/1:2.2.3+ds-2 geophar/18.10+dfsg1-6 mpi4py/4.0.3-1ubuntu1 onnxruntime/1.20.1+dfsg-2 petsc4py/3.22.3-1 pyinstaller/6.12.0+ds-2 sympy/1.13.3-3 umap-learn/0.5.4+dfsg-1' -- ssh -s /home/ubuntu/autopkgtest/ssh-setup/nova -- --flavor autopkgtest-big --security-groups autopkgtest-juju-7f2275-prod-proposed-migration-environment-15@lcy02-2.secgroup --name adt-plucky-amd64-dask.distributed-20250220-232642-juju-7f2275-prod-proposed-migration-environment-15-778cec75-8126-4666-82fe-c9464ea2b50b --image adt/ubuntu-plucky-amd64-server --keyname testbed-juju-7f2275-prod-proposed-migration-environment-15 --net-id=net_prod-proposed-migration -e TERM=linux -e ''"'"'http_proxy=http://squid.internal:3128'"'"'' -e ''"'"'https_proxy=http://squid.internal:3128'"'"'' -e ''"'"'no_proxy=127.0.0.1,127.0.1.1,login.ubuntu.com,localhost,localdomain,novalocal,internal,archive.ubuntu.com,ports.ubuntu.com,security.ubuntu.com,ddebs.ubuntu.com,changelogs.ubuntu.com,keyserver.ubuntu.com,launchpadlibrarian.net,launchpadcontent.net,launchpad.net,10.24.0.0/24,keystone.ps5.canonical.com,objectstorage.prodstack5.canonical.com,radosgw.ps5.canonical.com'"'"'' --mirror=http://ftpmaster.internal/ubuntu/ 58s autopkgtest [23:27:41]: testbed dpkg architecture: amd64 58s autopkgtest [23:27:41]: testbed apt version: 2.9.30 58s autopkgtest [23:27:41]: @@@@@@@@@@@@@@@@@@@@ test bed setup 58s autopkgtest [23:27:41]: testbed release detected to be: None 58s autopkgtest [23:27:41]: updating testbed package index (apt update) 58s Get:1 http://ftpmaster.internal/ubuntu plucky-proposed InRelease [110 kB] 58s Hit:2 http://ftpmaster.internal/ubuntu plucky InRelease 58s Hit:3 http://ftpmaster.internal/ubuntu plucky-updates InRelease 58s Hit:4 http://ftpmaster.internal/ubuntu plucky-security InRelease 58s Get:5 http://ftpmaster.internal/ubuntu plucky-proposed/universe Sources [729 kB] 58s Get:6 http://ftpmaster.internal/ubuntu plucky-proposed/multiverse Sources [14.8 kB] 58s Get:7 http://ftpmaster.internal/ubuntu plucky-proposed/main Sources [89.5 kB] 59s Get:8 http://ftpmaster.internal/ubuntu plucky-proposed/restricted Sources [3120 B] 59s Get:9 http://ftpmaster.internal/ubuntu plucky-proposed/main i386 Packages [110 kB] 59s Get:10 http://ftpmaster.internal/ubuntu plucky-proposed/main amd64 Packages [136 kB] 59s Get:11 http://ftpmaster.internal/ubuntu plucky-proposed/restricted i386 Packages [2412 B] 59s Get:12 http://ftpmaster.internal/ubuntu plucky-proposed/restricted amd64 Packages [7984 B] 59s Get:13 http://ftpmaster.internal/ubuntu plucky-proposed/universe i386 Packages [261 kB] 59s Get:14 http://ftpmaster.internal/ubuntu plucky-proposed/universe amd64 Packages [691 kB] 59s Get:15 http://ftpmaster.internal/ubuntu plucky-proposed/multiverse i386 Packages [9128 B] 59s Get:16 http://ftpmaster.internal/ubuntu plucky-proposed/multiverse amd64 Packages [22.5 kB] 59s Fetched 2187 kB in 0s (5372 kB/s) 60s Reading package lists... 60s + lsb_release --codename --short 60s + RELEASE=plucky 60s + cat 60s + [ plucky != trusty ] 60s + DEBIAN_FRONTEND=noninteractive eatmydata apt-get -y --allow-downgrades -o Dpkg::Options::=--force-confnew dist-upgrade 60s Reading package lists... 60s Building dependency tree... 60s Reading state information... 61s Calculating upgrade... 61s The following package was automatically installed and is no longer required: 61s libapt-pkg6.0t64 61s Use 'sudo apt autoremove' to remove it. 62s The following packages will be upgraded: 62s apt apt-utils binutils binutils-common binutils-x86-64-linux-gnu 62s cryptsetup-bin fwupd inetutils-telnet kbd libapt-pkg7.0 libbinutils 62s libcbor0.10 libcryptsetup12 libctf-nobfd0 libctf0 libfwupd3 libgprofng0 62s libplymouth5 libsframe1 libssl3t64 lto-disabled-list openssl 62s openssl-provider-legacy plymouth plymouth-theme-ubuntu-text python3-requests 62s telnet ubuntu-pro-client ubuntu-pro-client-l10n 62s 29 upgraded, 0 newly installed, 0 to remove and 0 not upgraded. 62s Need to get 16.7 MB of archives. 62s After this operation, 230 kB of additional disk space will be used. 62s Get:1 http://ftpmaster.internal/ubuntu plucky/main amd64 openssl-provider-legacy amd64 3.4.1-1ubuntu1 [38.8 kB] 62s Get:2 http://ftpmaster.internal/ubuntu plucky/main amd64 libssl3t64 amd64 3.4.1-1ubuntu1 [2334 kB] 62s Get:3 http://ftpmaster.internal/ubuntu plucky/main amd64 libapt-pkg7.0 amd64 2.9.30ubuntu1 [1132 kB] 62s Get:4 http://ftpmaster.internal/ubuntu plucky/main amd64 apt amd64 2.9.30ubuntu1 [1436 kB] 62s Get:5 http://ftpmaster.internal/ubuntu plucky/main amd64 apt-utils amd64 2.9.30ubuntu1 [222 kB] 62s Get:6 http://ftpmaster.internal/ubuntu plucky/main amd64 kbd amd64 2.7.1-2ubuntu1 [242 kB] 62s Get:7 http://ftpmaster.internal/ubuntu plucky/main amd64 openssl amd64 3.4.1-1ubuntu1 [1189 kB] 62s Get:8 http://ftpmaster.internal/ubuntu plucky/main amd64 ubuntu-pro-client-l10n amd64 34.1.3 [18.3 kB] 62s Get:9 http://ftpmaster.internal/ubuntu plucky/main amd64 ubuntu-pro-client amd64 34.1.3 [241 kB] 62s Get:10 http://ftpmaster.internal/ubuntu plucky/main amd64 inetutils-telnet amd64 2:2.5-6ubuntu1 [116 kB] 62s Get:11 http://ftpmaster.internal/ubuntu plucky/main amd64 libcbor0.10 amd64 0.10.2-2ubuntu1 [26.0 kB] 62s Get:12 http://ftpmaster.internal/ubuntu plucky/main amd64 libplymouth5 amd64 24.004.60-2ubuntu5 [146 kB] 62s Get:13 http://ftpmaster.internal/ubuntu plucky/main amd64 plymouth-theme-ubuntu-text amd64 24.004.60-2ubuntu5 [10.3 kB] 62s Get:14 http://ftpmaster.internal/ubuntu plucky/main amd64 plymouth amd64 24.004.60-2ubuntu5 [140 kB] 62s Get:15 http://ftpmaster.internal/ubuntu plucky/main amd64 telnet all 0.17+2.5-6ubuntu1 [3694 B] 62s Get:16 http://ftpmaster.internal/ubuntu plucky/main amd64 libgprofng0 amd64 2.44-2ubuntu1 [885 kB] 62s Get:17 http://ftpmaster.internal/ubuntu plucky/main amd64 libctf0 amd64 2.44-2ubuntu1 [96.5 kB] 62s Get:18 http://ftpmaster.internal/ubuntu plucky/main amd64 libctf-nobfd0 amd64 2.44-2ubuntu1 [98.9 kB] 62s Get:19 http://ftpmaster.internal/ubuntu plucky/main amd64 binutils-x86-64-linux-gnu amd64 2.44-2ubuntu1 [1108 kB] 62s Get:20 http://ftpmaster.internal/ubuntu plucky/main amd64 libbinutils amd64 2.44-2ubuntu1 [585 kB] 62s Get:21 http://ftpmaster.internal/ubuntu plucky/main amd64 binutils amd64 2.44-2ubuntu1 [208 kB] 62s Get:22 http://ftpmaster.internal/ubuntu plucky/main amd64 binutils-common amd64 2.44-2ubuntu1 [215 kB] 62s Get:23 http://ftpmaster.internal/ubuntu plucky/main amd64 libsframe1 amd64 2.44-2ubuntu1 [14.9 kB] 62s Get:24 http://ftpmaster.internal/ubuntu plucky/main amd64 libcryptsetup12 amd64 2:2.7.5-1ubuntu2 [321 kB] 62s Get:25 http://ftpmaster.internal/ubuntu plucky/main amd64 cryptsetup-bin amd64 2:2.7.5-1ubuntu2 [222 kB] 62s Get:26 http://ftpmaster.internal/ubuntu plucky/main amd64 fwupd amd64 2.0.6-3 [5408 kB] 62s Get:27 http://ftpmaster.internal/ubuntu plucky/main amd64 libfwupd3 amd64 2.0.6-3 [136 kB] 62s Get:28 http://ftpmaster.internal/ubuntu plucky/main amd64 lto-disabled-list all 56 [12.4 kB] 62s Get:29 http://ftpmaster.internal/ubuntu plucky/main amd64 python3-requests all 2.32.3+dfsg-4ubuntu1 [52.9 kB] 62s Fetched 16.7 MB in 0s (72.4 MB/s) 63s (Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 109023 files and directories currently installed.) 63s Preparing to unpack .../openssl-provider-legacy_3.4.1-1ubuntu1_amd64.deb ... 63s Unpacking openssl-provider-legacy (3.4.1-1ubuntu1) over (3.4.0-1ubuntu2) ... 63s Setting up openssl-provider-legacy (3.4.1-1ubuntu1) ... 63s (Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 109023 files and directories currently installed.) 63s Preparing to unpack .../libssl3t64_3.4.1-1ubuntu1_amd64.deb ... 63s Unpacking libssl3t64:amd64 (3.4.1-1ubuntu1) over (3.4.0-1ubuntu2) ... 63s Setting up libssl3t64:amd64 (3.4.1-1ubuntu1) ... 63s (Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 109023 files and directories currently installed.) 63s Preparing to unpack .../libapt-pkg7.0_2.9.30ubuntu1_amd64.deb ... 63s Unpacking libapt-pkg7.0:amd64 (2.9.30ubuntu1) over (2.9.30) ... 63s Setting up libapt-pkg7.0:amd64 (2.9.30ubuntu1) ... 63s (Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 109023 files and directories currently installed.) 63s Preparing to unpack .../apt_2.9.30ubuntu1_amd64.deb ... 63s Unpacking apt (2.9.30ubuntu1) over (2.9.30) ... 63s Setting up apt (2.9.30ubuntu1) ... 64s (Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 109023 files and directories currently installed.) 64s Preparing to unpack .../00-apt-utils_2.9.30ubuntu1_amd64.deb ... 64s Unpacking apt-utils (2.9.30ubuntu1) over (2.9.30) ... 64s Preparing to unpack .../01-kbd_2.7.1-2ubuntu1_amd64.deb ... 64s Unpacking kbd (2.7.1-2ubuntu1) over (2.6.4-2ubuntu3) ... 64s Preparing to unpack .../02-openssl_3.4.1-1ubuntu1_amd64.deb ... 64s Unpacking openssl (3.4.1-1ubuntu1) over (3.4.0-1ubuntu2) ... 64s Preparing to unpack .../03-ubuntu-pro-client-l10n_34.1.3_amd64.deb ... 64s Unpacking ubuntu-pro-client-l10n (34.1.3) over (34.1.2) ... 64s Preparing to unpack .../04-ubuntu-pro-client_34.1.3_amd64.deb ... 64s /usr/bin/py3clean:101: DeprecationWarning: glob.glob1 is deprecated and will be removed in Python 3.15. Use glob.glob and pass a directory to its root_dir argument instead. 64s for fn in glob1(directory, "%s.*" % fname): 64s Unpacking ubuntu-pro-client (34.1.3) over (34.1.2) ... 64s Preparing to unpack .../05-inetutils-telnet_2%3a2.5-6ubuntu1_amd64.deb ... 64s Unpacking inetutils-telnet (2:2.5-6ubuntu1) over (2:2.5-5ubuntu1) ... 65s Preparing to unpack .../06-libcbor0.10_0.10.2-2ubuntu1_amd64.deb ... 65s Unpacking libcbor0.10:amd64 (0.10.2-2ubuntu1) over (0.10.2-1.2ubuntu2) ... 65s Preparing to unpack .../07-libplymouth5_24.004.60-2ubuntu5_amd64.deb ... 65s Unpacking libplymouth5:amd64 (24.004.60-2ubuntu5) over (24.004.60-2ubuntu4) ... 65s Preparing to unpack .../08-plymouth-theme-ubuntu-text_24.004.60-2ubuntu5_amd64.deb ... 65s Unpacking plymouth-theme-ubuntu-text (24.004.60-2ubuntu5) over (24.004.60-2ubuntu4) ... 65s Preparing to unpack .../09-plymouth_24.004.60-2ubuntu5_amd64.deb ... 65s Unpacking plymouth (24.004.60-2ubuntu5) over (24.004.60-2ubuntu4) ... 65s Preparing to unpack .../10-telnet_0.17+2.5-6ubuntu1_all.deb ... 65s Unpacking telnet (0.17+2.5-6ubuntu1) over (0.17+2.5-5ubuntu1) ... 65s Preparing to unpack .../11-libgprofng0_2.44-2ubuntu1_amd64.deb ... 65s Unpacking libgprofng0:amd64 (2.44-2ubuntu1) over (2.44-1ubuntu1) ... 65s Preparing to unpack .../12-libctf0_2.44-2ubuntu1_amd64.deb ... 65s Unpacking libctf0:amd64 (2.44-2ubuntu1) over (2.44-1ubuntu1) ... 65s Preparing to unpack .../13-libctf-nobfd0_2.44-2ubuntu1_amd64.deb ... 65s Unpacking libctf-nobfd0:amd64 (2.44-2ubuntu1) over (2.44-1ubuntu1) ... 65s Preparing to unpack .../14-binutils-x86-64-linux-gnu_2.44-2ubuntu1_amd64.deb ... 65s Unpacking binutils-x86-64-linux-gnu (2.44-2ubuntu1) over (2.44-1ubuntu1) ... 65s Preparing to unpack .../15-libbinutils_2.44-2ubuntu1_amd64.deb ... 65s Unpacking libbinutils:amd64 (2.44-2ubuntu1) over (2.44-1ubuntu1) ... 65s Preparing to unpack .../16-binutils_2.44-2ubuntu1_amd64.deb ... 65s Unpacking binutils (2.44-2ubuntu1) over (2.44-1ubuntu1) ... 65s Preparing to unpack .../17-binutils-common_2.44-2ubuntu1_amd64.deb ... 65s Unpacking binutils-common:amd64 (2.44-2ubuntu1) over (2.44-1ubuntu1) ... 65s Preparing to unpack .../18-libsframe1_2.44-2ubuntu1_amd64.deb ... 65s Unpacking libsframe1:amd64 (2.44-2ubuntu1) over (2.44-1ubuntu1) ... 65s Preparing to unpack .../19-libcryptsetup12_2%3a2.7.5-1ubuntu2_amd64.deb ... 65s Unpacking libcryptsetup12:amd64 (2:2.7.5-1ubuntu2) over (2:2.7.2-2ubuntu1) ... 65s Preparing to unpack .../20-cryptsetup-bin_2%3a2.7.5-1ubuntu2_amd64.deb ... 65s Unpacking cryptsetup-bin (2:2.7.5-1ubuntu2) over (2:2.7.2-2ubuntu1) ... 65s Preparing to unpack .../21-fwupd_2.0.6-3_amd64.deb ... 65s Unpacking fwupd (2.0.6-3) over (2.0.5-1) ... 66s Preparing to unpack .../22-libfwupd3_2.0.6-3_amd64.deb ... 66s Unpacking libfwupd3:amd64 (2.0.6-3) over (2.0.5-1) ... 66s Preparing to unpack .../23-lto-disabled-list_56_all.deb ... 66s Unpacking lto-disabled-list (56) over (55) ... 66s Preparing to unpack .../24-python3-requests_2.32.3+dfsg-4ubuntu1_all.deb ... 66s /usr/bin/py3clean:101: DeprecationWarning: glob.glob1 is deprecated and will be removed in Python 3.15. Use glob.glob and pass a directory to its root_dir argument instead. 66s for fn in glob1(directory, "%s.*" % fname): 66s Unpacking python3-requests (2.32.3+dfsg-4ubuntu1) over (2.32.3+dfsg-1ubuntu1) ... 66s Setting up lto-disabled-list (56) ... 66s Setting up apt-utils (2.9.30ubuntu1) ... 66s Setting up libcbor0.10:amd64 (0.10.2-2ubuntu1) ... 66s Setting up binutils-common:amd64 (2.44-2ubuntu1) ... 66s Setting up inetutils-telnet (2:2.5-6ubuntu1) ... 66s Setting up libctf-nobfd0:amd64 (2.44-2ubuntu1) ... 66s Setting up libfwupd3:amd64 (2.0.6-3) ... 66s Setting up libsframe1:amd64 (2.44-2ubuntu1) ... 66s Setting up python3-requests (2.32.3+dfsg-4ubuntu1) ... 66s Setting up libplymouth5:amd64 (24.004.60-2ubuntu5) ... 66s Setting up libcryptsetup12:amd64 (2:2.7.5-1ubuntu2) ... 66s Setting up kbd (2.7.1-2ubuntu1) ... 66s Setting up libbinutils:amd64 (2.44-2ubuntu1) ... 66s Setting up openssl (3.4.1-1ubuntu1) ... 66s Setting up ubuntu-pro-client (34.1.3) ... 68s Setting up fwupd (2.0.6-3) ... 68s fwupd-refresh.service is a disabled or a static unit not running, not starting it. 68s fwupd.service is a disabled or a static unit not running, not starting it. 69s Setting up libctf0:amd64 (2.44-2ubuntu1) ... 69s Setting up cryptsetup-bin (2:2.7.5-1ubuntu2) ... 69s Setting up ubuntu-pro-client-l10n (34.1.3) ... 69s Setting up telnet (0.17+2.5-6ubuntu1) ... 69s Setting up plymouth (24.004.60-2ubuntu5) ... 69s update-rc.d: warning: start and stop actions are no longer supported; falling back to defaults 69s update-rc.d: warning: start and stop actions are no longer supported; falling back to defaults 69s Setting up libgprofng0:amd64 (2.44-2ubuntu1) ... 69s Setting up binutils-x86-64-linux-gnu (2.44-2ubuntu1) ... 69s Setting up binutils (2.44-2ubuntu1) ... 69s Processing triggers for dbus (1.16.0-1ubuntu1) ... 69s Processing triggers for initramfs-tools (0.145ubuntu2) ... 69s update-initramfs: Generating /boot/initrd.img-6.12.0-15-generic 69s W: No lz4 in /usr/bin:/sbin:/bin, using gzip 82s Processing triggers for libc-bin (2.40-4ubuntu1) ... 82s Processing triggers for man-db (2.13.0-1) ... 83s Setting up plymouth-theme-ubuntu-text (24.004.60-2ubuntu5) ... 83s Processing triggers for initramfs-tools (0.145ubuntu2) ... 83s update-initramfs: Generating /boot/initrd.img-6.12.0-15-generic 83s W: No lz4 in /usr/bin:/sbin:/bin, using gzip 94s + rm /etc/apt/preferences.d/force-downgrade-to-release.pref 94s + /usr/lib/apt/apt-helper analyze-pattern ?true 94s + uname -r 94s + sed s/\./\\./g 94s + running_kernel_pattern=^linux-.*6\.12\.0-15-generic.* 94s + apt list ?obsolete 94s + tail -n+2 94s + cut -d/ -f1 94s + grep -v ^linux-.*6\.12\.0-15-generic.* 96s + true 96s + obsolete_pkgs= 96s + DEBIAN_FRONTEND=noninteractive eatmydata apt-get -y purge --autoremove 96s Reading package lists... 96s Building dependency tree... 96s Reading state information... 96s Solving dependencies... 97s The following packages will be REMOVED: 97s libapt-pkg6.0t64* 97s 0 upgraded, 0 newly installed, 1 to remove and 0 not upgraded. 97s After this operation, 3725 kB disk space will be freed. 97s (Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 109020 files and directories currently installed.) 97s Removing libapt-pkg6.0t64:amd64 (2.9.29) ... 97s Processing triggers for libc-bin (2.40-4ubuntu1) ... 97s + grep -q trusty /etc/lsb-release 97s + [ ! -d /usr/share/doc/unattended-upgrades ] 97s + [ ! -d /usr/share/doc/lxd ] 97s + [ ! -d /usr/share/doc/lxd-client ] 97s + [ ! -d /usr/share/doc/snapd ] 97s + type iptables 97s + cat 97s + chmod 755 /etc/rc.local 97s + . /etc/rc.local 97s + iptables -w -t mangle -A FORWARD -p tcp --tcp-flags SYN,RST SYN -j TCPMSS --clamp-mss-to-pmtu 97s + iptables -A OUTPUT -d 10.255.255.1/32 -p tcp -j DROP 97s + iptables -A OUTPUT -d 10.255.255.2/32 -p tcp -j DROP 97s + uname -m 97s + [ x86_64 = ppc64le ] 97s + [ -d /run/systemd/system ] 97s + systemd-detect-virt --quiet --vm 97s + mkdir -p /etc/systemd/system/systemd-random-seed.service.d/ 97s + cat 97s + grep -q lz4 /etc/initramfs-tools/initramfs.conf 97s + echo COMPRESS=lz4 97s autopkgtest [23:28:20]: upgrading testbed (apt dist-upgrade and autopurge) 97s Reading package lists... 98s Building dependency tree... 98s Reading state information... 98s Calculating upgrade...Starting pkgProblemResolver with broken count: 0 98s Starting 2 pkgProblemResolver with broken count: 0 98s Done 99s Entering ResolveByKeep 99s 99s Calculating upgrade... 100s 0 upgraded, 0 newly installed, 0 to remove and 0 not upgraded. 100s Reading package lists... 100s Building dependency tree... 100s Reading state information... 100s Starting pkgProblemResolver with broken count: 0 100s Starting 2 pkgProblemResolver with broken count: 0 100s Done 101s Solving dependencies... 101s 0 upgraded, 0 newly installed, 0 to remove and 0 not upgraded. 101s autopkgtest [23:28:24]: rebooting testbed after setup commands that affected boot 105s autopkgtest-virt-ssh: WARNING: ssh connection failed. Retrying in 3 seconds... 117s autopkgtest [23:28:40]: testbed running kernel: Linux 6.12.0-15-generic #15-Ubuntu SMP PREEMPT_DYNAMIC Tue Feb 4 16:02:16 UTC 2025 118s autopkgtest [23:28:41]: @@@@@@@@@@@@@@@@@@@@ apt-source dask.distributed 120s Get:1 http://ftpmaster.internal/ubuntu plucky/universe dask.distributed 2024.12.1+ds-1 (dsc) [3860 B] 120s Get:2 http://ftpmaster.internal/ubuntu plucky/universe dask.distributed 2024.12.1+ds-1 (tar) [2144 kB] 120s Get:3 http://ftpmaster.internal/ubuntu plucky/universe dask.distributed 2024.12.1+ds-1 (diff) [2046 kB] 120s gpgv: Signature made Mon Jan 6 15:46:05 2025 UTC 120s gpgv: using RSA key AC0A4FF12611B6FCCF01C111393587D97D86500B 120s gpgv: Can't check signature: No public key 120s dpkg-source: warning: cannot verify inline signature for ./dask.distributed_2024.12.1+ds-1.dsc: no acceptable signature found 120s autopkgtest [23:28:43]: testing package dask.distributed version 2024.12.1+ds-1 120s autopkgtest [23:28:43]: build not needed 122s autopkgtest [23:28:45]: test pytest: preparing testbed 122s Reading package lists... 122s Building dependency tree... 122s Reading state information... 123s Starting pkgProblemResolver with broken count: 0 123s Starting 2 pkgProblemResolver with broken count: 0 123s Done 124s The following NEW packages will be installed: 124s blt fontconfig-config fonts-dejavu-core fonts-dejavu-mono fonts-font-awesome 124s fonts-glyphicons-halflings fonts-lato fonts-lyx fonts-mathjax gdb libaec0 124s libargon2-1 libbabeltrace1 libblas3 libcares2 libdebuginfod-common 124s libdebuginfod1t64 libdeflate0 libfontconfig1 libgfortran5 libgomp1 124s libgraphite2-3 libharfbuzz0b libhdf5-310 libhdf5-hl-310 libimagequant0 124s libipt2 libjbig0 libjpeg-turbo8 libjpeg8 libjs-bootstrap libjs-jquery 124s libjs-jquery-ui libjs-mathjax libjs-sphinxdoc libjs-sprintf-js 124s libjs-underscore liblapack3 liblbfgsb0 liblcms2-2 liblerc4 liblzf1 124s libnetcdf22 libnode115 libnorm1t64 libopenjp2-7 libpgm-5.3-0t64 124s libqhull-r8.0 libraqm0 libsharpyuv0 libsodium23 libsource-highlight-common 124s libsource-highlight4t64 libsz2 libtcl8.6 libtiff6 libtk8.6 libwebp7 124s libwebpdemux2 libwebpmux3 libxft2 libxrender1 libxslt1.1 libxss1 libzmq5 124s node-acorn node-argparse node-balanced-match node-brace-expansion 124s node-cjs-module-lexer node-esprima node-js-yaml node-minimatch 124s node-sprintf-js node-undici node-xtend nodejs python-dask-doc 124s python-distributed-doc python-fsspec-doc python-matplotlib-data 124s python-numpy-doc python-pandas-doc python-tinycss2-common 124s python3-aiohappyeyeballs python3-aiohttp python3-aiosignal python3-all 124s python3-anyio python3-argon2 python3-arrow python3-asttokens 124s python3-async-timeout python3-bleach python3-brotli python3-bs4 124s python3-cftime python3-click python3-cloudpickle python3-comm 124s python3-contourpy python3-coverage python3-cycler python3-dask 124s python3-dateutil python3-debugpy python3-decorator python3-defusedxml 124s python3-dill python3-distributed python3-doc python3-executing 124s python3-fastjsonschema python3-fonttools python3-fqdn python3-frozenlist 124s python3-fs python3-fsspec python3-h5py python3-h5py-serial python3-html5lib 124s python3-iniconfig python3-ipykernel python3-ipython python3-isoduration 124s python3-jedi python3-joblib python3-jupyter-client python3-jupyter-core 124s python3-jupyter-events python3-jupyter-server 124s python3-jupyter-server-terminals python3-jupyterlab-pygments 124s python3-kiwisolver python3-locket python3-lxml python3-lz4 124s python3-matplotlib python3-matplotlib-inline python3-mistune python3-mpmath 124s python3-msgpack python3-multidict python3-nacl python3-nbclient 124s python3-nbconvert python3-nbformat python3-nest-asyncio python3-netcdf4 124s python3-numpy python3-numpy-dev python3-overrides python3-packaging 124s python3-pandas python3-pandas-lib python3-pandocfilters python3-paramiko 124s python3-parso python3-partd python3-pexpect python3-pil python3-pil.imagetk 124s python3-platformdirs python3-pluggy python3-prometheus-client 124s python3-prompt-toolkit python3-psutil python3-ptyprocess python3-pure-eval 124s python3-pytest python3-pytest-rerunfailures python3-pytest-timeout 124s python3-pythonjsonlogger python3-pytz python3-rfc3339-validator 124s python3-rfc3986-validator python3-scipy python3-send2trash python3-sklearn 124s python3-sklearn-lib python3-sniffio python3-sortedcontainers 124s python3-soupsieve python3-stack-data python3-sympy python3-tblib 124s python3-terminado python3-threadpoolctl python3-tinycss2 python3-tk 124s python3-toolz python3-tornado python3-traitlets python3-typeshed python3-tz 124s python3-ufolib2 python3-uritemplate python3-wcwidth python3-webcolors 124s python3-webencodings python3-websocket python3-yarl python3-zict python3-zmq 124s python3.12 python3.12-minimal python3.12-tk python3.13-doc python3.13-tk 124s sass-stylesheets-bulma sphinx-rtd-theme-common tk8.6-blt2.5 tzdata-legacy 124s unicode-data x11-common 124s 0 upgraded, 215 newly installed, 0 to remove and 0 not upgraded. 124s Need to get 192 MB of archives. 124s After this operation, 1203 MB of additional disk space will be used. 124s Get:1 http://ftpmaster.internal/ubuntu plucky/main amd64 python3.12-minimal amd64 3.12.9-1 [2348 kB] 124s Get:2 http://ftpmaster.internal/ubuntu plucky/main amd64 fonts-lato all 2.015-1 [2781 kB] 124s Get:3 http://ftpmaster.internal/ubuntu plucky/main amd64 libdebuginfod-common all 0.192-4 [15.4 kB] 124s Get:4 http://ftpmaster.internal/ubuntu plucky-proposed/main amd64 python3-numpy-dev amd64 1:2.2.3+ds-2 [147 kB] 124s Get:5 http://ftpmaster.internal/ubuntu plucky/main amd64 libblas3 amd64 3.12.1-2 [359 kB] 124s Get:6 http://ftpmaster.internal/ubuntu plucky/main amd64 libgfortran5 amd64 15-20250213-1ubuntu1 [920 kB] 124s Get:7 http://ftpmaster.internal/ubuntu plucky/main amd64 liblapack3 amd64 3.12.1-2 [3179 kB] 124s Get:8 http://ftpmaster.internal/ubuntu plucky-proposed/main amd64 python3-numpy amd64 1:2.2.3+ds-2 [8537 kB] 124s Get:9 http://ftpmaster.internal/ubuntu plucky/main amd64 python3.12 amd64 3.12.9-1 [671 kB] 124s Get:10 http://ftpmaster.internal/ubuntu plucky/main amd64 libtcl8.6 amd64 8.6.16+dfsg-1 [1086 kB] 124s Get:11 http://ftpmaster.internal/ubuntu plucky/main amd64 fonts-dejavu-mono all 2.37-8 [502 kB] 124s Get:12 http://ftpmaster.internal/ubuntu plucky/main amd64 fonts-dejavu-core all 2.37-8 [835 kB] 124s Get:13 http://ftpmaster.internal/ubuntu plucky/main amd64 fontconfig-config amd64 2.15.0-2ubuntu1 [37.4 kB] 124s Get:14 http://ftpmaster.internal/ubuntu plucky/main amd64 libfontconfig1 amd64 2.15.0-2ubuntu1 [164 kB] 124s Get:15 http://ftpmaster.internal/ubuntu plucky/main amd64 libxrender1 amd64 1:0.9.10-1.1build1 [19.0 kB] 124s Get:16 http://ftpmaster.internal/ubuntu plucky/main amd64 libxft2 amd64 2.3.6-1build1 [45.3 kB] 124s Get:17 http://ftpmaster.internal/ubuntu plucky/main amd64 x11-common all 1:7.7+23ubuntu3 [21.7 kB] 124s Get:18 http://ftpmaster.internal/ubuntu plucky/main amd64 libxss1 amd64 1:1.2.3-1build3 [7204 B] 124s Get:19 http://ftpmaster.internal/ubuntu plucky/main amd64 libtk8.6 amd64 8.6.16-1 [868 kB] 124s Get:20 http://ftpmaster.internal/ubuntu plucky/main amd64 tk8.6-blt2.5 amd64 2.5.3+dfsg-7build1 [630 kB] 124s Get:21 http://ftpmaster.internal/ubuntu plucky/main amd64 blt amd64 2.5.3+dfsg-7build1 [4840 B] 124s Get:22 http://ftpmaster.internal/ubuntu plucky/main amd64 fonts-font-awesome all 5.0.10+really4.7.0~dfsg-4.1 [516 kB] 124s Get:23 http://ftpmaster.internal/ubuntu plucky/universe amd64 fonts-glyphicons-halflings all 1.009~3.4.1+dfsg-3 [118 kB] 124s Get:24 http://ftpmaster.internal/ubuntu plucky/universe amd64 fonts-lyx all 2.4.3-1 [171 kB] 124s Get:25 http://ftpmaster.internal/ubuntu plucky/main amd64 fonts-mathjax all 2.7.9+dfsg-1 [2208 kB] 124s Get:26 http://ftpmaster.internal/ubuntu plucky/main amd64 libbabeltrace1 amd64 1.5.11-4build1 [185 kB] 124s Get:27 http://ftpmaster.internal/ubuntu plucky/main amd64 libdebuginfod1t64 amd64 0.192-4 [21.0 kB] 124s Get:28 http://ftpmaster.internal/ubuntu plucky/main amd64 libipt2 amd64 2.1.2-1 [58.9 kB] 124s Get:29 http://ftpmaster.internal/ubuntu plucky/main amd64 libsource-highlight-common all 3.1.9-4.3build1 [64.2 kB] 124s Get:30 http://ftpmaster.internal/ubuntu plucky/main amd64 libsource-highlight4t64 amd64 3.1.9-4.3build1 [258 kB] 124s Get:31 http://ftpmaster.internal/ubuntu plucky/main amd64 gdb amd64 16.2-1ubuntu1 [8934 kB] 124s Get:32 http://ftpmaster.internal/ubuntu plucky/universe amd64 libaec0 amd64 1.1.3-1 [22.7 kB] 124s Get:33 http://ftpmaster.internal/ubuntu plucky/main amd64 libargon2-1 amd64 0~20190702+dfsg-4build1 [20.8 kB] 124s Get:34 http://ftpmaster.internal/ubuntu plucky/main amd64 libcares2 amd64 1.34.4-2.1 [109 kB] 124s Get:35 http://ftpmaster.internal/ubuntu plucky/main amd64 libdeflate0 amd64 1.23-1 [64.1 kB] 124s Get:36 http://ftpmaster.internal/ubuntu plucky/main amd64 libgomp1 amd64 15-20250213-1ubuntu1 [148 kB] 124s Get:37 http://ftpmaster.internal/ubuntu plucky/main amd64 libgraphite2-3 amd64 1.3.14-2ubuntu1 [73.1 kB] 124s Get:38 http://ftpmaster.internal/ubuntu plucky/main amd64 libharfbuzz0b amd64 10.2.0-1 [543 kB] 124s Get:39 http://ftpmaster.internal/ubuntu plucky/universe amd64 libsz2 amd64 1.1.3-1 [5456 B] 124s Get:40 http://ftpmaster.internal/ubuntu plucky/universe amd64 libhdf5-310 amd64 1.14.5+repack-3 [1519 kB] 124s Get:41 http://ftpmaster.internal/ubuntu plucky/universe amd64 libhdf5-hl-310 amd64 1.14.5+repack-3 [62.6 kB] 124s Get:42 http://ftpmaster.internal/ubuntu plucky/main amd64 libimagequant0 amd64 2.18.0-1build1 [36.3 kB] 124s Get:43 http://ftpmaster.internal/ubuntu plucky/main amd64 libjpeg-turbo8 amd64 2.1.5-3ubuntu2 [179 kB] 124s Get:44 http://ftpmaster.internal/ubuntu plucky/main amd64 libjpeg8 amd64 8c-2ubuntu11 [2148 B] 124s Get:45 http://ftpmaster.internal/ubuntu plucky/universe amd64 libjs-bootstrap all 3.4.1+dfsg-3 [129 kB] 124s Get:46 http://ftpmaster.internal/ubuntu plucky/main amd64 libjs-jquery all 3.6.1+dfsg+~3.5.14-1 [328 kB] 124s Get:47 http://ftpmaster.internal/ubuntu plucky/universe amd64 libjs-jquery-ui all 1.13.2+dfsg-1 [252 kB] 124s Get:48 http://ftpmaster.internal/ubuntu plucky/main amd64 libjs-underscore all 1.13.4~dfsg+~1.11.4-3 [118 kB] 124s Get:49 http://ftpmaster.internal/ubuntu plucky/main amd64 libjs-sphinxdoc all 8.1.3-4 [30.9 kB] 124s Get:50 http://ftpmaster.internal/ubuntu plucky/universe amd64 libjs-sprintf-js all 1.1.2+ds1+~1.1.2-1 [12.8 kB] 124s Get:51 http://ftpmaster.internal/ubuntu plucky/universe amd64 liblbfgsb0 amd64 3.0+dfsg.4-1build1 [29.9 kB] 124s Get:52 http://ftpmaster.internal/ubuntu plucky/main amd64 liblcms2-2 amd64 2.16-2 [212 kB] 124s Get:53 http://ftpmaster.internal/ubuntu plucky/main amd64 liblerc4 amd64 4.0.0+ds-5ubuntu1 [271 kB] 124s Get:54 http://ftpmaster.internal/ubuntu plucky/universe amd64 liblzf1 amd64 3.6-4 [7624 B] 124s Get:55 http://ftpmaster.internal/ubuntu plucky/universe amd64 libnetcdf22 amd64 1:4.9.3-1 [574 kB] 124s Get:56 http://ftpmaster.internal/ubuntu plucky/universe amd64 node-xtend all 4.0.2-3 [3902 B] 124s Get:57 http://ftpmaster.internal/ubuntu plucky/universe amd64 nodejs amd64 20.18.1+dfsg-1ubuntu2 [334 kB] 124s Get:58 http://ftpmaster.internal/ubuntu plucky/universe amd64 node-acorn all 8.8.1+ds+~cs25.17.7-2 [115 kB] 124s Get:59 http://ftpmaster.internal/ubuntu plucky/universe amd64 node-cjs-module-lexer all 1.2.3+dfsg-1 [32.1 kB] 124s Get:60 http://ftpmaster.internal/ubuntu plucky/universe amd64 node-balanced-match all 2.0.0-1 [4910 B] 124s Get:61 http://ftpmaster.internal/ubuntu plucky/universe amd64 node-brace-expansion all 2.0.1+~1.1.0-1 [8072 B] 124s Get:62 http://ftpmaster.internal/ubuntu plucky/universe amd64 node-minimatch all 9.0.3-5 [78.2 kB] 124s Get:63 http://ftpmaster.internal/ubuntu plucky/universe amd64 node-undici all 7.3.0+dfsg1+~cs24.12.11-1 [341 kB] 124s Get:64 http://ftpmaster.internal/ubuntu plucky/universe amd64 libnode115 amd64 20.18.1+dfsg-1ubuntu2 [13.3 MB] 125s Get:65 http://ftpmaster.internal/ubuntu plucky/universe amd64 libnorm1t64 amd64 1.5.9+dfsg-3.1build1 [154 kB] 125s Get:66 http://ftpmaster.internal/ubuntu plucky/universe amd64 libpgm-5.3-0t64 amd64 5.3.128~dfsg-2.1build1 [167 kB] 125s Get:67 http://ftpmaster.internal/ubuntu plucky/universe amd64 libqhull-r8.0 amd64 2020.2-6build1 [193 kB] 125s Get:68 http://ftpmaster.internal/ubuntu plucky/main amd64 libraqm0 amd64 0.10.2-1 [17.2 kB] 125s Get:69 http://ftpmaster.internal/ubuntu plucky/main amd64 libsharpyuv0 amd64 1.5.0-0.1 [25.9 kB] 125s Get:70 http://ftpmaster.internal/ubuntu plucky/main amd64 libsodium23 amd64 1.0.18-1build3 [161 kB] 125s Get:71 http://ftpmaster.internal/ubuntu plucky/main amd64 libjbig0 amd64 2.1-6.1ubuntu2 [29.7 kB] 125s Get:72 http://ftpmaster.internal/ubuntu plucky/main amd64 libwebp7 amd64 1.5.0-0.1 [378 kB] 125s Get:73 http://ftpmaster.internal/ubuntu plucky/main amd64 libtiff6 amd64 4.5.1+git230720-4ubuntu4 [200 kB] 125s Get:74 http://ftpmaster.internal/ubuntu plucky/main amd64 libwebpdemux2 amd64 1.5.0-0.1 [13.0 kB] 125s Get:75 http://ftpmaster.internal/ubuntu plucky/main amd64 libwebpmux3 amd64 1.5.0-0.1 [27.6 kB] 125s Get:76 http://ftpmaster.internal/ubuntu plucky/main amd64 libxslt1.1 amd64 1.1.39-0exp1ubuntu2 [175 kB] 125s Get:77 http://ftpmaster.internal/ubuntu plucky/universe amd64 libzmq5 amd64 4.3.5-1build2 [260 kB] 125s Get:78 http://ftpmaster.internal/ubuntu plucky/universe amd64 node-esprima all 4.0.1+ds+~4.0.3-2 [69.3 kB] 125s Get:79 http://ftpmaster.internal/ubuntu plucky/universe amd64 node-sprintf-js all 1.1.2+ds1+~1.1.2-1 [3916 B] 125s Get:80 http://ftpmaster.internal/ubuntu plucky/universe amd64 node-argparse all 2.0.1-2 [33.2 kB] 125s Get:81 http://ftpmaster.internal/ubuntu plucky/universe amd64 node-js-yaml all 4.1.0+dfsg+~4.0.5-7 [61.9 kB] 125s Get:82 http://ftpmaster.internal/ubuntu plucky/main amd64 libjs-mathjax all 2.7.9+dfsg-1 [5665 kB] 125s Get:83 http://ftpmaster.internal/ubuntu plucky/universe amd64 python-dask-doc all 2024.12.1+dfsg-2 [10.4 MB] 125s Get:84 http://ftpmaster.internal/ubuntu plucky/main amd64 sphinx-rtd-theme-common all 3.0.2+dfsg-2 [1014 kB] 125s Get:85 http://ftpmaster.internal/ubuntu plucky/universe amd64 python-fsspec-doc all 2025.2.0-1 [320 kB] 125s Get:86 http://ftpmaster.internal/ubuntu plucky-proposed/main amd64 python-numpy-doc all 1:2.2.3+ds-2 [5757 kB] 125s Get:87 http://ftpmaster.internal/ubuntu plucky/universe amd64 python-pandas-doc all 2.2.3+dfsg-8 [10.7 MB] 125s Get:88 http://ftpmaster.internal/ubuntu plucky/main amd64 python3.13-doc all 3.13.2-1 [14.2 MB] 125s Get:89 http://ftpmaster.internal/ubuntu plucky/main amd64 python3-doc all 3.13.1-1~exp2 [10.4 kB] 125s Get:90 http://ftpmaster.internal/ubuntu plucky/universe amd64 sass-stylesheets-bulma all 0.9.4~ds-1 [113 kB] 125s Get:91 http://ftpmaster.internal/ubuntu plucky/universe amd64 python-distributed-doc all 2024.12.1+ds-1 [3147 kB] 125s Get:92 http://ftpmaster.internal/ubuntu plucky/universe amd64 python-matplotlib-data all 3.8.3-3ubuntu2 [2929 kB] 125s Get:93 http://ftpmaster.internal/ubuntu plucky/universe amd64 python-tinycss2-common all 1.4.0-1 [47.0 kB] 125s Get:94 http://ftpmaster.internal/ubuntu plucky/universe amd64 python3-aiohappyeyeballs all 2.4.6-1 [10.5 kB] 125s Get:95 http://ftpmaster.internal/ubuntu plucky/universe amd64 python3-multidict amd64 6.1.0-1build1 [38.5 kB] 125s Get:96 http://ftpmaster.internal/ubuntu plucky/universe amd64 python3-yarl amd64 1.13.1-1build1 [127 kB] 125s Get:97 http://ftpmaster.internal/ubuntu plucky/universe amd64 python3-async-timeout all 5.0.1-1 [6830 B] 125s Get:98 http://ftpmaster.internal/ubuntu plucky/universe amd64 python3-frozenlist amd64 1.5.0-1build1 [67.8 kB] 125s Get:99 http://ftpmaster.internal/ubuntu plucky/universe amd64 python3-aiosignal all 1.3.2-1 [5182 B] 125s Get:100 http://ftpmaster.internal/ubuntu plucky/universe amd64 python3-aiohttp amd64 3.10.11-1 [374 kB] 125s Get:101 http://ftpmaster.internal/ubuntu plucky/main amd64 python3-all amd64 3.13.1-1~exp2 [894 B] 125s Get:102 http://ftpmaster.internal/ubuntu plucky/universe amd64 python3-sniffio all 1.3.1-1 [7262 B] 125s Get:103 http://ftpmaster.internal/ubuntu plucky/universe amd64 python3-anyio all 4.7.0-1 [61.6 kB] 125s Get:104 http://ftpmaster.internal/ubuntu plucky/universe amd64 python3-argon2 amd64 21.1.0-3 [21.4 kB] 125s Get:105 http://ftpmaster.internal/ubuntu plucky/main amd64 python3-dateutil all 2.9.0-3 [80.2 kB] 125s Get:106 http://ftpmaster.internal/ubuntu plucky/main amd64 python3-arrow all 1.3.0-1.1ubuntu1 [56.1 kB] 125s Get:107 http://ftpmaster.internal/ubuntu plucky/universe amd64 python3-asttokens all 3.0.0-1 [20.4 kB] 125s Get:108 http://ftpmaster.internal/ubuntu plucky/main amd64 python3-webencodings all 0.5.1-5 [11.5 kB] 125s Get:109 http://ftpmaster.internal/ubuntu plucky/main amd64 python3-html5lib all 1.2-1 [90.8 kB] 125s Get:110 http://ftpmaster.internal/ubuntu plucky/universe amd64 python3-bleach all 6.2.0-1 [43.9 kB] 125s Get:111 http://ftpmaster.internal/ubuntu plucky/universe amd64 python3-brotli amd64 1.1.0-2build3 [368 kB] 125s Get:112 http://ftpmaster.internal/ubuntu plucky/main amd64 python3-soupsieve all 2.6-1 [33.0 kB] 125s Get:113 http://ftpmaster.internal/ubuntu plucky/main amd64 python3-bs4 all 4.13.3-1 [136 kB] 125s Get:114 http://ftpmaster.internal/ubuntu plucky/universe amd64 python3-cftime amd64 1.6.4-1build2 [346 kB] 125s Get:115 http://ftpmaster.internal/ubuntu plucky/main amd64 python3-click all 8.1.8-1 [79.8 kB] 125s Get:116 http://ftpmaster.internal/ubuntu plucky/universe amd64 python3-cloudpickle all 3.1.1-1 [22.4 kB] 125s Get:117 http://ftpmaster.internal/ubuntu plucky/universe amd64 python3-traitlets all 5.14.3+really5.14.3-1 [71.5 kB] 125s Get:118 http://ftpmaster.internal/ubuntu plucky/universe amd64 python3-comm all 0.2.1-1 [7016 B] 125s Get:119 http://ftpmaster.internal/ubuntu plucky/universe amd64 python3-contourpy amd64 1.3.1-1 [271 kB] 125s Get:120 http://ftpmaster.internal/ubuntu plucky/universe amd64 python3-coverage amd64 7.4.4+dfsg1-0ubuntu3 [150 kB] 125s Get:121 http://ftpmaster.internal/ubuntu plucky/universe amd64 python3-cycler all 0.12.1-1 [9716 B] 125s Get:122 http://ftpmaster.internal/ubuntu plucky/universe amd64 python3-fsspec all 2025.2.0-1 [211 kB] 125s Get:123 http://ftpmaster.internal/ubuntu plucky/universe amd64 python3-toolz all 1.0.0-2 [45.0 kB] 125s Get:124 http://ftpmaster.internal/ubuntu plucky/main amd64 python3-packaging all 24.2-1 [51.5 kB] 125s Get:125 http://ftpmaster.internal/ubuntu plucky/universe amd64 python3-locket all 1.0.0-2 [5872 B] 125s Get:126 http://ftpmaster.internal/ubuntu plucky/universe amd64 python3-partd all 1.4.2-1 [15.7 kB] 125s Get:127 http://ftpmaster.internal/ubuntu plucky/universe amd64 python3-dask all 2024.12.1+dfsg-2 [875 kB] 125s Get:128 http://ftpmaster.internal/ubuntu plucky/universe amd64 python3-debugpy amd64 1.8.8+ds-2ubuntu1 [1145 kB] 125s Get:129 http://ftpmaster.internal/ubuntu plucky/main amd64 python3-decorator all 5.1.1-5 [10.1 kB] 125s Get:130 http://ftpmaster.internal/ubuntu plucky/main amd64 python3-defusedxml all 0.7.1-3 [42.2 kB] 125s Get:131 http://ftpmaster.internal/ubuntu plucky/universe amd64 python3-dill all 0.3.9-1 [84.5 kB] 125s Get:132 http://ftpmaster.internal/ubuntu plucky/main amd64 python3-msgpack amd64 1.0.3-3build3 [113 kB] 125s Get:133 http://ftpmaster.internal/ubuntu plucky/main amd64 python3-psutil amd64 5.9.8-2build3 [196 kB] 125s Get:134 http://ftpmaster.internal/ubuntu plucky/main amd64 python3-sortedcontainers all 2.4.0-2 [27.6 kB] 125s Get:135 http://ftpmaster.internal/ubuntu plucky/universe amd64 python3-tblib all 3.0.0-6 [13.0 kB] 125s Get:136 http://ftpmaster.internal/ubuntu plucky/main amd64 python3-tornado amd64 6.4.2-1 [299 kB] 125s Get:137 http://ftpmaster.internal/ubuntu plucky/universe amd64 python3-zict all 3.0.0-2ubuntu1 [30.4 kB] 125s Get:138 http://ftpmaster.internal/ubuntu plucky/universe amd64 python3-distributed all 2024.12.1+ds-1 [1019 kB] 125s Get:139 http://ftpmaster.internal/ubuntu plucky/universe amd64 python3-executing all 2.2.0-0.1 [25.0 kB] 125s Get:140 http://ftpmaster.internal/ubuntu plucky/universe amd64 python3-fastjsonschema all 2.21.1-1 [20.4 kB] 125s Get:141 http://ftpmaster.internal/ubuntu plucky/main amd64 python3-pytz all 2025.1-3 [162 kB] 125s Get:142 http://ftpmaster.internal/ubuntu plucky/main amd64 python3-tz all 2025.1-3 [1866 B] 125s Get:143 http://ftpmaster.internal/ubuntu plucky/main amd64 python3-platformdirs all 4.3.6-1 [16.8 kB] 125s Get:144 http://ftpmaster.internal/ubuntu plucky/universe amd64 python3-fs all 2.4.16-6 [90.7 kB] 125s Get:145 http://ftpmaster.internal/ubuntu plucky/main amd64 python3-lxml amd64 5.3.1-1 [1831 kB] 125s Get:146 http://ftpmaster.internal/ubuntu plucky/universe amd64 python3-lz4 amd64 4.4.0+dfsg-1 [27.4 kB] 125s Get:147 http://ftpmaster.internal/ubuntu plucky/universe amd64 python3-scipy amd64 1.14.1-4ubuntu1 [22.3 MB] 125s Get:148 http://ftpmaster.internal/ubuntu plucky/universe amd64 python3-mpmath all 1.3.0-1 [425 kB] 125s Get:149 http://ftpmaster.internal/ubuntu plucky-proposed/universe amd64 python3-sympy all 1.13.3-3 [4228 kB] 125s Get:150 http://ftpmaster.internal/ubuntu plucky/universe amd64 python3-ufolib2 all 0.17.0+dfsg1-1 [33.5 kB] 125s Get:151 http://ftpmaster.internal/ubuntu plucky/universe amd64 unicode-data all 15.1.0-1 [8878 kB] 125s Get:152 http://ftpmaster.internal/ubuntu plucky/universe amd64 python3-fonttools amd64 4.55.3-2 [1755 kB] 125s Get:153 http://ftpmaster.internal/ubuntu plucky/universe amd64 python3-fqdn all 1.5.1-2 [7688 B] 125s Get:154 http://ftpmaster.internal/ubuntu plucky/universe amd64 python3-h5py-serial amd64 3.12.1-1 [1677 kB] 125s Get:155 http://ftpmaster.internal/ubuntu plucky/universe amd64 python3-h5py all 3.12.1-1 [7970 B] 125s Get:156 http://ftpmaster.internal/ubuntu plucky/universe amd64 python3-iniconfig all 1.1.1-2 [6024 B] 125s Get:157 http://ftpmaster.internal/ubuntu plucky/universe amd64 python3-parso all 0.8.4-1 [67.6 kB] 125s Get:158 http://ftpmaster.internal/ubuntu plucky/universe amd64 python3-typeshed all 0.0~git20241223.ea91db2-1 [1548 kB] 125s Get:159 http://ftpmaster.internal/ubuntu plucky/universe amd64 python3-jedi all 0.19.1+ds1-1 [693 kB] 125s Get:160 http://ftpmaster.internal/ubuntu plucky/universe amd64 python3-matplotlib-inline all 0.1.6-2 [8784 B] 125s Get:161 http://ftpmaster.internal/ubuntu plucky/main amd64 python3-wcwidth all 0.2.13+dfsg1-1 [26.3 kB] 125s Get:162 http://ftpmaster.internal/ubuntu plucky/universe amd64 python3-prompt-toolkit all 3.0.50-1 [257 kB] 125s Get:163 http://ftpmaster.internal/ubuntu plucky/universe amd64 python3-pure-eval all 0.2.3-1 [11.4 kB] 125s Get:164 http://ftpmaster.internal/ubuntu plucky/universe amd64 python3-stack-data all 0.6.3-1 [22.0 kB] 125s Get:165 http://ftpmaster.internal/ubuntu plucky/main amd64 python3-ptyprocess all 0.7.0-6 [14.8 kB] 125s Get:166 http://ftpmaster.internal/ubuntu plucky/main amd64 python3-pexpect all 4.9-3 [48.1 kB] 125s Get:167 http://ftpmaster.internal/ubuntu plucky/universe amd64 python3-ipython all 8.30.0-2 [569 kB] 125s Get:168 http://ftpmaster.internal/ubuntu plucky/universe amd64 python3-jupyter-core all 5.7.2-5 [28.1 kB] 125s Get:169 http://ftpmaster.internal/ubuntu plucky/universe amd64 python3-zmq amd64 26.2.1-1 [226 kB] 125s Get:170 http://ftpmaster.internal/ubuntu plucky/universe amd64 python3-jupyter-client all 8.6.3-2 [78.5 kB] 125s Get:171 http://ftpmaster.internal/ubuntu plucky/universe amd64 python3-nest-asyncio all 1.5.4-1 [6256 B] 125s Get:172 http://ftpmaster.internal/ubuntu plucky/universe amd64 python3-ipykernel all 6.29.5-2 [82.7 kB] 125s Get:173 http://ftpmaster.internal/ubuntu plucky/universe amd64 python3-isoduration all 20.11.0+git20211126.ae0bd61-2 [12.5 kB] 125s Get:174 http://ftpmaster.internal/ubuntu plucky/universe amd64 python3-joblib all 1.4.2-2 [205 kB] 125s Get:175 http://ftpmaster.internal/ubuntu plucky/universe amd64 python3-pythonjsonlogger all 3.2.1-1 [12.3 kB] 125s Get:176 http://ftpmaster.internal/ubuntu plucky/universe amd64 python3-rfc3339-validator all 0.1.4-2 [3930 B] 125s Get:177 http://ftpmaster.internal/ubuntu plucky/universe amd64 python3-rfc3986-validator all 0.1.1-2 [4758 B] 125s Get:178 http://ftpmaster.internal/ubuntu plucky/universe amd64 python3-uritemplate all 4.1.1-3 [9762 B] 126s Get:179 http://ftpmaster.internal/ubuntu plucky/universe amd64 python3-webcolors all 1.13-1 [13.6 kB] 126s Get:180 http://ftpmaster.internal/ubuntu plucky/universe amd64 python3-jupyter-events all 0.10.0-4 [15.6 kB] 126s Get:181 http://ftpmaster.internal/ubuntu plucky/universe amd64 python3-terminado all 0.18.1-1 [13.2 kB] 126s Get:182 http://ftpmaster.internal/ubuntu plucky/universe amd64 python3-jupyter-server-terminals all 0.5.3-2 [10.9 kB] 126s Get:183 http://ftpmaster.internal/ubuntu plucky/universe amd64 python3-tinycss2 all 1.4.0-1 [22.5 kB] 126s Get:184 http://ftpmaster.internal/ubuntu plucky/universe amd64 python3-jupyterlab-pygments all 0.2.2-3 [6054 B] 126s Get:185 http://ftpmaster.internal/ubuntu plucky/universe amd64 python3-mistune all 3.0.2-2 [32.9 kB] 126s Get:186 http://ftpmaster.internal/ubuntu plucky/universe amd64 python3-nbformat all 5.9.1-1 [41.2 kB] 126s Get:187 http://ftpmaster.internal/ubuntu plucky/universe amd64 python3-nbclient all 0.8.0-2 [53.9 kB] 126s Get:188 http://ftpmaster.internal/ubuntu plucky/universe amd64 python3-pandocfilters all 1.5.1-1 [23.6 kB] 126s Get:189 http://ftpmaster.internal/ubuntu plucky/universe amd64 python3-nbconvert all 7.16.6-1 [140 kB] 126s Get:190 http://ftpmaster.internal/ubuntu plucky/universe amd64 python3-overrides all 7.7.0-2 [14.4 kB] 126s Get:191 http://ftpmaster.internal/ubuntu plucky/main amd64 python3-prometheus-client all 0.21.1+ds1-1 [45.8 kB] 126s Get:192 http://ftpmaster.internal/ubuntu plucky/universe amd64 python3-send2trash all 1.8.3-1 [14.6 kB] 126s Get:193 http://ftpmaster.internal/ubuntu plucky/universe amd64 python3-websocket all 1.8.0-2 [38.5 kB] 126s Get:194 http://ftpmaster.internal/ubuntu plucky/universe amd64 python3-jupyter-server all 2.14.2-5 [183 kB] 126s Get:195 http://ftpmaster.internal/ubuntu plucky/universe amd64 python3-kiwisolver amd64 1.4.7-3 [70.4 kB] 126s Get:196 http://ftpmaster.internal/ubuntu plucky/main amd64 libopenjp2-7 amd64 2.5.0-2ubuntu3 [217 kB] 126s Get:197 http://ftpmaster.internal/ubuntu plucky/main amd64 python3-pil amd64 11.1.0-5 [589 kB] 126s Get:198 http://ftpmaster.internal/ubuntu plucky/main amd64 python3.12-tk amd64 3.12.9-1 [116 kB] 126s Get:199 http://ftpmaster.internal/ubuntu plucky/main amd64 python3.13-tk amd64 3.13.2-1 [107 kB] 126s Get:200 http://ftpmaster.internal/ubuntu plucky/main amd64 python3-tk amd64 3.13.1-1 [9770 B] 126s Get:201 http://ftpmaster.internal/ubuntu plucky/universe amd64 python3-pil.imagetk amd64 11.1.0-5 [9936 B] 126s Get:202 http://ftpmaster.internal/ubuntu plucky/universe amd64 python3-matplotlib amd64 3.8.3-3ubuntu2 [4697 kB] 126s Get:203 http://ftpmaster.internal/ubuntu plucky/main amd64 python3-nacl amd64 1.5.0-7 [61.0 kB] 126s Get:204 http://ftpmaster.internal/ubuntu plucky/universe amd64 python3-netcdf4 amd64 1.7.2-1build3 [942 kB] 126s Get:205 http://ftpmaster.internal/ubuntu plucky/universe amd64 python3-pandas-lib amd64 2.2.3+dfsg-8 [8248 kB] 126s Get:206 http://ftpmaster.internal/ubuntu plucky/universe amd64 python3-pandas all 2.2.3+dfsg-8 [3112 kB] 126s Get:207 http://ftpmaster.internal/ubuntu plucky/main amd64 python3-paramiko all 3.5.1-2ubuntu1 [147 kB] 126s Get:208 http://ftpmaster.internal/ubuntu plucky/universe amd64 python3-pluggy all 1.5.0-1 [21.0 kB] 126s Get:209 http://ftpmaster.internal/ubuntu plucky/universe amd64 python3-pytest all 8.3.4-1 [252 kB] 126s Get:210 http://ftpmaster.internal/ubuntu plucky/universe amd64 python3-pytest-rerunfailures all 15.0-1 [13.9 kB] 126s Get:211 http://ftpmaster.internal/ubuntu plucky/universe amd64 python3-pytest-timeout all 2.3.1-1 [22.1 kB] 126s Get:212 http://ftpmaster.internal/ubuntu plucky/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 126s Get:213 http://ftpmaster.internal/ubuntu plucky/universe amd64 python3-sklearn-lib amd64 1.4.2+dfsg-7build1 [6872 kB] 126s Get:214 http://ftpmaster.internal/ubuntu plucky/universe amd64 python3-sklearn all 1.4.2+dfsg-7build1 [2258 kB] 126s Get:215 http://ftpmaster.internal/ubuntu plucky/main amd64 tzdata-legacy all 2025a-2ubuntu1 [99.2 kB] 127s Preconfiguring packages ... 127s Fetched 192 MB in 2s (90.5 MB/s) 127s Selecting previously unselected package python3.12-minimal. 127s (Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 108970 files and directories currently installed.) 127s Preparing to unpack .../000-python3.12-minimal_3.12.9-1_amd64.deb ... 127s Unpacking python3.12-minimal (3.12.9-1) ... 127s Selecting previously unselected package fonts-lato. 127s Preparing to unpack .../001-fonts-lato_2.015-1_all.deb ... 127s Unpacking fonts-lato (2.015-1) ... 127s Selecting previously unselected package libdebuginfod-common. 127s Preparing to unpack .../002-libdebuginfod-common_0.192-4_all.deb ... 127s Unpacking libdebuginfod-common (0.192-4) ... 127s Selecting previously unselected package python3-numpy-dev:amd64. 127s Preparing to unpack .../003-python3-numpy-dev_1%3a2.2.3+ds-2_amd64.deb ... 127s Unpacking python3-numpy-dev:amd64 (1:2.2.3+ds-2) ... 127s Selecting previously unselected package libblas3:amd64. 127s Preparing to unpack .../004-libblas3_3.12.1-2_amd64.deb ... 127s Unpacking libblas3:amd64 (3.12.1-2) ... 127s Selecting previously unselected package libgfortran5:amd64. 127s Preparing to unpack .../005-libgfortran5_15-20250213-1ubuntu1_amd64.deb ... 127s Unpacking libgfortran5:amd64 (15-20250213-1ubuntu1) ... 127s Selecting previously unselected package liblapack3:amd64. 127s Preparing to unpack .../006-liblapack3_3.12.1-2_amd64.deb ... 127s Unpacking liblapack3:amd64 (3.12.1-2) ... 128s Selecting previously unselected package python3-numpy. 128s Preparing to unpack .../007-python3-numpy_1%3a2.2.3+ds-2_amd64.deb ... 128s Unpacking python3-numpy (1:2.2.3+ds-2) ... 128s Selecting previously unselected package python3.12. 128s Preparing to unpack .../008-python3.12_3.12.9-1_amd64.deb ... 128s Unpacking python3.12 (3.12.9-1) ... 128s Selecting previously unselected package libtcl8.6:amd64. 128s Preparing to unpack .../009-libtcl8.6_8.6.16+dfsg-1_amd64.deb ... 128s Unpacking libtcl8.6:amd64 (8.6.16+dfsg-1) ... 128s Selecting previously unselected package fonts-dejavu-mono. 128s Preparing to unpack .../010-fonts-dejavu-mono_2.37-8_all.deb ... 128s Unpacking fonts-dejavu-mono (2.37-8) ... 128s Selecting previously unselected package fonts-dejavu-core. 128s Preparing to unpack .../011-fonts-dejavu-core_2.37-8_all.deb ... 128s Unpacking fonts-dejavu-core (2.37-8) ... 128s Selecting previously unselected package fontconfig-config. 128s Preparing to unpack .../012-fontconfig-config_2.15.0-2ubuntu1_amd64.deb ... 128s Unpacking fontconfig-config (2.15.0-2ubuntu1) ... 128s Selecting previously unselected package libfontconfig1:amd64. 128s Preparing to unpack .../013-libfontconfig1_2.15.0-2ubuntu1_amd64.deb ... 128s Unpacking libfontconfig1:amd64 (2.15.0-2ubuntu1) ... 128s Selecting previously unselected package libxrender1:amd64. 128s Preparing to unpack .../014-libxrender1_1%3a0.9.10-1.1build1_amd64.deb ... 128s Unpacking libxrender1:amd64 (1:0.9.10-1.1build1) ... 129s Selecting previously unselected package libxft2:amd64. 129s Preparing to unpack .../015-libxft2_2.3.6-1build1_amd64.deb ... 129s Unpacking libxft2:amd64 (2.3.6-1build1) ... 129s Selecting previously unselected package x11-common. 129s Preparing to unpack .../016-x11-common_1%3a7.7+23ubuntu3_all.deb ... 129s Unpacking x11-common (1:7.7+23ubuntu3) ... 129s Selecting previously unselected package libxss1:amd64. 129s Preparing to unpack .../017-libxss1_1%3a1.2.3-1build3_amd64.deb ... 129s Unpacking libxss1:amd64 (1:1.2.3-1build3) ... 129s Selecting previously unselected package libtk8.6:amd64. 129s Preparing to unpack .../018-libtk8.6_8.6.16-1_amd64.deb ... 129s Unpacking libtk8.6:amd64 (8.6.16-1) ... 129s Selecting previously unselected package tk8.6-blt2.5. 129s Preparing to unpack .../019-tk8.6-blt2.5_2.5.3+dfsg-7build1_amd64.deb ... 129s Unpacking tk8.6-blt2.5 (2.5.3+dfsg-7build1) ... 129s Selecting previously unselected package blt. 129s Preparing to unpack .../020-blt_2.5.3+dfsg-7build1_amd64.deb ... 129s Unpacking blt (2.5.3+dfsg-7build1) ... 129s Selecting previously unselected package fonts-font-awesome. 129s Preparing to unpack .../021-fonts-font-awesome_5.0.10+really4.7.0~dfsg-4.1_all.deb ... 129s Unpacking fonts-font-awesome (5.0.10+really4.7.0~dfsg-4.1) ... 129s Selecting previously unselected package fonts-glyphicons-halflings. 129s Preparing to unpack .../022-fonts-glyphicons-halflings_1.009~3.4.1+dfsg-3_all.deb ... 129s Unpacking fonts-glyphicons-halflings (1.009~3.4.1+dfsg-3) ... 129s Selecting previously unselected package fonts-lyx. 129s Preparing to unpack .../023-fonts-lyx_2.4.3-1_all.deb ... 129s Unpacking fonts-lyx (2.4.3-1) ... 129s Selecting previously unselected package fonts-mathjax. 129s Preparing to unpack .../024-fonts-mathjax_2.7.9+dfsg-1_all.deb ... 129s Unpacking fonts-mathjax (2.7.9+dfsg-1) ... 129s Selecting previously unselected package libbabeltrace1:amd64. 129s Preparing to unpack .../025-libbabeltrace1_1.5.11-4build1_amd64.deb ... 129s Unpacking libbabeltrace1:amd64 (1.5.11-4build1) ... 129s Selecting previously unselected package libdebuginfod1t64:amd64. 129s Preparing to unpack .../026-libdebuginfod1t64_0.192-4_amd64.deb ... 129s Unpacking libdebuginfod1t64:amd64 (0.192-4) ... 129s Selecting previously unselected package libipt2. 129s Preparing to unpack .../027-libipt2_2.1.2-1_amd64.deb ... 129s Unpacking libipt2 (2.1.2-1) ... 129s Selecting previously unselected package libsource-highlight-common. 129s Preparing to unpack .../028-libsource-highlight-common_3.1.9-4.3build1_all.deb ... 129s Unpacking libsource-highlight-common (3.1.9-4.3build1) ... 129s Selecting previously unselected package libsource-highlight4t64:amd64. 129s Preparing to unpack .../029-libsource-highlight4t64_3.1.9-4.3build1_amd64.deb ... 129s Unpacking libsource-highlight4t64:amd64 (3.1.9-4.3build1) ... 129s Selecting previously unselected package gdb. 129s Preparing to unpack .../030-gdb_16.2-1ubuntu1_amd64.deb ... 129s Unpacking gdb (16.2-1ubuntu1) ... 130s Selecting previously unselected package libaec0:amd64. 130s Preparing to unpack .../031-libaec0_1.1.3-1_amd64.deb ... 130s Unpacking libaec0:amd64 (1.1.3-1) ... 130s Selecting previously unselected package libargon2-1:amd64. 130s Preparing to unpack .../032-libargon2-1_0~20190702+dfsg-4build1_amd64.deb ... 130s Unpacking libargon2-1:amd64 (0~20190702+dfsg-4build1) ... 130s Selecting previously unselected package libcares2:amd64. 130s Preparing to unpack .../033-libcares2_1.34.4-2.1_amd64.deb ... 130s Unpacking libcares2:amd64 (1.34.4-2.1) ... 130s Selecting previously unselected package libdeflate0:amd64. 130s Preparing to unpack .../034-libdeflate0_1.23-1_amd64.deb ... 130s Unpacking libdeflate0:amd64 (1.23-1) ... 130s Selecting previously unselected package libgomp1:amd64. 130s Preparing to unpack .../035-libgomp1_15-20250213-1ubuntu1_amd64.deb ... 130s Unpacking libgomp1:amd64 (15-20250213-1ubuntu1) ... 130s Selecting previously unselected package libgraphite2-3:amd64. 130s Preparing to unpack .../036-libgraphite2-3_1.3.14-2ubuntu1_amd64.deb ... 130s Unpacking libgraphite2-3:amd64 (1.3.14-2ubuntu1) ... 130s Selecting previously unselected package libharfbuzz0b:amd64. 130s Preparing to unpack .../037-libharfbuzz0b_10.2.0-1_amd64.deb ... 130s Unpacking libharfbuzz0b:amd64 (10.2.0-1) ... 130s Selecting previously unselected package libsz2:amd64. 130s Preparing to unpack .../038-libsz2_1.1.3-1_amd64.deb ... 130s Unpacking libsz2:amd64 (1.1.3-1) ... 130s Selecting previously unselected package libhdf5-310:amd64. 130s Preparing to unpack .../039-libhdf5-310_1.14.5+repack-3_amd64.deb ... 130s Unpacking libhdf5-310:amd64 (1.14.5+repack-3) ... 130s Selecting previously unselected package libhdf5-hl-310:amd64. 130s Preparing to unpack .../040-libhdf5-hl-310_1.14.5+repack-3_amd64.deb ... 130s Unpacking libhdf5-hl-310:amd64 (1.14.5+repack-3) ... 130s Selecting previously unselected package libimagequant0:amd64. 130s Preparing to unpack .../041-libimagequant0_2.18.0-1build1_amd64.deb ... 130s Unpacking libimagequant0:amd64 (2.18.0-1build1) ... 130s Selecting previously unselected package libjpeg-turbo8:amd64. 130s Preparing to unpack .../042-libjpeg-turbo8_2.1.5-3ubuntu2_amd64.deb ... 130s Unpacking libjpeg-turbo8:amd64 (2.1.5-3ubuntu2) ... 130s Selecting previously unselected package libjpeg8:amd64. 130s Preparing to unpack .../043-libjpeg8_8c-2ubuntu11_amd64.deb ... 130s Unpacking libjpeg8:amd64 (8c-2ubuntu11) ... 130s Selecting previously unselected package libjs-bootstrap. 130s Preparing to unpack .../044-libjs-bootstrap_3.4.1+dfsg-3_all.deb ... 130s Unpacking libjs-bootstrap (3.4.1+dfsg-3) ... 130s Selecting previously unselected package libjs-jquery. 130s Preparing to unpack .../045-libjs-jquery_3.6.1+dfsg+~3.5.14-1_all.deb ... 130s Unpacking libjs-jquery (3.6.1+dfsg+~3.5.14-1) ... 130s Selecting previously unselected package libjs-jquery-ui. 130s Preparing to unpack .../046-libjs-jquery-ui_1.13.2+dfsg-1_all.deb ... 130s Unpacking libjs-jquery-ui (1.13.2+dfsg-1) ... 130s Selecting previously unselected package libjs-underscore. 130s Preparing to unpack .../047-libjs-underscore_1.13.4~dfsg+~1.11.4-3_all.deb ... 130s Unpacking libjs-underscore (1.13.4~dfsg+~1.11.4-3) ... 130s Selecting previously unselected package libjs-sphinxdoc. 130s Preparing to unpack .../048-libjs-sphinxdoc_8.1.3-4_all.deb ... 130s Unpacking libjs-sphinxdoc (8.1.3-4) ... 130s Selecting previously unselected package libjs-sprintf-js. 130s Preparing to unpack .../049-libjs-sprintf-js_1.1.2+ds1+~1.1.2-1_all.deb ... 130s Unpacking libjs-sprintf-js (1.1.2+ds1+~1.1.2-1) ... 130s Selecting previously unselected package liblbfgsb0:amd64. 130s Preparing to unpack .../050-liblbfgsb0_3.0+dfsg.4-1build1_amd64.deb ... 130s Unpacking liblbfgsb0:amd64 (3.0+dfsg.4-1build1) ... 130s Selecting previously unselected package liblcms2-2:amd64. 130s Preparing to unpack .../051-liblcms2-2_2.16-2_amd64.deb ... 130s Unpacking liblcms2-2:amd64 (2.16-2) ... 130s Selecting previously unselected package liblerc4:amd64. 130s Preparing to unpack .../052-liblerc4_4.0.0+ds-5ubuntu1_amd64.deb ... 130s Unpacking liblerc4:amd64 (4.0.0+ds-5ubuntu1) ... 130s Selecting previously unselected package liblzf1:amd64. 130s Preparing to unpack .../053-liblzf1_3.6-4_amd64.deb ... 130s Unpacking liblzf1:amd64 (3.6-4) ... 131s Selecting previously unselected package libnetcdf22:amd64. 131s Preparing to unpack .../054-libnetcdf22_1%3a4.9.3-1_amd64.deb ... 131s Unpacking libnetcdf22:amd64 (1:4.9.3-1) ... 131s Selecting previously unselected package node-xtend. 131s Preparing to unpack .../055-node-xtend_4.0.2-3_all.deb ... 131s Unpacking node-xtend (4.0.2-3) ... 131s Selecting previously unselected package nodejs. 131s Preparing to unpack .../056-nodejs_20.18.1+dfsg-1ubuntu2_amd64.deb ... 131s Unpacking nodejs (20.18.1+dfsg-1ubuntu2) ... 131s Selecting previously unselected package node-acorn. 131s Preparing to unpack .../057-node-acorn_8.8.1+ds+~cs25.17.7-2_all.deb ... 131s Unpacking node-acorn (8.8.1+ds+~cs25.17.7-2) ... 131s Selecting previously unselected package node-cjs-module-lexer. 131s Preparing to unpack .../058-node-cjs-module-lexer_1.2.3+dfsg-1_all.deb ... 131s Unpacking node-cjs-module-lexer (1.2.3+dfsg-1) ... 131s Selecting previously unselected package node-balanced-match. 131s Preparing to unpack .../059-node-balanced-match_2.0.0-1_all.deb ... 131s Unpacking node-balanced-match (2.0.0-1) ... 131s Selecting previously unselected package node-brace-expansion. 131s Preparing to unpack .../060-node-brace-expansion_2.0.1+~1.1.0-1_all.deb ... 131s Unpacking node-brace-expansion (2.0.1+~1.1.0-1) ... 131s Selecting previously unselected package node-minimatch. 131s Preparing to unpack .../061-node-minimatch_9.0.3-5_all.deb ... 131s Unpacking node-minimatch (9.0.3-5) ... 131s Selecting previously unselected package node-undici. 131s Preparing to unpack .../062-node-undici_7.3.0+dfsg1+~cs24.12.11-1_all.deb ... 131s Unpacking node-undici (7.3.0+dfsg1+~cs24.12.11-1) ... 131s Selecting previously unselected package libnode115:amd64. 131s Preparing to unpack .../063-libnode115_20.18.1+dfsg-1ubuntu2_amd64.deb ... 131s Unpacking libnode115:amd64 (20.18.1+dfsg-1ubuntu2) ... 131s Selecting previously unselected package libnorm1t64:amd64. 131s Preparing to unpack .../064-libnorm1t64_1.5.9+dfsg-3.1build1_amd64.deb ... 131s Unpacking libnorm1t64:amd64 (1.5.9+dfsg-3.1build1) ... 131s Selecting previously unselected package libpgm-5.3-0t64:amd64. 131s Preparing to unpack .../065-libpgm-5.3-0t64_5.3.128~dfsg-2.1build1_amd64.deb ... 131s Unpacking libpgm-5.3-0t64:amd64 (5.3.128~dfsg-2.1build1) ... 131s Selecting previously unselected package libqhull-r8.0:amd64. 131s Preparing to unpack .../066-libqhull-r8.0_2020.2-6build1_amd64.deb ... 131s Unpacking libqhull-r8.0:amd64 (2020.2-6build1) ... 131s Selecting previously unselected package libraqm0:amd64. 131s Preparing to unpack .../067-libraqm0_0.10.2-1_amd64.deb ... 131s Unpacking libraqm0:amd64 (0.10.2-1) ... 131s Selecting previously unselected package libsharpyuv0:amd64. 131s Preparing to unpack .../068-libsharpyuv0_1.5.0-0.1_amd64.deb ... 131s Unpacking libsharpyuv0:amd64 (1.5.0-0.1) ... 131s Selecting previously unselected package libsodium23:amd64. 131s Preparing to unpack .../069-libsodium23_1.0.18-1build3_amd64.deb ... 131s Unpacking libsodium23:amd64 (1.0.18-1build3) ... 131s Selecting previously unselected package libjbig0:amd64. 132s Preparing to unpack .../070-libjbig0_2.1-6.1ubuntu2_amd64.deb ... 132s Unpacking libjbig0:amd64 (2.1-6.1ubuntu2) ... 132s Selecting previously unselected package libwebp7:amd64. 132s Preparing to unpack .../071-libwebp7_1.5.0-0.1_amd64.deb ... 132s Unpacking libwebp7:amd64 (1.5.0-0.1) ... 132s Selecting previously unselected package libtiff6:amd64. 132s Preparing to unpack .../072-libtiff6_4.5.1+git230720-4ubuntu4_amd64.deb ... 132s Unpacking libtiff6:amd64 (4.5.1+git230720-4ubuntu4) ... 132s Selecting previously unselected package libwebpdemux2:amd64. 132s Preparing to unpack .../073-libwebpdemux2_1.5.0-0.1_amd64.deb ... 132s Unpacking libwebpdemux2:amd64 (1.5.0-0.1) ... 132s Selecting previously unselected package libwebpmux3:amd64. 132s Preparing to unpack .../074-libwebpmux3_1.5.0-0.1_amd64.deb ... 132s Unpacking libwebpmux3:amd64 (1.5.0-0.1) ... 132s Selecting previously unselected package libxslt1.1:amd64. 132s Preparing to unpack .../075-libxslt1.1_1.1.39-0exp1ubuntu2_amd64.deb ... 132s Unpacking libxslt1.1:amd64 (1.1.39-0exp1ubuntu2) ... 132s Selecting previously unselected package libzmq5:amd64. 132s Preparing to unpack .../076-libzmq5_4.3.5-1build2_amd64.deb ... 132s Unpacking libzmq5:amd64 (4.3.5-1build2) ... 132s Selecting previously unselected package node-esprima. 132s Preparing to unpack .../077-node-esprima_4.0.1+ds+~4.0.3-2_all.deb ... 132s Unpacking node-esprima (4.0.1+ds+~4.0.3-2) ... 132s Selecting previously unselected package node-sprintf-js. 132s Preparing to unpack .../078-node-sprintf-js_1.1.2+ds1+~1.1.2-1_all.deb ... 132s Unpacking node-sprintf-js (1.1.2+ds1+~1.1.2-1) ... 132s Selecting previously unselected package node-argparse. 132s Preparing to unpack .../079-node-argparse_2.0.1-2_all.deb ... 132s Unpacking node-argparse (2.0.1-2) ... 132s Selecting previously unselected package node-js-yaml. 132s Preparing to unpack .../080-node-js-yaml_4.1.0+dfsg+~4.0.5-7_all.deb ... 132s Unpacking node-js-yaml (4.1.0+dfsg+~4.0.5-7) ... 132s Selecting previously unselected package libjs-mathjax. 132s Preparing to unpack .../081-libjs-mathjax_2.7.9+dfsg-1_all.deb ... 132s Unpacking libjs-mathjax (2.7.9+dfsg-1) ... 133s Selecting previously unselected package python-dask-doc. 133s Preparing to unpack .../082-python-dask-doc_2024.12.1+dfsg-2_all.deb ... 133s Unpacking python-dask-doc (2024.12.1+dfsg-2) ... 133s Selecting previously unselected package sphinx-rtd-theme-common. 133s Preparing to unpack .../083-sphinx-rtd-theme-common_3.0.2+dfsg-2_all.deb ... 133s Unpacking sphinx-rtd-theme-common (3.0.2+dfsg-2) ... 133s Selecting previously unselected package python-fsspec-doc. 133s Preparing to unpack .../084-python-fsspec-doc_2025.2.0-1_all.deb ... 133s Unpacking python-fsspec-doc (2025.2.0-1) ... 133s Selecting previously unselected package python-numpy-doc. 133s Preparing to unpack .../085-python-numpy-doc_1%3a2.2.3+ds-2_all.deb ... 133s Unpacking python-numpy-doc (1:2.2.3+ds-2) ... 134s Selecting previously unselected package python-pandas-doc. 134s Preparing to unpack .../086-python-pandas-doc_2.2.3+dfsg-8_all.deb ... 134s Unpacking python-pandas-doc (2.2.3+dfsg-8) ... 136s Selecting previously unselected package python3.13-doc. 136s Preparing to unpack .../087-python3.13-doc_3.13.2-1_all.deb ... 136s Unpacking python3.13-doc (3.13.2-1) ... 136s Selecting previously unselected package python3-doc. 136s Preparing to unpack .../088-python3-doc_3.13.1-1~exp2_all.deb ... 136s Unpacking python3-doc (3.13.1-1~exp2) ... 136s Selecting previously unselected package sass-stylesheets-bulma. 136s Preparing to unpack .../089-sass-stylesheets-bulma_0.9.4~ds-1_all.deb ... 136s Unpacking sass-stylesheets-bulma (0.9.4~ds-1) ... 136s Selecting previously unselected package python-distributed-doc. 136s Preparing to unpack .../090-python-distributed-doc_2024.12.1+ds-1_all.deb ... 136s Unpacking python-distributed-doc (2024.12.1+ds-1) ... 136s Selecting previously unselected package python-matplotlib-data. 136s Preparing to unpack .../091-python-matplotlib-data_3.8.3-3ubuntu2_all.deb ... 136s Unpacking python-matplotlib-data (3.8.3-3ubuntu2) ... 136s Selecting previously unselected package python-tinycss2-common. 136s Preparing to unpack .../092-python-tinycss2-common_1.4.0-1_all.deb ... 136s Unpacking python-tinycss2-common (1.4.0-1) ... 136s Selecting previously unselected package python3-aiohappyeyeballs. 136s Preparing to unpack .../093-python3-aiohappyeyeballs_2.4.6-1_all.deb ... 136s Unpacking python3-aiohappyeyeballs (2.4.6-1) ... 136s Selecting previously unselected package python3-multidict. 136s Preparing to unpack .../094-python3-multidict_6.1.0-1build1_amd64.deb ... 136s Unpacking python3-multidict (6.1.0-1build1) ... 137s Selecting previously unselected package python3-yarl. 137s Preparing to unpack .../095-python3-yarl_1.13.1-1build1_amd64.deb ... 137s Unpacking python3-yarl (1.13.1-1build1) ... 137s Selecting previously unselected package python3-async-timeout. 137s Preparing to unpack .../096-python3-async-timeout_5.0.1-1_all.deb ... 137s Unpacking python3-async-timeout (5.0.1-1) ... 137s Selecting previously unselected package python3-frozenlist. 137s Preparing to unpack .../097-python3-frozenlist_1.5.0-1build1_amd64.deb ... 137s Unpacking python3-frozenlist (1.5.0-1build1) ... 137s Selecting previously unselected package python3-aiosignal. 137s Preparing to unpack .../098-python3-aiosignal_1.3.2-1_all.deb ... 137s Unpacking python3-aiosignal (1.3.2-1) ... 137s Selecting previously unselected package python3-aiohttp. 137s Preparing to unpack .../099-python3-aiohttp_3.10.11-1_amd64.deb ... 137s Unpacking python3-aiohttp (3.10.11-1) ... 137s Selecting previously unselected package python3-all. 137s Preparing to unpack .../100-python3-all_3.13.1-1~exp2_amd64.deb ... 137s Unpacking python3-all (3.13.1-1~exp2) ... 137s Selecting previously unselected package python3-sniffio. 137s Preparing to unpack .../101-python3-sniffio_1.3.1-1_all.deb ... 137s Unpacking python3-sniffio (1.3.1-1) ... 137s Selecting previously unselected package python3-anyio. 137s Preparing to unpack .../102-python3-anyio_4.7.0-1_all.deb ... 137s Unpacking python3-anyio (4.7.0-1) ... 137s Selecting previously unselected package python3-argon2. 137s Preparing to unpack .../103-python3-argon2_21.1.0-3_amd64.deb ... 137s Unpacking python3-argon2 (21.1.0-3) ... 137s Selecting previously unselected package python3-dateutil. 137s Preparing to unpack .../104-python3-dateutil_2.9.0-3_all.deb ... 137s Unpacking python3-dateutil (2.9.0-3) ... 137s Selecting previously unselected package python3-arrow. 137s Preparing to unpack .../105-python3-arrow_1.3.0-1.1ubuntu1_all.deb ... 137s Unpacking python3-arrow (1.3.0-1.1ubuntu1) ... 137s Selecting previously unselected package python3-asttokens. 137s Preparing to unpack .../106-python3-asttokens_3.0.0-1_all.deb ... 137s Unpacking python3-asttokens (3.0.0-1) ... 137s Selecting previously unselected package python3-webencodings. 137s Preparing to unpack .../107-python3-webencodings_0.5.1-5_all.deb ... 137s Unpacking python3-webencodings (0.5.1-5) ... 137s Selecting previously unselected package python3-html5lib. 137s Preparing to unpack .../108-python3-html5lib_1.2-1_all.deb ... 137s Unpacking python3-html5lib (1.2-1) ... 137s Selecting previously unselected package python3-bleach. 137s Preparing to unpack .../109-python3-bleach_6.2.0-1_all.deb ... 137s Unpacking python3-bleach (6.2.0-1) ... 137s Selecting previously unselected package python3-brotli. 137s Preparing to unpack .../110-python3-brotli_1.1.0-2build3_amd64.deb ... 137s Unpacking python3-brotli (1.1.0-2build3) ... 137s Selecting previously unselected package python3-soupsieve. 137s Preparing to unpack .../111-python3-soupsieve_2.6-1_all.deb ... 137s Unpacking python3-soupsieve (2.6-1) ... 137s Selecting previously unselected package python3-bs4. 137s Preparing to unpack .../112-python3-bs4_4.13.3-1_all.deb ... 137s Unpacking python3-bs4 (4.13.3-1) ... 137s Selecting previously unselected package python3-cftime. 137s Preparing to unpack .../113-python3-cftime_1.6.4-1build2_amd64.deb ... 137s Unpacking python3-cftime (1.6.4-1build2) ... 137s Selecting previously unselected package python3-click. 137s Preparing to unpack .../114-python3-click_8.1.8-1_all.deb ... 137s Unpacking python3-click (8.1.8-1) ... 137s Selecting previously unselected package python3-cloudpickle. 137s Preparing to unpack .../115-python3-cloudpickle_3.1.1-1_all.deb ... 137s Unpacking python3-cloudpickle (3.1.1-1) ... 137s Selecting previously unselected package python3-traitlets. 137s Preparing to unpack .../116-python3-traitlets_5.14.3+really5.14.3-1_all.deb ... 137s Unpacking python3-traitlets (5.14.3+really5.14.3-1) ... 138s Selecting previously unselected package python3-comm. 138s Preparing to unpack .../117-python3-comm_0.2.1-1_all.deb ... 138s Unpacking python3-comm (0.2.1-1) ... 138s Selecting previously unselected package python3-contourpy. 138s Preparing to unpack .../118-python3-contourpy_1.3.1-1_amd64.deb ... 138s Unpacking python3-contourpy (1.3.1-1) ... 138s Selecting previously unselected package python3-coverage. 138s Preparing to unpack .../119-python3-coverage_7.4.4+dfsg1-0ubuntu3_amd64.deb ... 138s Unpacking python3-coverage (7.4.4+dfsg1-0ubuntu3) ... 138s Selecting previously unselected package python3-cycler. 138s Preparing to unpack .../120-python3-cycler_0.12.1-1_all.deb ... 138s Unpacking python3-cycler (0.12.1-1) ... 138s Selecting previously unselected package python3-fsspec. 138s Preparing to unpack .../121-python3-fsspec_2025.2.0-1_all.deb ... 138s Unpacking python3-fsspec (2025.2.0-1) ... 138s Selecting previously unselected package python3-toolz. 138s Preparing to unpack .../122-python3-toolz_1.0.0-2_all.deb ... 138s Unpacking python3-toolz (1.0.0-2) ... 138s Selecting previously unselected package python3-packaging. 138s Preparing to unpack .../123-python3-packaging_24.2-1_all.deb ... 138s Unpacking python3-packaging (24.2-1) ... 138s Selecting previously unselected package python3-locket. 138s Preparing to unpack .../124-python3-locket_1.0.0-2_all.deb ... 138s Unpacking python3-locket (1.0.0-2) ... 138s Selecting previously unselected package python3-partd. 138s Preparing to unpack .../125-python3-partd_1.4.2-1_all.deb ... 138s Unpacking python3-partd (1.4.2-1) ... 138s Selecting previously unselected package python3-dask. 138s Preparing to unpack .../126-python3-dask_2024.12.1+dfsg-2_all.deb ... 138s Unpacking python3-dask (2024.12.1+dfsg-2) ... 138s Selecting previously unselected package python3-debugpy. 138s Preparing to unpack .../127-python3-debugpy_1.8.8+ds-2ubuntu1_amd64.deb ... 138s Unpacking python3-debugpy (1.8.8+ds-2ubuntu1) ... 138s Selecting previously unselected package python3-decorator. 138s Preparing to unpack .../128-python3-decorator_5.1.1-5_all.deb ... 138s Unpacking python3-decorator (5.1.1-5) ... 138s Selecting previously unselected package python3-defusedxml. 138s Preparing to unpack .../129-python3-defusedxml_0.7.1-3_all.deb ... 138s Unpacking python3-defusedxml (0.7.1-3) ... 138s Selecting previously unselected package python3-dill. 138s Preparing to unpack .../130-python3-dill_0.3.9-1_all.deb ... 138s Unpacking python3-dill (0.3.9-1) ... 138s Selecting previously unselected package python3-msgpack. 138s Preparing to unpack .../131-python3-msgpack_1.0.3-3build3_amd64.deb ... 138s Unpacking python3-msgpack (1.0.3-3build3) ... 138s Selecting previously unselected package python3-psutil. 138s Preparing to unpack .../132-python3-psutil_5.9.8-2build3_amd64.deb ... 138s Unpacking python3-psutil (5.9.8-2build3) ... 138s Selecting previously unselected package python3-sortedcontainers. 138s Preparing to unpack .../133-python3-sortedcontainers_2.4.0-2_all.deb ... 138s Unpacking python3-sortedcontainers (2.4.0-2) ... 138s Selecting previously unselected package python3-tblib. 138s Preparing to unpack .../134-python3-tblib_3.0.0-6_all.deb ... 138s Unpacking python3-tblib (3.0.0-6) ... 138s Selecting previously unselected package python3-tornado. 138s Preparing to unpack .../135-python3-tornado_6.4.2-1_amd64.deb ... 138s Unpacking python3-tornado (6.4.2-1) ... 139s Selecting previously unselected package python3-zict. 139s Preparing to unpack .../136-python3-zict_3.0.0-2ubuntu1_all.deb ... 139s Unpacking python3-zict (3.0.0-2ubuntu1) ... 139s Selecting previously unselected package python3-distributed. 139s Preparing to unpack .../137-python3-distributed_2024.12.1+ds-1_all.deb ... 139s Unpacking python3-distributed (2024.12.1+ds-1) ... 139s Selecting previously unselected package python3-executing. 139s Preparing to unpack .../138-python3-executing_2.2.0-0.1_all.deb ... 139s Unpacking python3-executing (2.2.0-0.1) ... 139s Selecting previously unselected package python3-fastjsonschema. 139s Preparing to unpack .../139-python3-fastjsonschema_2.21.1-1_all.deb ... 139s Unpacking python3-fastjsonschema (2.21.1-1) ... 139s Selecting previously unselected package python3-pytz. 139s Preparing to unpack .../140-python3-pytz_2025.1-3_all.deb ... 139s Unpacking python3-pytz (2025.1-3) ... 139s Selecting previously unselected package python3-tz. 139s Preparing to unpack .../141-python3-tz_2025.1-3_all.deb ... 139s Unpacking python3-tz (2025.1-3) ... 139s Selecting previously unselected package python3-platformdirs. 139s Preparing to unpack .../142-python3-platformdirs_4.3.6-1_all.deb ... 139s Unpacking python3-platformdirs (4.3.6-1) ... 139s Selecting previously unselected package python3-fs. 139s Preparing to unpack .../143-python3-fs_2.4.16-6_all.deb ... 139s Unpacking python3-fs (2.4.16-6) ... 139s Selecting previously unselected package python3-lxml:amd64. 139s Preparing to unpack .../144-python3-lxml_5.3.1-1_amd64.deb ... 139s Unpacking python3-lxml:amd64 (5.3.1-1) ... 139s Selecting previously unselected package python3-lz4. 139s Preparing to unpack .../145-python3-lz4_4.4.0+dfsg-1_amd64.deb ... 139s Unpacking python3-lz4 (4.4.0+dfsg-1) ... 139s Selecting previously unselected package python3-scipy. 139s Preparing to unpack .../146-python3-scipy_1.14.1-4ubuntu1_amd64.deb ... 139s Unpacking python3-scipy (1.14.1-4ubuntu1) ... 140s Selecting previously unselected package python3-mpmath. 140s Preparing to unpack .../147-python3-mpmath_1.3.0-1_all.deb ... 140s Unpacking python3-mpmath (1.3.0-1) ... 140s Selecting previously unselected package python3-sympy. 140s Preparing to unpack .../148-python3-sympy_1.13.3-3_all.deb ... 140s Unpacking python3-sympy (1.13.3-3) ... 140s Selecting previously unselected package python3-ufolib2. 140s Preparing to unpack .../149-python3-ufolib2_0.17.0+dfsg1-1_all.deb ... 140s Unpacking python3-ufolib2 (0.17.0+dfsg1-1) ... 140s Selecting previously unselected package unicode-data. 140s Preparing to unpack .../150-unicode-data_15.1.0-1_all.deb ... 140s Unpacking unicode-data (15.1.0-1) ... 140s Selecting previously unselected package python3-fonttools. 140s Preparing to unpack .../151-python3-fonttools_4.55.3-2_amd64.deb ... 140s Unpacking python3-fonttools (4.55.3-2) ... 141s Selecting previously unselected package python3-fqdn. 141s Preparing to unpack .../152-python3-fqdn_1.5.1-2_all.deb ... 141s Unpacking python3-fqdn (1.5.1-2) ... 141s Selecting previously unselected package python3-h5py-serial. 141s Preparing to unpack .../153-python3-h5py-serial_3.12.1-1_amd64.deb ... 141s Unpacking python3-h5py-serial (3.12.1-1) ... 141s Selecting previously unselected package python3-h5py. 141s Preparing to unpack .../154-python3-h5py_3.12.1-1_all.deb ... 141s Unpacking python3-h5py (3.12.1-1) ... 141s Selecting previously unselected package python3-iniconfig. 141s Preparing to unpack .../155-python3-iniconfig_1.1.1-2_all.deb ... 141s Unpacking python3-iniconfig (1.1.1-2) ... 141s Selecting previously unselected package python3-parso. 141s Preparing to unpack .../156-python3-parso_0.8.4-1_all.deb ... 141s Unpacking python3-parso (0.8.4-1) ... 141s Selecting previously unselected package python3-typeshed. 141s Preparing to unpack .../157-python3-typeshed_0.0~git20241223.ea91db2-1_all.deb ... 141s Unpacking python3-typeshed (0.0~git20241223.ea91db2-1) ... 142s Selecting previously unselected package python3-jedi. 142s Preparing to unpack .../158-python3-jedi_0.19.1+ds1-1_all.deb ... 142s Unpacking python3-jedi (0.19.1+ds1-1) ... 142s Selecting previously unselected package python3-matplotlib-inline. 142s Preparing to unpack .../159-python3-matplotlib-inline_0.1.6-2_all.deb ... 142s Unpacking python3-matplotlib-inline (0.1.6-2) ... 142s Selecting previously unselected package python3-wcwidth. 142s Preparing to unpack .../160-python3-wcwidth_0.2.13+dfsg1-1_all.deb ... 142s Unpacking python3-wcwidth (0.2.13+dfsg1-1) ... 142s Selecting previously unselected package python3-prompt-toolkit. 142s Preparing to unpack .../161-python3-prompt-toolkit_3.0.50-1_all.deb ... 142s Unpacking python3-prompt-toolkit (3.0.50-1) ... 142s Selecting previously unselected package python3-pure-eval. 142s Preparing to unpack .../162-python3-pure-eval_0.2.3-1_all.deb ... 142s Unpacking python3-pure-eval (0.2.3-1) ... 142s Selecting previously unselected package python3-stack-data. 142s Preparing to unpack .../163-python3-stack-data_0.6.3-1_all.deb ... 142s Unpacking python3-stack-data (0.6.3-1) ... 142s Selecting previously unselected package python3-ptyprocess. 142s Preparing to unpack .../164-python3-ptyprocess_0.7.0-6_all.deb ... 142s Unpacking python3-ptyprocess (0.7.0-6) ... 142s Selecting previously unselected package python3-pexpect. 142s Preparing to unpack .../165-python3-pexpect_4.9-3_all.deb ... 142s Unpacking python3-pexpect (4.9-3) ... 142s Selecting previously unselected package python3-ipython. 142s Preparing to unpack .../166-python3-ipython_8.30.0-2_all.deb ... 142s Unpacking python3-ipython (8.30.0-2) ... 142s Selecting previously unselected package python3-jupyter-core. 142s Preparing to unpack .../167-python3-jupyter-core_5.7.2-5_all.deb ... 142s Unpacking python3-jupyter-core (5.7.2-5) ... 142s Selecting previously unselected package python3-zmq. 142s Preparing to unpack .../168-python3-zmq_26.2.1-1_amd64.deb ... 142s Unpacking python3-zmq (26.2.1-1) ... 142s Selecting previously unselected package python3-jupyter-client. 142s Preparing to unpack .../169-python3-jupyter-client_8.6.3-2_all.deb ... 142s Unpacking python3-jupyter-client (8.6.3-2) ... 142s Selecting previously unselected package python3-nest-asyncio. 142s Preparing to unpack .../170-python3-nest-asyncio_1.5.4-1_all.deb ... 142s Unpacking python3-nest-asyncio (1.5.4-1) ... 142s Selecting previously unselected package python3-ipykernel. 143s Preparing to unpack .../171-python3-ipykernel_6.29.5-2_all.deb ... 143s Unpacking python3-ipykernel (6.29.5-2) ... 143s Selecting previously unselected package python3-isoduration. 143s Preparing to unpack .../172-python3-isoduration_20.11.0+git20211126.ae0bd61-2_all.deb ... 143s Unpacking python3-isoduration (20.11.0+git20211126.ae0bd61-2) ... 143s Selecting previously unselected package python3-joblib. 143s Preparing to unpack .../173-python3-joblib_1.4.2-2_all.deb ... 143s Unpacking python3-joblib (1.4.2-2) ... 143s Selecting previously unselected package python3-pythonjsonlogger. 143s Preparing to unpack .../174-python3-pythonjsonlogger_3.2.1-1_all.deb ... 143s Unpacking python3-pythonjsonlogger (3.2.1-1) ... 143s Selecting previously unselected package python3-rfc3339-validator. 143s Preparing to unpack .../175-python3-rfc3339-validator_0.1.4-2_all.deb ... 143s Unpacking python3-rfc3339-validator (0.1.4-2) ... 143s Selecting previously unselected package python3-rfc3986-validator. 143s Preparing to unpack .../176-python3-rfc3986-validator_0.1.1-2_all.deb ... 143s Unpacking python3-rfc3986-validator (0.1.1-2) ... 143s Selecting previously unselected package python3-uritemplate. 143s Preparing to unpack .../177-python3-uritemplate_4.1.1-3_all.deb ... 143s Unpacking python3-uritemplate (4.1.1-3) ... 143s Selecting previously unselected package python3-webcolors. 143s Preparing to unpack .../178-python3-webcolors_1.13-1_all.deb ... 143s Unpacking python3-webcolors (1.13-1) ... 143s Selecting previously unselected package python3-jupyter-events. 143s Preparing to unpack .../179-python3-jupyter-events_0.10.0-4_all.deb ... 143s Unpacking python3-jupyter-events (0.10.0-4) ... 143s Selecting previously unselected package python3-terminado. 143s Preparing to unpack .../180-python3-terminado_0.18.1-1_all.deb ... 143s Unpacking python3-terminado (0.18.1-1) ... 143s Selecting previously unselected package python3-jupyter-server-terminals. 143s Preparing to unpack .../181-python3-jupyter-server-terminals_0.5.3-2_all.deb ... 143s Unpacking python3-jupyter-server-terminals (0.5.3-2) ... 143s Selecting previously unselected package python3-tinycss2. 143s Preparing to unpack .../182-python3-tinycss2_1.4.0-1_all.deb ... 143s Unpacking python3-tinycss2 (1.4.0-1) ... 143s Selecting previously unselected package python3-jupyterlab-pygments. 143s Preparing to unpack .../183-python3-jupyterlab-pygments_0.2.2-3_all.deb ... 143s Unpacking python3-jupyterlab-pygments (0.2.2-3) ... 143s Selecting previously unselected package python3-mistune. 143s Preparing to unpack .../184-python3-mistune_3.0.2-2_all.deb ... 143s Unpacking python3-mistune (3.0.2-2) ... 143s Selecting previously unselected package python3-nbformat. 143s Preparing to unpack .../185-python3-nbformat_5.9.1-1_all.deb ... 143s Unpacking python3-nbformat (5.9.1-1) ... 143s Selecting previously unselected package python3-nbclient. 143s Preparing to unpack .../186-python3-nbclient_0.8.0-2_all.deb ... 143s Unpacking python3-nbclient (0.8.0-2) ... 143s Selecting previously unselected package python3-pandocfilters. 143s Preparing to unpack .../187-python3-pandocfilters_1.5.1-1_all.deb ... 143s Unpacking python3-pandocfilters (1.5.1-1) ... 143s Selecting previously unselected package python3-nbconvert. 143s Preparing to unpack .../188-python3-nbconvert_7.16.6-1_all.deb ... 143s Unpacking python3-nbconvert (7.16.6-1) ... 143s Selecting previously unselected package python3-overrides. 143s Preparing to unpack .../189-python3-overrides_7.7.0-2_all.deb ... 143s Unpacking python3-overrides (7.7.0-2) ... 143s Selecting previously unselected package python3-prometheus-client. 143s Preparing to unpack .../190-python3-prometheus-client_0.21.1+ds1-1_all.deb ... 143s Unpacking python3-prometheus-client (0.21.1+ds1-1) ... 143s Selecting previously unselected package python3-send2trash. 143s Preparing to unpack .../191-python3-send2trash_1.8.3-1_all.deb ... 143s Unpacking python3-send2trash (1.8.3-1) ... 143s Selecting previously unselected package python3-websocket. 143s Preparing to unpack .../192-python3-websocket_1.8.0-2_all.deb ... 143s Unpacking python3-websocket (1.8.0-2) ... 144s Selecting previously unselected package python3-jupyter-server. 144s Preparing to unpack .../193-python3-jupyter-server_2.14.2-5_all.deb ... 144s Unpacking python3-jupyter-server (2.14.2-5) ... 144s Selecting previously unselected package python3-kiwisolver. 144s Preparing to unpack .../194-python3-kiwisolver_1.4.7-3_amd64.deb ... 144s Unpacking python3-kiwisolver (1.4.7-3) ... 144s Selecting previously unselected package libopenjp2-7:amd64. 144s Preparing to unpack .../195-libopenjp2-7_2.5.0-2ubuntu3_amd64.deb ... 144s Unpacking libopenjp2-7:amd64 (2.5.0-2ubuntu3) ... 144s Selecting previously unselected package python3-pil:amd64. 144s Preparing to unpack .../196-python3-pil_11.1.0-5_amd64.deb ... 144s Unpacking python3-pil:amd64 (11.1.0-5) ... 144s Selecting previously unselected package python3.12-tk. 144s Preparing to unpack .../197-python3.12-tk_3.12.9-1_amd64.deb ... 144s Unpacking python3.12-tk (3.12.9-1) ... 144s Selecting previously unselected package python3.13-tk. 144s Preparing to unpack .../198-python3.13-tk_3.13.2-1_amd64.deb ... 144s Unpacking python3.13-tk (3.13.2-1) ... 144s Selecting previously unselected package python3-tk:amd64. 144s Preparing to unpack .../199-python3-tk_3.13.1-1_amd64.deb ... 144s Unpacking python3-tk:amd64 (3.13.1-1) ... 144s Selecting previously unselected package python3-pil.imagetk:amd64. 144s Preparing to unpack .../200-python3-pil.imagetk_11.1.0-5_amd64.deb ... 144s Unpacking python3-pil.imagetk:amd64 (11.1.0-5) ... 144s Selecting previously unselected package python3-matplotlib. 144s Preparing to unpack .../201-python3-matplotlib_3.8.3-3ubuntu2_amd64.deb ... 144s Unpacking python3-matplotlib (3.8.3-3ubuntu2) ... 144s Selecting previously unselected package python3-nacl. 144s Preparing to unpack .../202-python3-nacl_1.5.0-7_amd64.deb ... 144s Unpacking python3-nacl (1.5.0-7) ... 144s Selecting previously unselected package python3-netcdf4. 144s Preparing to unpack .../203-python3-netcdf4_1.7.2-1build3_amd64.deb ... 144s Unpacking python3-netcdf4 (1.7.2-1build3) ... 144s Selecting previously unselected package python3-pandas-lib:amd64. 144s Preparing to unpack .../204-python3-pandas-lib_2.2.3+dfsg-8_amd64.deb ... 144s Unpacking python3-pandas-lib:amd64 (2.2.3+dfsg-8) ... 144s Selecting previously unselected package python3-pandas. 144s Preparing to unpack .../205-python3-pandas_2.2.3+dfsg-8_all.deb ... 144s Unpacking python3-pandas (2.2.3+dfsg-8) ... 145s Selecting previously unselected package python3-paramiko. 145s Preparing to unpack .../206-python3-paramiko_3.5.1-2ubuntu1_all.deb ... 145s Unpacking python3-paramiko (3.5.1-2ubuntu1) ... 145s Selecting previously unselected package python3-pluggy. 145s Preparing to unpack .../207-python3-pluggy_1.5.0-1_all.deb ... 145s Unpacking python3-pluggy (1.5.0-1) ... 145s Selecting previously unselected package python3-pytest. 145s Preparing to unpack .../208-python3-pytest_8.3.4-1_all.deb ... 145s Unpacking python3-pytest (8.3.4-1) ... 145s Selecting previously unselected package python3-pytest-rerunfailures. 145s Preparing to unpack .../209-python3-pytest-rerunfailures_15.0-1_all.deb ... 145s Unpacking python3-pytest-rerunfailures (15.0-1) ... 145s Selecting previously unselected package python3-pytest-timeout. 145s Preparing to unpack .../210-python3-pytest-timeout_2.3.1-1_all.deb ... 145s Unpacking python3-pytest-timeout (2.3.1-1) ... 145s Selecting previously unselected package python3-threadpoolctl. 145s Preparing to unpack .../211-python3-threadpoolctl_3.1.0-1_all.deb ... 145s Unpacking python3-threadpoolctl (3.1.0-1) ... 145s Selecting previously unselected package python3-sklearn-lib:amd64. 145s Preparing to unpack .../212-python3-sklearn-lib_1.4.2+dfsg-7build1_amd64.deb ... 145s Unpacking python3-sklearn-lib:amd64 (1.4.2+dfsg-7build1) ... 145s Selecting previously unselected package python3-sklearn. 145s Preparing to unpack .../213-python3-sklearn_1.4.2+dfsg-7build1_all.deb ... 145s Unpacking python3-sklearn (1.4.2+dfsg-7build1) ... 145s Selecting previously unselected package tzdata-legacy. 146s Preparing to unpack .../214-tzdata-legacy_2025a-2ubuntu1_all.deb ... 146s Unpacking tzdata-legacy (2025a-2ubuntu1) ... 146s Setting up libgraphite2-3:amd64 (1.3.14-2ubuntu1) ... 146s Setting up liblcms2-2:amd64 (2.16-2) ... 146s Setting up python3-iniconfig (1.1.1-2) ... 146s Setting up python3-sniffio (1.3.1-1) ... 146s Setting up python3.12-minimal (3.12.9-1) ... 147s Setting up python3-tornado (6.4.2-1) ... 147s Setting up libnorm1t64:amd64 (1.5.9+dfsg-3.1build1) ... 147s Setting up libsharpyuv0:amd64 (1.5.0-0.1) ... 147s Setting up python3-pure-eval (0.2.3-1) ... 148s Setting up python3-send2trash (1.8.3-1) ... 148s Setting up fonts-lato (2.015-1) ... 148s Setting up libjs-sprintf-js (1.1.2+ds1+~1.1.2-1) ... 148s Setting up fonts-mathjax (2.7.9+dfsg-1) ... 148s Setting up libsodium23:amd64 (1.0.18-1build3) ... 148s Setting up liblerc4:amd64 (4.0.0+ds-5ubuntu1) ... 148s Setting up libjs-mathjax (2.7.9+dfsg-1) ... 148s Setting up python3-tblib (3.0.0-6) ... 148s Setting up libxrender1:amd64 (1:0.9.10-1.1build1) ... 148s Setting up libdebuginfod-common (0.192-4) ... 148s Setting up python3-anyio (4.7.0-1) ... 149s Setting up python3-joblib (1.4.2-2) ... 149s Setting up python3-pythonjsonlogger (3.2.1-1) ... 149s Setting up python3-parso (0.8.4-1) ... 150s Setting up python3-lz4 (4.4.0+dfsg-1) ... 150s Setting up python3-defusedxml (0.7.1-3) ... 150s Setting up python3-asttokens (3.0.0-1) ... 150s Setting up fonts-glyphicons-halflings (1.009~3.4.1+dfsg-3) ... 150s Setting up fonts-lyx (2.4.3-1) ... 150s Setting up libargon2-1:amd64 (0~20190702+dfsg-4build1) ... 150s Setting up python3-overrides (7.7.0-2) ... 150s Setting up python3.12 (3.12.9-1) ... 152s Setting up python3-fsspec (2025.2.0-1) ... 152s Setting up python3-rfc3339-validator (0.1.4-2) ... 152s Setting up python3-threadpoolctl (3.1.0-1) ... 153s Setting up x11-common (1:7.7+23ubuntu3) ... 153s Setting up libdeflate0:amd64 (1.23-1) ... 153s Setting up libqhull-r8.0:amd64 (2020.2-6build1) ... 153s Setting up python3-all (3.13.1-1~exp2) ... 153s Setting up python3-coverage (7.4.4+dfsg1-0ubuntu3) ... 153s Setting up node-cjs-module-lexer (1.2.3+dfsg-1) ... 153s Setting up python3-pytz (2025.1-3) ... 154s Setting up python3-sortedcontainers (2.4.0-2) ... 154s Setting up python3-pandocfilters (1.5.1-1) ... 154s Setting up libgomp1:amd64 (15-20250213-1ubuntu1) ... 154s Setting up python3-click (8.1.8-1) ... 154s Setting up libjbig0:amd64 (2.1-6.1ubuntu2) ... 154s Setting up python3-webencodings (0.5.1-5) ... 154s Setting up libaec0:amd64 (1.1.3-1) ... 154s Setting up python3-platformdirs (4.3.6-1) ... 155s Setting up python3-psutil (5.9.8-2build3) ... 155s Setting up python3-multidict (6.1.0-1build1) ... 155s Setting up libsource-highlight-common (3.1.9-4.3build1) ... 155s Setting up tzdata-legacy (2025a-2ubuntu1) ... 155s Setting up python3-tz (2025.1-3) ... 155s Setting up python3-cloudpickle (3.1.1-1) ... 155s Setting up python3-frozenlist (1.5.0-1build1) ... 156s Setting up python3-aiosignal (1.3.2-1) ... 156s Setting up python3-uritemplate (4.1.1-3) ... 156s Setting up python3-fs (2.4.16-6) ... 156s Setting up python3-async-timeout (5.0.1-1) ... 156s Setting up unicode-data (15.1.0-1) ... 156s Setting up python3-jupyterlab-pygments (0.2.2-3) ... 157s Setting up libpgm-5.3-0t64:amd64 (5.3.128~dfsg-2.1build1) ... 157s Setting up python3-decorator (5.1.1-5) ... 157s Setting up python3-fqdn (1.5.1-2) ... 157s Setting up libblas3:amd64 (3.12.1-2) ... 157s update-alternatives: using /usr/lib/x86_64-linux-gnu/blas/libblas.so.3 to provide /usr/lib/x86_64-linux-gnu/libblas.so.3 (libblas.so.3-x86_64-linux-gnu) in auto mode 157s Setting up python3-webcolors (1.13-1) ... 157s Setting up python3-packaging (24.2-1) ... 157s Setting up python3-wcwidth (0.2.13+dfsg1-1) ... 158s Setting up node-sprintf-js (1.1.2+ds1+~1.1.2-1) ... 158s Setting up python3-typeshed (0.0~git20241223.ea91db2-1) ... 158s Setting up python3-executing (2.2.0-0.1) ... 158s Setting up node-balanced-match (2.0.0-1) ... 158s Setting up node-brace-expansion (2.0.1+~1.1.0-1) ... 158s Setting up python3-nest-asyncio (1.5.4-1) ... 158s Setting up python3-dill (0.3.9-1) ... 158s Setting up python3-brotli (1.1.0-2build3) ... 159s Setting up liblzf1:amd64 (3.6-4) ... 159s Setting up python3-cycler (0.12.1-1) ... 159s Setting up libimagequant0:amd64 (2.18.0-1build1) ... 159s Setting up python3-rfc3986-validator (0.1.1-2) ... 159s Setting up fonts-dejavu-mono (2.37-8) ... 159s Setting up python3-kiwisolver (1.4.7-3) ... 159s Setting up libcares2:amd64 (1.34.4-2.1) ... 159s Setting up python3-numpy-dev:amd64 (1:2.2.3+ds-2) ... 159s Setting up libtcl8.6:amd64 (8.6.16+dfsg-1) ... 159s Setting up libipt2 (2.1.2-1) ... 159s Setting up fonts-dejavu-core (2.37-8) ... 159s Setting up python3-aiohappyeyeballs (2.4.6-1) ... 159s Setting up libjpeg-turbo8:amd64 (2.1.5-3ubuntu2) ... 159s Setting up python3-html5lib (1.2-1) ... 160s Setting up libbabeltrace1:amd64 (1.5.11-4build1) ... 160s Setting up libgfortran5:amd64 (15-20250213-1ubuntu1) ... 160s Setting up python3-pluggy (1.5.0-1) ... 160s Setting up libwebp7:amd64 (1.5.0-0.1) ... 160s Setting up python3-fastjsonschema (2.21.1-1) ... 160s Setting up node-undici (7.3.0+dfsg1+~cs24.12.11-1) ... 160s Setting up python3-traitlets (5.14.3+really5.14.3-1) ... 160s Setting up python-tinycss2-common (1.4.0-1) ... 160s Setting up libxslt1.1:amd64 (1.1.39-0exp1ubuntu2) ... 160s Setting up python3-argon2 (21.1.0-3) ... 161s Setting up libopenjp2-7:amd64 (2.5.0-2ubuntu3) ... 161s Setting up python3-toolz (1.0.0-2) ... 161s Setting up libharfbuzz0b:amd64 (10.2.0-1) ... 161s Setting up python3-dateutil (2.9.0-3) ... 161s Setting up python3-msgpack (1.0.3-3build3) ... 161s Setting up libxss1:amd64 (1:1.2.3-1build3) ... 161s Setting up node-minimatch (9.0.3-5) ... 161s Setting up libjs-jquery (3.6.1+dfsg+~3.5.14-1) ... 161s Setting up sass-stylesheets-bulma (0.9.4~ds-1) ... 161s Setting up python3-mpmath (1.3.0-1) ... 162s Setting up node-xtend (4.0.2-3) ... 162s Setting up python3-zict (3.0.0-2ubuntu1) ... 163s Setting up python-matplotlib-data (3.8.3-3ubuntu2) ... 163s Setting up libwebpmux3:amd64 (1.5.0-0.1) ... 163s Setting up python3-locket (1.0.0-2) ... 163s Setting up python3-yarl (1.13.1-1build1) ... 163s Setting up python3-mistune (3.0.2-2) ... 163s Setting up python3-stack-data (0.6.3-1) ... 163s Setting up python3-soupsieve (2.6-1) ... 164s Setting up fonts-font-awesome (5.0.10+really4.7.0~dfsg-4.1) ... 164s Setting up sphinx-rtd-theme-common (3.0.2+dfsg-2) ... 164s Setting up python3-websocket (1.8.0-2) ... 164s Setting up python3-jupyter-core (5.7.2-5) ... 164s Setting up python3-nacl (1.5.0-7) ... 164s Setting up libsz2:amd64 (1.1.3-1) ... 164s Setting up libjs-bootstrap (3.4.1+dfsg-3) ... 164s Setting up libjs-underscore (1.13.4~dfsg+~1.11.4-3) ... 164s Setting up python3-ptyprocess (0.7.0-6) ... 164s Setting up libjpeg8:amd64 (8c-2ubuntu11) ... 164s Setting up python3-prompt-toolkit (3.0.50-1) ... 165s Setting up python3-partd (1.4.2-1) ... 165s Setting up python3-sympy (1.13.3-3) ... 178s Setting up libdebuginfod1t64:amd64 (0.192-4) ... 178s Setting up liblapack3:amd64 (3.12.1-2) ... 178s update-alternatives: using /usr/lib/x86_64-linux-gnu/lapack/liblapack.so.3 to provide /usr/lib/x86_64-linux-gnu/liblapack.so.3 (liblapack.so.3-x86_64-linux-gnu) in auto mode 178s Setting up python3-tinycss2 (1.4.0-1) ... 178s Setting up libzmq5:amd64 (4.3.5-1build2) ... 178s Setting up python3-arrow (1.3.0-1.1ubuntu1) ... 178s Setting up python3-jedi (0.19.1+ds1-1) ... 179s Setting up fontconfig-config (2.15.0-2ubuntu1) ... 179s Setting up python3-pytest (8.3.4-1) ... 180s Setting up libwebpdemux2:amd64 (1.5.0-0.1) ... 180s Setting up python3-aiohttp (3.10.11-1) ... 180s Setting up python3-dask (2024.12.1+dfsg-2) ... 183s Setting up python3-isoduration (20.11.0+git20211126.ae0bd61-2) ... 183s Setting up libsource-highlight4t64:amd64 (3.1.9-4.3build1) ... 183s Setting up python3-nbformat (5.9.1-1) ... 183s Setting up python3-bs4 (4.13.3-1) ... 184s Setting up python3-bleach (6.2.0-1) ... 184s Setting up python3-matplotlib-inline (0.1.6-2) ... 184s Setting up python3-comm (0.2.1-1) ... 184s Setting up python3.13-doc (3.13.2-1) ... 184s Setting up python3-prometheus-client (0.21.1+ds1-1) ... 184s Setting up python3-distributed (2024.12.1+ds-1) ... 187s Setting up gdb (16.2-1ubuntu1) ... 187s Setting up libjs-jquery-ui (1.13.2+dfsg-1) ... 187s Setting up python3-pexpect (4.9-3) ... 187s Setting up python3-zmq (26.2.1-1) ... 187s Setting up libraqm0:amd64 (0.10.2-1) ... 187s Setting up python3-numpy (1:2.2.3+ds-2) ... 191s Setting up libjs-sphinxdoc (8.1.3-4) ... 191s Setting up python3-terminado (0.18.1-1) ... 191s Setting up libhdf5-310:amd64 (1.14.5+repack-3) ... 191s Setting up python3-lxml:amd64 (5.3.1-1) ... 191s Setting up libtiff6:amd64 (4.5.1+git230720-4ubuntu4) ... 191s Setting up python3-jupyter-client (8.6.3-2) ... 191s Setting up python3-contourpy (1.3.1-1) ... 192s Setting up python3-jupyter-server-terminals (0.5.3-2) ... 192s Setting up libfontconfig1:amd64 (2.15.0-2ubuntu1) ... 192s Setting up python3-paramiko (3.5.1-2ubuntu1) ... 192s Setting up python3-jupyter-events (0.10.0-4) ... 192s Setting up python3-doc (3.13.1-1~exp2) ... 192s Setting up liblbfgsb0:amd64 (3.0+dfsg.4-1build1) ... 192s Setting up python-numpy-doc (1:2.2.3+ds-2) ... 192s Setting up libhdf5-hl-310:amd64 (1.14.5+repack-3) ... 192s Setting up python3-pytest-rerunfailures (15.0-1) ... 192s Setting up libxft2:amd64 (2.3.6-1build1) ... 192s Setting up python3-scipy (1.14.1-4ubuntu1) ... 199s Setting up python3-pytest-timeout (2.3.1-1) ... 199s Setting up python-pandas-doc (2.2.3+dfsg-8) ... 199s Setting up libtk8.6:amd64 (8.6.16-1) ... 199s Setting up python3-pandas-lib:amd64 (2.2.3+dfsg-8) ... 199s Setting up python3.12-tk (3.12.9-1) ... 199s Setting up libnetcdf22:amd64 (1:4.9.3-1) ... 199s Setting up python3-sklearn-lib:amd64 (1.4.2+dfsg-7build1) ... 199s Setting up python3-h5py-serial (3.12.1-1) ... 200s Setting up python3-debugpy (1.8.8+ds-2ubuntu1) ... 201s Setting up python3.13-tk (3.13.2-1) ... 201s Setting up python3-nbclient (0.8.0-2) ... 201s Setting up python3-pil:amd64 (11.1.0-5) ... 202s Setting up python3-pandas (2.2.3+dfsg-8) ... 212s Setting up python3-ipython (8.30.0-2) ... 213s Setting up python-fsspec-doc (2025.2.0-1) ... 213s Setting up python3-ipykernel (6.29.5-2) ... 213s Setting up python3-h5py (3.12.1-1) ... 213s Setting up python3-sklearn (1.4.2+dfsg-7build1) ... 217s Setting up python3-cftime (1.6.4-1build2) ... 217s Setting up python3-nbconvert (7.16.6-1) ... 217s Setting up python3-netcdf4 (1.7.2-1build3) ... 217s Setting up tk8.6-blt2.5 (2.5.3+dfsg-7build1) ... 217s Setting up python3-jupyter-server (2.14.2-5) ... 218s Setting up blt (2.5.3+dfsg-7build1) ... 218s Setting up python3-tk:amd64 (3.13.1-1) ... 218s Setting up python3-pil.imagetk:amd64 (11.1.0-5) ... 218s Setting up python3-fonttools (4.55.3-2) ... 220s Setting up python3-ufolib2 (0.17.0+dfsg1-1) ... 220s Setting up node-acorn (8.8.1+ds+~cs25.17.7-2) ... 220s Setting up libnode115:amd64 (20.18.1+dfsg-1ubuntu2) ... 220s Setting up python3-matplotlib (3.8.3-3ubuntu2) ... 223s Setting up nodejs (20.18.1+dfsg-1ubuntu2) ... 223s update-alternatives: using /usr/bin/nodejs to provide /usr/bin/js (js) in auto mode 223s Setting up node-argparse (2.0.1-2) ... 223s Setting up node-esprima (4.0.1+ds+~4.0.3-2) ... 223s Setting up node-js-yaml (4.1.0+dfsg+~4.0.5-7) ... 223s Setting up python-dask-doc (2024.12.1+dfsg-2) ... 223s Setting up python-distributed-doc (2024.12.1+ds-1) ... 223s Processing triggers for install-info (7.1.1-1) ... 223s Processing triggers for libc-bin (2.40-4ubuntu1) ... 223s Processing triggers for systemd (257.2-3ubuntu1) ... 224s Processing triggers for man-db (2.13.0-1) ... 225s autopkgtest [23:30:28]: test pytest: [----------------------- 226s ping6: connect: Network is unreachable 226s No external ipv6 connectivity 226s Testing with python3.12: 226s *** STARTING RUN 1: python3.12 -m pytest -m not avoid_ci --verbose --timeout-method=signal --timeout=300 --durations=20 --color=no --runslow --pyargs distributed -rsfE --deselect=cli/tests/test_dask_scheduler.py::test_no_dashboard --deselect=deploy/tests/test_local.py::test_localcluster_get_client --deselect=deploy/tests/test_old_ssh.py::test_cluster --deselect=deploy/tests/test_old_ssh.py::test_old_ssh_nprocs_renamed_to_n_workers --deselect=deploy/tests/test_old_ssh.py::test_nprocs_attribute_is_deprecated --deselect=deploy/tests/test_ssh.py::test_nprocs_attribute_is_deprecated --deselect=http/tests/test_core.py::test_prometheus_api_doc --deselect=tests/test_init.py::test_git_revision --deselect=tests/test_jupyter.py::test_jupyter_idle_timeout --deselect=tests/test_jupyter.py::test_jupyter_idle_timeout_returned --deselect=tests/test_jupyter.py::test_jupyter_server --deselect=tests/test_jupyter.py::test_shutsdown_cleanly --deselect=tests/test_profile.py::test_stack_overflow --deselect=tests/test_pubsub.py::test_client_worker --deselect=tests/test_queues.py::test_queue_in_task --deselect=tests/test_spill.py::test_spillbuffer_oserror --deselect=tests/test_steal.py::test_steal_twice --deselect=tests/test_utils_test.py::test_cluster --deselect=tests/test_variable.py::test_variable_in_task --deselect=tests/test_worker.py::test_process_executor_kills_process --deselect=tests/test_worker_memory.py::test_fail_to_pickle_execute_1 --deselect=tests/test_worker_state_machine.py::test_task_state_instance_are_garbage_collected --deselect=protocol/tests/test_protocol.py::test_deeply_nested_structures --deselect=protocol/tests/test_serialize.py::test_deeply_nested_structures 227s ============================= test session starts ============================== 227s platform linux -- Python 3.12.9, pytest-8.3.4, pluggy-1.5.0 -- /usr/bin/python3.12 227s cachedir: .pytest_cache 227s rootdir: /tmp/autopkgtest.4PKwEm/autopkgtest_tmp 227s configfile: pyproject.toml 227s plugins: timeout-2.3.1, rerunfailures-15.0, anyio-4.7.0, typeguard-4.4.1 227s timeout: 300.0s 227s timeout method: signal 227s timeout func_only: False 237s collecting ... collected 3663 items / 38 deselected / 25 skipped / 3625 selected 237s 238s cli/tests/test_dask_scheduler.py::test_defaults <- ../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py PASSED [ 0%] 245s cli/tests/test_dask_scheduler.py::test_hostport <- ../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py PASSED [ 0%] 245s cli/tests/test_dask_scheduler.py::test_dashboard <- ../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py SKIPPED [ 0%] 245s cli/tests/test_dask_scheduler.py::test_dashboard_non_standard_ports <- ../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py SKIPPED [ 0%] 247s cli/tests/test_dask_scheduler.py::test_multiple_protocols <- ../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py PASSED [ 0%] 247s cli/tests/test_dask_scheduler.py::test_dashboard_allowlist <- ../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py SKIPPED [ 0%] 249s cli/tests/test_dask_scheduler.py::test_interface <- ../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py PASSED [ 0%] 250s cli/tests/test_dask_scheduler.py::test_pid_file <- ../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py PASSED [ 0%] 251s cli/tests/test_dask_scheduler.py::test_scheduler_port_zero <- ../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py PASSED [ 0%] 251s cli/tests/test_dask_scheduler.py::test_dashboard_port_zero <- ../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py SKIPPED [ 0%] 252s cli/tests/test_dask_scheduler.py::test_preload_file <- ../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py PASSED [ 0%] 253s cli/tests/test_dask_scheduler.py::test_preload_module <- ../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py PASSED [ 0%] 255s cli/tests/test_dask_scheduler.py::test_preload_remote_module <- ../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py PASSED [ 0%] 255s cli/tests/test_dask_scheduler.py::test_preload_config <- ../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py PASSED [ 0%] 256s cli/tests/test_dask_scheduler.py::test_preload_command <- ../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py PASSED [ 0%] 257s cli/tests/test_dask_scheduler.py::test_preload_command_default <- ../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py PASSED [ 0%] 257s cli/tests/test_dask_scheduler.py::test_version_option <- ../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py PASSED [ 0%] 258s cli/tests/test_dask_scheduler.py::test_idle_timeout <- ../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py PASSED [ 0%] 259s cli/tests/test_dask_scheduler.py::test_restores_signal_handler <- ../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py PASSED [ 0%] 262s cli/tests/test_dask_scheduler.py::test_multiple_workers_2 <- ../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py PASSED [ 0%] 264s cli/tests/test_dask_scheduler.py::test_multiple_workers <- ../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py PASSED [ 0%] 266s cli/tests/test_dask_scheduler.py::test_signal_handling[2] <- ../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py PASSED [ 0%] 268s cli/tests/test_dask_scheduler.py::test_signal_handling[15] <- ../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py PASSED [ 0%] 269s cli/tests/test_dask_scheduler.py::test_single_executable_deprecated <- ../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py PASSED [ 0%] 270s cli/tests/test_dask_spec.py::test_text <- ../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_spec.py PASSED [ 0%] 272s cli/tests/test_dask_spec.py::test_file <- ../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_spec.py PASSED [ 0%] 273s cli/tests/test_dask_spec.py::test_errors <- ../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_spec.py PASSED [ 0%] 274s cli/tests/test_dask_spec.py::test_signal_handling_worker[2-Nanny] <- ../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_spec.py PASSED [ 0%] 275s cli/tests/test_dask_spec.py::test_signal_handling_worker[2-Worker] <- ../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_spec.py PASSED [ 0%] 277s cli/tests/test_dask_spec.py::test_signal_handling_worker[15-Nanny] <- ../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_spec.py PASSED [ 0%] 278s cli/tests/test_dask_spec.py::test_signal_handling_worker[15-Worker] <- ../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_spec.py PASSED [ 0%] 279s cli/tests/test_dask_spec.py::test_signal_handling_scheduler[2] <- ../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_spec.py PASSED [ 0%] 280s cli/tests/test_dask_spec.py::test_signal_handling_scheduler[15] <- ../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_spec.py PASSED [ 0%] 280s cli/tests/test_dask_ssh.py::test_version_option <- ../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_ssh.py PASSED [ 0%] 280s cli/tests/test_dask_worker.py::test_apportion_ports[args0-expect0] <- ../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 0%] 280s cli/tests/test_dask_worker.py::test_apportion_ports[args1-expect1] <- ../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 0%] 280s cli/tests/test_dask_worker.py::test_apportion_ports[args2-expect2] <- ../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 1%] 280s cli/tests/test_dask_worker.py::test_apportion_ports[args3-expect3] <- ../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 1%] 280s cli/tests/test_dask_worker.py::test_apportion_ports[args4-expect4] <- ../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 1%] 281s cli/tests/test_dask_worker.py::test_apportion_ports[args5-expect5] <- ../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 1%] 281s cli/tests/test_dask_worker.py::test_apportion_ports[args6-expect6] <- ../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 1%] 281s cli/tests/test_dask_worker.py::test_apportion_ports[args7-expect7] <- ../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 1%] 281s cli/tests/test_dask_worker.py::test_apportion_ports[args8-expect8] <- ../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 1%] 281s cli/tests/test_dask_worker.py::test_apportion_ports[args9-expect9] <- ../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 1%] 281s cli/tests/test_dask_worker.py::test_apportion_ports[args10-expect10] <- ../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 1%] 281s cli/tests/test_dask_worker.py::test_apportion_ports[args11-expect11] <- ../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 1%] 281s cli/tests/test_dask_worker.py::test_apportion_ports[args12-expect12] <- ../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 1%] 281s cli/tests/test_dask_worker.py::test_apportion_ports[args13-expect13] <- ../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 1%] 281s cli/tests/test_dask_worker.py::test_apportion_ports[args14-expect14] <- ../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 1%] 281s cli/tests/test_dask_worker.py::test_apportion_ports[args15-expect15] <- ../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 1%] 281s cli/tests/test_dask_worker.py::test_apportion_ports[args16-expect16] <- ../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 1%] 281s cli/tests/test_dask_worker.py::test_apportion_ports[args17-expect17] <- ../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 1%] 281s cli/tests/test_dask_worker.py::test_apportion_ports_bad <- ../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 1%] 282s cli/tests/test_dask_worker.py::test_nanny_worker_ports <- ../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 1%] 284s cli/tests/test_dask_worker.py::test_nanny_worker_port_range <- ../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 1%] 285s cli/tests/test_dask_worker.py::test_nanny_worker_port_range_too_many_workers_raises <- ../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 1%] 287s cli/tests/test_dask_worker.py::test_memory_limit <- ../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 1%] 288s cli/tests/test_dask_worker.py::test_no_nanny <- ../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 1%] 290s cli/tests/test_dask_worker.py::test_resources <- ../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 1%] 292s cli/tests/test_dask_worker.py::test_local_directory[--nanny] <- ../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 1%] 293s cli/tests/test_dask_worker.py::test_local_directory[--no-nanny] <- ../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 1%] 295s cli/tests/test_dask_worker.py::test_scheduler_file[--nanny] <- ../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 1%] 297s cli/tests/test_dask_worker.py::test_scheduler_file[--no-nanny] <- ../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 1%] 299s cli/tests/test_dask_worker.py::test_scheduler_address_env <- ../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 1%] 299s cli/tests/test_dask_worker.py::test_nworkers_requires_nanny <- ../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 1%] 301s cli/tests/test_dask_worker.py::test_nworkers_negative <- ../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 1%] 303s cli/tests/test_dask_worker.py::test_nworkers_auto <- ../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 1%] 305s cli/tests/test_dask_worker.py::test_nworkers_expands_name <- ../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 1%] 307s cli/tests/test_dask_worker.py::test_contact_listen_address[tcp://0.0.0.0:---nanny] <- ../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 1%] 308s cli/tests/test_dask_worker.py::test_contact_listen_address[tcp://0.0.0.0:---no-nanny] <- ../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 1%] 310s cli/tests/test_dask_worker.py::test_contact_listen_address[tcp://127.0.0.2:---nanny] <- ../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 1%] 311s cli/tests/test_dask_worker.py::test_contact_listen_address[tcp://127.0.0.2:---no-nanny] <- ../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 1%] 311s cli/tests/test_dask_worker.py::test_listen_address_ipv6[tcp://:---nanny] <- ../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py SKIPPED [ 2%] 311s cli/tests/test_dask_worker.py::test_listen_address_ipv6[tcp://:---no-nanny] <- ../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py SKIPPED [ 2%] 311s cli/tests/test_dask_worker.py::test_listen_address_ipv6[tcp://[::1]:---nanny] <- ../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py SKIPPED [ 2%] 311s cli/tests/test_dask_worker.py::test_listen_address_ipv6[tcp://[::1]:---no-nanny] <- ../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py SKIPPED [ 2%] 313s cli/tests/test_dask_worker.py::test_respect_host_listen_address[127.0.0.2---nanny] <- ../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 2%] 314s cli/tests/test_dask_worker.py::test_respect_host_listen_address[127.0.0.2---no-nanny] <- ../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 2%] 316s cli/tests/test_dask_worker.py::test_respect_host_listen_address[0.0.0.0---nanny] <- ../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 2%] 317s cli/tests/test_dask_worker.py::test_respect_host_listen_address[0.0.0.0---no-nanny] <- ../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 2%] 317s cli/tests/test_dask_worker.py::test_dashboard_non_standard_ports <- ../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py SKIPPED [ 2%] 317s cli/tests/test_dask_worker.py::test_version_option <- ../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 2%] 318s cli/tests/test_dask_worker.py::test_worker_timeout[True] <- ../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 2%] 319s cli/tests/test_dask_worker.py::test_worker_timeout[False] <- ../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 2%] 321s cli/tests/test_dask_worker.py::test_integer_names <- ../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 2%] 322s cli/tests/test_dask_worker.py::test_worker_class[--nanny] <- ../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 2%] 324s cli/tests/test_dask_worker.py::test_worker_class[--no-nanny] <- ../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 2%] 326s cli/tests/test_dask_worker.py::test_preload_config <- ../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 2%] 328s cli/tests/test_dask_worker.py::test_set_lifetime_stagger_via_env_var <- ../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 2%] 330s cli/tests/test_dask_worker.py::test_set_lifetime_restart_via_env_var <- ../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 2%] 331s cli/tests/test_dask_worker.py::test_timeout[--nanny] <- ../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 2%] 333s cli/tests/test_dask_worker.py::test_timeout[--no-nanny] <- ../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 2%] 335s cli/tests/test_dask_worker.py::test_signal_handling[2---nanny] <- ../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 2%] 336s cli/tests/test_dask_worker.py::test_signal_handling[2---no-nanny] <- ../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 2%] 338s cli/tests/test_dask_worker.py::test_signal_handling[15---nanny] <- ../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 2%] 339s cli/tests/test_dask_worker.py::test_signal_handling[15---no-nanny] <- ../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 2%] 341s cli/tests/test_dask_worker.py::test_error_during_startup[--nanny] <- ../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 2%] 344s cli/tests/test_dask_worker.py::test_error_during_startup[--no-nanny] <- ../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 2%] 346s cli/tests/test_dask_worker.py::test_single_executable_deprecated <- ../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 2%] 347s cli/tests/test_dask_worker.py::test_single_executable_works <- ../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 2%] 349s cli/tests/test_tls_cli.py::test_basic <- ../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_tls_cli.py PASSED [ 2%] 351s cli/tests/test_tls_cli.py::test_sni <- ../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_tls_cli.py PASSED [ 2%] 353s cli/tests/test_tls_cli.py::test_nanny <- ../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_tls_cli.py PASSED [ 2%] 355s cli/tests/test_tls_cli.py::test_separate_key_cert <- ../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_tls_cli.py PASSED [ 2%] 357s cli/tests/test_tls_cli.py::test_use_config_file <- ../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_tls_cli.py PASSED [ 2%] 357s comm/tests/test_comms.py::test_parse_host_port[tornado] <- ../../../usr/lib/python3/dist-packages/distributed/comm/tests/test_comms.py PASSED [ 2%] 357s comm/tests/test_comms.py::test_unparse_host_port[tornado] <- ../../../usr/lib/python3/dist-packages/distributed/comm/tests/test_comms.py PASSED [ 2%] 357s comm/tests/test_comms.py::test_get_address_host[tornado] <- ../../../usr/lib/python3/dist-packages/distributed/comm/tests/test_comms.py PASSED [ 2%] 357s comm/tests/test_comms.py::test_resolve_address[tornado] <- ../../../usr/lib/python3/dist-packages/distributed/comm/tests/test_comms.py PASSED [ 3%] 357s comm/tests/test_comms.py::test_get_local_address_for[tornado] <- ../../../usr/lib/python3/dist-packages/distributed/comm/tests/test_comms.py PASSED [ 3%] 357s comm/tests/test_comms.py::test_tcp_listener_does_not_call_handler_on_handshake_error[tornado] <- ../../../usr/lib/python3/dist-packages/distributed/comm/tests/test_comms.py PASSED [ 3%] 357s comm/tests/test_comms.py::test_tcp_specific[tornado] <- ../../../usr/lib/python3/dist-packages/distributed/comm/tests/test_comms.py PASSED [ 3%] 358s comm/tests/test_comms.py::test_tls_specific[tornado-None] <- ../../../usr/lib/python3/dist-packages/distributed/comm/tests/test_comms.py PASSED [ 3%] 358s comm/tests/test_comms.py::test_tls_specific[tornado-localhost] <- ../../../usr/lib/python3/dist-packages/distributed/comm/tests/test_comms.py PASSED [ 3%] 358s comm/tests/test_comms.py::test_comm_failure_threading[tornado] <- ../../../usr/lib/python3/dist-packages/distributed/comm/tests/test_comms.py PASSED [ 3%] 358s comm/tests/test_comms.py::test_inproc_specific_same_thread <- ../../../usr/lib/python3/dist-packages/distributed/comm/tests/test_comms.py PASSED [ 3%] 359s comm/tests/test_comms.py::test_inproc_specific_different_threads <- ../../../usr/lib/python3/dist-packages/distributed/comm/tests/test_comms.py PASSED [ 3%] 359s comm/tests/test_comms.py::test_inproc_continues_listening_after_handshake_error <- ../../../usr/lib/python3/dist-packages/distributed/comm/tests/test_comms.py PASSED [ 3%] 359s comm/tests/test_comms.py::test_inproc_handshakes_concurrently <- ../../../usr/lib/python3/dist-packages/distributed/comm/tests/test_comms.py PASSED [ 3%] 359s comm/tests/test_comms.py::test_ucx_client_server <- ../../../usr/lib/python3/dist-packages/distributed/comm/tests/test_comms.py SKIPPED [ 3%] 359s comm/tests/test_comms.py::test_default_client_server_ipv4[tornado] <- ../../../usr/lib/python3/dist-packages/distributed/comm/tests/test_comms.py PASSED [ 3%] 359s comm/tests/test_comms.py::test_default_client_server_ipv6[tornado] <- ../../../usr/lib/python3/dist-packages/distributed/comm/tests/test_comms.py SKIPPED [ 3%] 359s comm/tests/test_comms.py::test_tcp_client_server_ipv4[tornado] <- ../../../usr/lib/python3/dist-packages/distributed/comm/tests/test_comms.py PASSED [ 3%] 359s comm/tests/test_comms.py::test_tcp_client_server_ipv6[tornado] <- ../../../usr/lib/python3/dist-packages/distributed/comm/tests/test_comms.py SKIPPED [ 3%] 360s comm/tests/test_comms.py::test_tls_client_server_ipv4[tornado] <- ../../../usr/lib/python3/dist-packages/distributed/comm/tests/test_comms.py PASSED [ 3%] 360s comm/tests/test_comms.py::test_tls_client_server_ipv6[tornado] <- ../../../usr/lib/python3/dist-packages/distributed/comm/tests/test_comms.py SKIPPED [ 3%] 360s comm/tests/test_comms.py::test_inproc_client_server <- ../../../usr/lib/python3/dist-packages/distributed/comm/tests/test_comms.py PASSED [ 3%] 360s comm/tests/test_comms.py::test_tls_reject_certificate[tornado] <- ../../../usr/lib/python3/dist-packages/distributed/comm/tests/test_comms.py PASSED [ 3%] 360s comm/tests/test_comms.py::test_tcp_comm_closed_implicit[tornado] <- ../../../usr/lib/python3/dist-packages/distributed/comm/tests/test_comms.py PASSED [ 3%] 360s comm/tests/test_comms.py::test_tls_comm_closed_implicit[tornado] <- ../../../usr/lib/python3/dist-packages/distributed/comm/tests/test_comms.py PASSED [ 3%] 360s comm/tests/test_comms.py::test_inproc_comm_closed_implicit <- ../../../usr/lib/python3/dist-packages/distributed/comm/tests/test_comms.py PASSED [ 3%] 360s comm/tests/test_comms.py::test_tcp_comm_closed_explicit[tornado] <- ../../../usr/lib/python3/dist-packages/distributed/comm/tests/test_comms.py PASSED [ 3%] 360s comm/tests/test_comms.py::test_tls_comm_closed_explicit[tornado] <- ../../../usr/lib/python3/dist-packages/distributed/comm/tests/test_comms.py PASSED [ 3%] 360s comm/tests/test_comms.py::test_inproc_comm_closed_explicit <- ../../../usr/lib/python3/dist-packages/distributed/comm/tests/test_comms.py PASSED [ 3%] 360s comm/tests/test_comms.py::test_inproc_comm_closed_explicit_2 <- ../../../usr/lib/python3/dist-packages/distributed/comm/tests/test_comms.py PASSED [ 3%] 360s comm/tests/test_comms.py::test_comm_closed_on_write_error[tornado-BufferError] <- ../../../usr/lib/python3/dist-packages/distributed/comm/tests/test_comms.py PASSED [ 3%] 360s comm/tests/test_comms.py::test_comm_closed_on_write_error[tornado-CustomBase] <- ../../../usr/lib/python3/dist-packages/distributed/comm/tests/test_comms.py PASSED [ 3%] 360s comm/tests/test_comms.py::test_comm_closed_on_read_error[tornado] <- ../../../usr/lib/python3/dist-packages/distributed/comm/tests/test_comms.py PASSED [ 3%] 360s comm/tests/test_comms.py::test_retry_connect[tornado] <- ../../../usr/lib/python3/dist-packages/distributed/comm/tests/test_comms.py PASSED [ 3%] 363s comm/tests/test_comms.py::test_handshake_slow_comm[tornado] <- ../../../usr/lib/python3/dist-packages/distributed/comm/tests/test_comms.py PASSED [ 3%] 363s comm/tests/test_comms.py::test_tcp_connect_timeout[tornado] <- ../../../usr/lib/python3/dist-packages/distributed/comm/tests/test_comms.py PASSED [ 3%] 363s comm/tests/test_comms.py::test_inproc_connect_timeout <- ../../../usr/lib/python3/dist-packages/distributed/comm/tests/test_comms.py PASSED [ 3%] 363s comm/tests/test_comms.py::test_tcp_many_listeners[tornado] <- ../../../usr/lib/python3/dist-packages/distributed/comm/tests/test_comms.py PASSED [ 3%] 363s comm/tests/test_comms.py::test_inproc_many_listeners <- ../../../usr/lib/python3/dist-packages/distributed/comm/tests/test_comms.py PASSED [ 3%] 363s comm/tests/test_comms.py::test_tcp_deserialize[tornado] <- ../../../usr/lib/python3/dist-packages/distributed/comm/tests/test_comms.py PASSED [ 4%] 363s comm/tests/test_comms.py::test_inproc_deserialize <- ../../../usr/lib/python3/dist-packages/distributed/comm/tests/test_comms.py PASSED [ 4%] 363s comm/tests/test_comms.py::test_inproc_deserialize_roundtrip <- ../../../usr/lib/python3/dist-packages/distributed/comm/tests/test_comms.py PASSED [ 4%] 364s comm/tests/test_comms.py::test_tcp_deserialize_roundtrip[tornado] <- ../../../usr/lib/python3/dist-packages/distributed/comm/tests/test_comms.py PASSED [ 4%] 364s comm/tests/test_comms.py::test_tcp_deserialize_eoferror[tornado] <- ../../../usr/lib/python3/dist-packages/distributed/comm/tests/test_comms.py PASSED [ 4%] 364s comm/tests/test_comms.py::test_tcp_repr[tornado] <- ../../../usr/lib/python3/dist-packages/distributed/comm/tests/test_comms.py PASSED [ 4%] 364s comm/tests/test_comms.py::test_tls_repr[tornado] <- ../../../usr/lib/python3/dist-packages/distributed/comm/tests/test_comms.py PASSED [ 4%] 364s comm/tests/test_comms.py::test_inproc_repr <- ../../../usr/lib/python3/dist-packages/distributed/comm/tests/test_comms.py PASSED [ 4%] 364s comm/tests/test_comms.py::test_tcp_adresses[tornado] <- ../../../usr/lib/python3/dist-packages/distributed/comm/tests/test_comms.py PASSED [ 4%] 364s comm/tests/test_comms.py::test_get_stream_address_raises_if_closed <- ../../../usr/lib/python3/dist-packages/distributed/comm/tests/test_comms.py PASSED [ 4%] 364s comm/tests/test_comms.py::test_tls_adresses[tornado] <- ../../../usr/lib/python3/dist-packages/distributed/comm/tests/test_comms.py PASSED [ 4%] 364s comm/tests/test_comms.py::test_inproc_adresses <- ../../../usr/lib/python3/dist-packages/distributed/comm/tests/test_comms.py PASSED [ 4%] 365s comm/tests/test_comms.py::test_register_backend_entrypoint <- ../../../usr/lib/python3/dist-packages/distributed/comm/tests/test_comms.py PASSED [ 4%] 365s comm/tests/test_comms.py::test_do_not_share_buffers[tornado-list] <- ../../../usr/lib/python3/dist-packages/distributed/comm/tests/test_comms.py PASSED [ 4%] 365s comm/tests/test_comms.py::test_do_not_share_buffers[tornado-OpaqueList] <- ../../../usr/lib/python3/dist-packages/distributed/comm/tests/test_comms.py PASSED [ 4%] 365s comm/tests/test_comms.py::test_share_buffer_with_header[tornado-1-0-False] <- ../../../usr/lib/python3/dist-packages/distributed/comm/tests/test_comms.py PASSED [ 4%] 365s comm/tests/test_comms.py::test_share_buffer_with_header[tornado-1-1800-False] <- ../../../usr/lib/python3/dist-packages/distributed/comm/tests/test_comms.py PASSED [ 4%] 365s comm/tests/test_comms.py::test_share_buffer_with_header[tornado-1-2100-True] <- ../../../usr/lib/python3/dist-packages/distributed/comm/tests/test_comms.py PASSED [ 4%] 365s comm/tests/test_comms.py::test_share_buffer_with_header[tornado-200000-9500-False] <- ../../../usr/lib/python3/dist-packages/distributed/comm/tests/test_comms.py PASSED [ 4%] 365s comm/tests/test_comms.py::test_share_buffer_with_header[tornado-200000-10500-True] <- ../../../usr/lib/python3/dist-packages/distributed/comm/tests/test_comms.py PASSED [ 4%] 365s comm/tests/test_comms.py::test_share_buffer_with_header[tornado-350000-0-False] <- ../../../usr/lib/python3/dist-packages/distributed/comm/tests/test_comms.py PASSED [ 4%] 365s comm/tests/test_tcp.py::test_getaddrinfo_invalid_af <- ../../../usr/lib/python3/dist-packages/distributed/comm/tests/test_tcp.py PASSED [ 4%] 365s comm/tests/test_ws.py::test_registered <- ../../../usr/lib/python3/dist-packages/distributed/comm/tests/test_ws.py PASSED [ 4%] 365s comm/tests/test_ws.py::test_listen_connect <- ../../../usr/lib/python3/dist-packages/distributed/comm/tests/test_ws.py PASSED [ 4%] 365s comm/tests/test_ws.py::test_listen_connect_wss <- ../../../usr/lib/python3/dist-packages/distributed/comm/tests/test_ws.py PASSED [ 4%] 365s comm/tests/test_ws.py::test_expect_ssl_context <- ../../../usr/lib/python3/dist-packages/distributed/comm/tests/test_ws.py PASSED [ 4%] 365s comm/tests/test_ws.py::test_expect_scheduler_ssl_when_sharing_server <- ../../../usr/lib/python3/dist-packages/distributed/comm/tests/test_ws.py PASSED [ 4%] 365s comm/tests/test_ws.py::test_roundtrip <- ../../../usr/lib/python3/dist-packages/distributed/comm/tests/test_ws.py PASSED [ 4%] 367s comm/tests/test_ws.py::test_collections <- ../../../usr/lib/python3/dist-packages/distributed/comm/tests/test_ws.py PASSED [ 4%] 368s comm/tests/test_ws.py::test_large_transfer <- ../../../usr/lib/python3/dist-packages/distributed/comm/tests/test_ws.py PASSED [ 4%] 368s comm/tests/test_ws.py::test_http_and_comm_server[True-ws://-None-8787] <- ../../../usr/lib/python3/dist-packages/distributed/comm/tests/test_ws.py PASSED [ 4%] 369s comm/tests/test_ws.py::test_http_and_comm_server[True-wss://-True-8787] <- ../../../usr/lib/python3/dist-packages/distributed/comm/tests/test_ws.py PASSED [ 4%] 369s comm/tests/test_ws.py::test_http_and_comm_server[False-ws://-None-8787] <- ../../../usr/lib/python3/dist-packages/distributed/comm/tests/test_ws.py PASSED [ 4%] 369s comm/tests/test_ws.py::test_http_and_comm_server[False-wss://-True-8787] <- ../../../usr/lib/python3/dist-packages/distributed/comm/tests/test_ws.py PASSED [ 4%] 369s comm/tests/test_ws.py::test_http_and_comm_server[True-ws://-None-8786] <- ../../../usr/lib/python3/dist-packages/distributed/comm/tests/test_ws.py PASSED [ 4%] 370s comm/tests/test_ws.py::test_http_and_comm_server[True-wss://-True-8786] <- ../../../usr/lib/python3/dist-packages/distributed/comm/tests/test_ws.py PASSED [ 4%] 370s comm/tests/test_ws.py::test_http_and_comm_server[False-ws://-None-8786] <- ../../../usr/lib/python3/dist-packages/distributed/comm/tests/test_ws.py PASSED [ 4%] 371s comm/tests/test_ws.py::test_http_and_comm_server[False-wss://-True-8786] <- ../../../usr/lib/python3/dist-packages/distributed/comm/tests/test_ws.py PASSED [ 5%] 371s comm/tests/test_ws.py::test_connection_made_with_extra_conn_args[ws://-True] <- ../../../usr/lib/python3/dist-packages/distributed/comm/tests/test_ws.py PASSED [ 5%] 371s comm/tests/test_ws.py::test_connection_made_with_extra_conn_args[ws://-False] <- ../../../usr/lib/python3/dist-packages/distributed/comm/tests/test_ws.py PASSED [ 5%] 371s comm/tests/test_ws.py::test_connection_made_with_extra_conn_args[wss://-True] <- ../../../usr/lib/python3/dist-packages/distributed/comm/tests/test_ws.py PASSED [ 5%] 371s comm/tests/test_ws.py::test_connection_made_with_extra_conn_args[wss://-False] <- ../../../usr/lib/python3/dist-packages/distributed/comm/tests/test_ws.py PASSED [ 5%] 371s comm/tests/test_ws.py::test_connection_made_with_sni <- ../../../usr/lib/python3/dist-packages/distributed/comm/tests/test_ws.py PASSED [ 5%] 371s comm/tests/test_ws.py::test_quiet_close <- ../../../usr/lib/python3/dist-packages/distributed/comm/tests/test_ws.py PASSED [ 5%] 372s comm/tests/test_ws.py::test_ws_roundtrip <- ../../../usr/lib/python3/dist-packages/distributed/comm/tests/test_ws.py PASSED [ 5%] 372s comm/tests/test_ws.py::test_wss_roundtrip <- ../../../usr/lib/python3/dist-packages/distributed/comm/tests/test_ws.py PASSED [ 5%] 372s dashboard/tests/test_bokeh.py::test_old_import <- ../../../usr/lib/python3/dist-packages/distributed/dashboard/tests/test_bokeh.py PASSED [ 5%] 374s deploy/tests/test_adaptive.py::test_adaptive_local_cluster <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_adaptive.py PASSED [ 5%] 375s deploy/tests/test_adaptive.py::test_adaptive_local_cluster_multi_workers <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_adaptive.py PASSED [ 5%] 376s deploy/tests/test_adaptive.py::test_min_max <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_adaptive.py PASSED [ 5%] 377s deploy/tests/test_adaptive.py::test_avoid_churn <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_adaptive.py PASSED [ 5%] 378s deploy/tests/test_adaptive.py::test_adapt_quickly <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_adaptive.py PASSED [ 5%] 378s deploy/tests/test_adaptive.py::test_adapt_down <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_adaptive.py PASSED [ 5%] 378s deploy/tests/test_adaptive.py::test_no_more_workers_than_tasks <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_adaptive.py PASSED [ 5%] 380s deploy/tests/test_adaptive.py::test_basic_no_loop <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_adaptive.py PASSED [ 5%] 382s deploy/tests/test_adaptive.py::test_target_duration[5] <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_adaptive.py PASSED [ 5%] 383s deploy/tests/test_adaptive.py::test_target_duration[1] <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_adaptive.py PASSED [ 5%] 385s deploy/tests/test_adaptive.py::test_worker_keys <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_adaptive.py PASSED [ 5%] 385s deploy/tests/test_adaptive.py::test_adapt_cores_memory <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_adaptive.py PASSED [ 5%] 385s deploy/tests/test_adaptive.py::test_adaptive_config <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_adaptive.py PASSED [ 5%] 385s deploy/tests/test_adaptive.py::test_update_adaptive <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_adaptive.py PASSED [ 5%] 388s deploy/tests/test_adaptive.py::test_adaptive_no_memory_limit <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_adaptive.py PASSED [ 5%] 388s deploy/tests/test_adaptive.py::test_adapt_gets_stopped_on_cluster_close <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_adaptive.py PASSED [ 5%] 394s deploy/tests/test_adaptive.py::test_scale_needs_to_be_awaited <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_adaptive.py PASSED [ 5%] 394s deploy/tests/test_adaptive.py::test_adaptive_stopped <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_adaptive.py PASSED [ 5%] 394s deploy/tests/test_adaptive.py::test_scale_up_large_tasks[1] <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_adaptive.py PASSED [ 5%] 394s deploy/tests/test_adaptive.py::test_scale_up_large_tasks[inf] <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_adaptive.py PASSED [ 5%] 394s deploy/tests/test_adaptive.py::test_respect_average_nthreads <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_adaptive.py PASSED [ 5%] 394s deploy/tests/test_adaptive.py::test_adaptive_stops_on_cluster_status_change <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_adaptive.py PASSED [ 5%] 394s deploy/tests/test_adaptive.py::test_interval <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_adaptive.py PASSED [ 5%] 394s deploy/tests/test_adaptive.py::test_adapt_logs_error_in_safe_target <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_adaptive.py PASSED [ 5%] 395s deploy/tests/test_adaptive.py::test_adapt_callback_logs_error_in_scale_down <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_adaptive.py PASSED [ 5%] 395s deploy/tests/test_adaptive.py::test_adaptive_logs_stopping_once[True] <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_adaptive.py PASSED [ 5%] 395s deploy/tests/test_adaptive.py::test_adaptive_logs_stopping_once[False] <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_adaptive.py PASSED [ 6%] 395s deploy/tests/test_adaptive.py::test_adapt_stop_del <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_adaptive.py PASSED [ 6%] 395s deploy/tests/test_adaptive_core.py::test_safe_target <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_adaptive_core.py PASSED [ 6%] 395s deploy/tests/test_adaptive_core.py::test_scale_up <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_adaptive_core.py PASSED [ 6%] 395s deploy/tests/test_adaptive_core.py::test_scale_down <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_adaptive_core.py PASSED [ 6%] 395s deploy/tests/test_cluster.py::test_eq <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_cluster.py PASSED [ 6%] 395s deploy/tests/test_cluster.py::test_repr <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_cluster.py PASSED [ 6%] 397s deploy/tests/test_cluster.py::test_cluster_wait_for_worker <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_cluster.py PASSED [ 6%] 397s deploy/tests/test_cluster.py::test_deprecated_loop_properties <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_cluster.py PASSED [ 6%] 397s deploy/tests/test_cluster.py::test_exponential_backoff <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_cluster.py PASSED [ 6%] 397s deploy/tests/test_cluster.py::test_sync_context_manager_used_with_async_cluster <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_cluster.py PASSED [ 6%] 397s deploy/tests/test_deploy_utils.py::test_default_process_thread_breakdown <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_deploy_utils.py PASSED [ 6%] 397s deploy/tests/test_local.py::test_simple <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_local.py PASSED [ 6%] 397s deploy/tests/test_local.py::test_local_cluster_supports_blocked_handlers <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_local.py PASSED [ 6%] 399s deploy/tests/test_local.py::test_close_twice <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_local.py PASSED [ 6%] 401s deploy/tests/test_local.py::test_procs <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_local.py PASSED [ 6%] 401s deploy/tests/test_local.py::test_move_unserializable_data <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_local.py PASSED [ 6%] 401s deploy/tests/test_local.py::test_transports_inproc <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_local.py PASSED [ 6%] 403s deploy/tests/test_local.py::test_transports_tcp <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_local.py PASSED [ 6%] 403s deploy/tests/test_local.py::test_transports_tcp_port <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_local.py PASSED [ 6%] 403s deploy/tests/test_local.py::test_cores <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_local.py PASSED [ 6%] 403s deploy/tests/test_local.py::test_submit <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_local.py PASSED [ 6%] 403s deploy/tests/test_local.py::test_context_manager <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_local.py PASSED [ 6%] 403s deploy/tests/test_local.py::test_no_workers_sync <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_local.py PASSED [ 6%] 404s deploy/tests/test_local.py::test_Client_with_local <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_local.py PASSED [ 6%] 405s deploy/tests/test_local.py::test_Client_solo <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_local.py PASSED [ 6%] 405s deploy/tests/test_local.py::test_duplicate_clients <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_local.py SKIPPED [ 6%] 406s deploy/tests/test_local.py::test_Client_kwargs <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_local.py PASSED [ 6%] 407s deploy/tests/test_local.py::test_Client_unused_kwargs_with_cluster <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_local.py PASSED [ 6%] 407s deploy/tests/test_local.py::test_Client_unused_kwargs_with_address <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_local.py PASSED [ 6%] 409s deploy/tests/test_local.py::test_Client_twice <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_local.py PASSED [ 6%] 411s deploy/tests/test_local.py::test_client_constructor_with_temporary_security <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_local.py PASSED [ 6%] 412s deploy/tests/test_local.py::test_defaults <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_local.py PASSED [ 6%] 412s deploy/tests/test_local.py::test_defaults_2 <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_local.py PASSED [ 6%] 413s deploy/tests/test_local.py::test_defaults_3 <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_local.py PASSED [ 6%] 414s deploy/tests/test_local.py::test_defaults_4 <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_local.py PASSED [ 6%] 416s deploy/tests/test_local.py::test_defaults_5 <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_local.py PASSED [ 7%] 418s deploy/tests/test_local.py::test_defaults_6 <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_local.py PASSED [ 7%] 418s deploy/tests/test_local.py::test_worker_params <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_local.py PASSED [ 7%] 418s deploy/tests/test_local.py::test_memory_limit_none <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_local.py PASSED [ 7%] 420s deploy/tests/test_local.py::test_cleanup <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_local.py PASSED [ 7%] 420s deploy/tests/test_local.py::test_repeated <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_local.py PASSED [ 7%] 420s deploy/tests/test_local.py::test_bokeh[True] <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_local.py SKIPPED [ 7%] 420s deploy/tests/test_local.py::test_bokeh[False] <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_local.py SKIPPED [ 7%] 421s deploy/tests/test_local.py::test_blocks_until_full <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_local.py PASSED [ 7%] 421s deploy/tests/test_local.py::test_scale_up_and_down <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_local.py PASSED [ 7%] 423s deploy/tests/test_local.py::test_silent_startup <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_local.py PASSED [ 7%] 424s deploy/tests/test_local.py::test_only_local_access <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_local.py PASSED [ 7%] 424s deploy/tests/test_local.py::test_remote_access <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_local.py PASSED [ 7%] 424s deploy/tests/test_local.py::test_memory[None] <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_local.py PASSED [ 7%] 424s deploy/tests/test_local.py::test_memory[3] <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_local.py PASSED [ 7%] 425s deploy/tests/test_local.py::test_memory_nanny[None] <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_local.py PASSED [ 7%] 426s deploy/tests/test_local.py::test_memory_nanny[3] <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_local.py PASSED [ 7%] 426s deploy/tests/test_local.py::test_death_timeout_raises <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_local.py PASSED [ 7%] 426s deploy/tests/test_local.py::test_bokeh_kwargs <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_local.py SKIPPED [ 7%] 427s deploy/tests/test_local.py::test_io_loop_periodic_callbacks <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_local.py PASSED [ 7%] 427s deploy/tests/test_local.py::test_logging <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_local.py PASSED [ 7%] 427s deploy/tests/test_local.py::test_ipywidgets <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_local.py SKIPPED [ 7%] 427s deploy/tests/test_local.py::test_ipywidgets_loop <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_local.py SKIPPED [ 7%] 427s deploy/tests/test_local.py::test_no_ipywidgets <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_local.py PASSED [ 7%] 428s deploy/tests/test_local.py::test_scale <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_local.py PASSED [ 7%] 428s deploy/tests/test_local.py::test_adapt <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_local.py PASSED [ 7%] 428s deploy/tests/test_local.py::test_adapt_then_manual <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_local.py PASSED [ 7%] 428s deploy/tests/test_local.py::test_local_tls[True] <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_local.py PASSED [ 7%] 428s deploy/tests/test_local.py::test_local_tls[False] <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_local.py PASSED [ 7%] 428s deploy/tests/test_local.py::test_scale_retires_workers <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_local.py PASSED [ 7%] 432s deploy/tests/test_local.py::test_local_tls_restart <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_local.py PASSED [ 7%] 432s deploy/tests/test_local.py::test_asynchronous_property <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_local.py PASSED [ 7%] 432s deploy/tests/test_local.py::test_protocol_inproc <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_local.py PASSED [ 7%] 432s deploy/tests/test_local.py::test_protocol_tcp <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_local.py PASSED [ 7%] 432s deploy/tests/test_local.py::test_protocol_ip <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_local.py PASSED [ 7%] 432s deploy/tests/test_local.py::test_worker_class_worker <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_local.py PASSED [ 7%] 433s deploy/tests/test_local.py::test_worker_class_nanny <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_local.py PASSED [ 8%] 434s deploy/tests/test_local.py::test_worker_class_nanny_async <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_local.py PASSED [ 8%] 434s deploy/tests/test_local.py::test_starts_up_sync <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_local.py PASSED [ 8%] 436s deploy/tests/test_local.py::test_dont_select_closed_worker <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_local.py PASSED [ 8%] 436s deploy/tests/test_local.py::test_client_cluster_synchronous <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_local.py PASSED [ 8%] 436s deploy/tests/test_local.py::test_scale_memory_cores <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_local.py PASSED [ 8%] 436s deploy/tests/test_local.py::test_repr[2 GiB] <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_local.py PASSED [ 8%] 436s deploy/tests/test_local.py::test_repr[None] <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_local.py PASSED [ 8%] 436s deploy/tests/test_local.py::test_threads_per_worker_set_to_0 <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_local.py PASSED [ 8%] 436s deploy/tests/test_local.py::test_capture_security[True] <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_local.py PASSED [ 8%] 436s deploy/tests/test_local.py::test_capture_security[False] <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_local.py PASSED [ 8%] 436s deploy/tests/test_local.py::test_no_dangling_asyncio_tasks <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_local.py PASSED [ 8%] 436s deploy/tests/test_local.py::test_async_with <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_local.py PASSED [ 8%] 436s deploy/tests/test_local.py::test_no_workers <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_local.py PASSED [ 8%] 437s deploy/tests/test_local.py::test_cluster_names <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_local.py PASSED [ 8%] 437s deploy/tests/test_local.py::test_local_cluster_redundant_kwarg[True] <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_local.py PASSED [ 8%] 437s deploy/tests/test_local.py::test_local_cluster_redundant_kwarg[False] <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_local.py PASSED [ 8%] 437s deploy/tests/test_local.py::test_cluster_info_sync <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_local.py PASSED [ 8%] 437s deploy/tests/test_local.py::test_cluster_info_sync_is_robust_to_network_blips <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_local.py PASSED [ 8%] 439s deploy/tests/test_local.py::test_cluster_host_used_throughout_cluster[True-None] <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_local.py PASSED [ 8%] 440s deploy/tests/test_local.py::test_cluster_host_used_throughout_cluster[True-127.0.0.1] <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_local.py PASSED [ 8%] 441s deploy/tests/test_local.py::test_cluster_host_used_throughout_cluster[False-None] <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_local.py PASSED [ 8%] 442s deploy/tests/test_local.py::test_cluster_host_used_throughout_cluster[False-127.0.0.1] <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_local.py PASSED [ 8%] 442s deploy/tests/test_local.py::test_connect_to_closed_cluster <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_local.py PASSED [ 8%] 443s deploy/tests/test_local.py::test_localcluster_start_exception <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_local.py PASSED [ 8%] 443s deploy/tests/test_old_ssh.py::test_old_ssh_n_workers_with_nprocs_is_an_error <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_old_ssh.py PASSED [ 8%] 443s deploy/tests/test_old_ssh.py::test_extra_kwargs_is_an_error <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_old_ssh.py PASSED [ 8%] 443s deploy/tests/test_slow_adaptive.py::test_startup <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_slow_adaptive.py PASSED [ 8%] 443s deploy/tests/test_slow_adaptive.py::test_scale_up_down <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_slow_adaptive.py PASSED [ 8%] 444s deploy/tests/test_slow_adaptive.py::test_adaptive <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_slow_adaptive.py PASSED [ 8%] 444s deploy/tests/test_spec_cluster.py::test_specification <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_spec_cluster.py PASSED [ 8%] 444s deploy/tests/test_spec_cluster.py::test_spec_sync <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_spec_cluster.py PASSED [ 8%] 444s deploy/tests/test_spec_cluster.py::test_loop_started_in_constructor <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_spec_cluster.py PASSED [ 8%] 444s deploy/tests/test_spec_cluster.py::test_repr <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_spec_cluster.py PASSED [ 8%] 444s deploy/tests/test_spec_cluster.py::test_scale <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_spec_cluster.py PASSED [ 8%] 448s deploy/tests/test_spec_cluster.py::test_adaptive_killed_worker <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_spec_cluster.py PASSED [ 8%] 448s deploy/tests/test_spec_cluster.py::test_unexpected_closed_worker <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_spec_cluster.py PASSED [ 8%] 451s deploy/tests/test_spec_cluster.py::test_restart <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_spec_cluster.py PASSED [ 9%] 451s deploy/tests/test_spec_cluster.py::test_broken_worker <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_spec_cluster.py PASSED [ 9%] 451s deploy/tests/test_spec_cluster.py::test_spec_close_clusters <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_spec_cluster.py PASSED [ 9%] 451s deploy/tests/test_spec_cluster.py::test_new_worker_spec <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_spec_cluster.py PASSED [ 9%] 452s deploy/tests/test_spec_cluster.py::test_nanny_port <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_spec_cluster.py PASSED [ 9%] 452s deploy/tests/test_spec_cluster.py::test_spec_process <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_spec_cluster.py PASSED [ 9%] 452s deploy/tests/test_spec_cluster.py::test_get_logs <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_spec_cluster.py PASSED [ 9%] 452s deploy/tests/test_spec_cluster.py::test_logs_deprecated <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_spec_cluster.py PASSED [ 9%] 452s deploy/tests/test_spec_cluster.py::test_scheduler_info <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_spec_cluster.py PASSED [ 9%] 452s deploy/tests/test_spec_cluster.py::test_dashboard_link <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_spec_cluster.py PASSED [ 9%] 452s deploy/tests/test_spec_cluster.py::test_widget <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_spec_cluster.py PASSED [ 9%] 452s deploy/tests/test_spec_cluster.py::test_scale_cores_memory <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_spec_cluster.py PASSED [ 9%] 452s deploy/tests/test_spec_cluster.py::test_ProcessInterfaceValid <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_spec_cluster.py PASSED [ 9%] 454s deploy/tests/test_spec_cluster.py::test_MultiWorker <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_spec_cluster.py PASSED [ 9%] 454s deploy/tests/test_spec_cluster.py::test_run_spec <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_spec_cluster.py PASSED [ 9%] 454s deploy/tests/test_spec_cluster.py::test_run_spec_cluster_worker_names <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_spec_cluster.py PASSED [ 9%] 454s deploy/tests/test_spec_cluster.py::test_bad_close <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_spec_cluster.py PASSED [ 9%] 456s deploy/tests/test_subprocess.py::test_basic <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_subprocess.py PASSED [ 9%] 458s deploy/tests/test_subprocess.py::test_n_workers <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_subprocess.py PASSED [ 9%] 461s deploy/tests/test_subprocess.py::test_scale_up_and_down <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_subprocess.py PASSED [ 9%] 462s deploy/tests/test_subprocess.py::test_raise_if_scheduler_fails_to_start <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_subprocess.py PASSED [ 9%] 464s deploy/tests/test_subprocess.py::test_subprocess_cluster_does_not_depend_on_logging <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_subprocess.py PASSED [ 9%] 464s deploy/tests/test_subprocess.py::test_raise_on_windows <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_subprocess.py SKIPPED [ 9%] 466s diagnostics/tests/test_cluster_dump_plugin.py::test_cluster_dump_plugin <- ../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_cluster_dump_plugin.py PASSED [ 9%] 466s diagnostics/tests/test_eventstream.py::test_eventstream <- ../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_eventstream.py SKIPPED [ 9%] 466s diagnostics/tests/test_eventstream.py::test_eventstream_remote <- ../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_eventstream.py PASSED [ 9%] 466s diagnostics/tests/test_graph_layout.py::test_basic <- ../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_graph_layout.py PASSED [ 9%] 466s diagnostics/tests/test_graph_layout.py::test_construct_after_call <- ../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_graph_layout.py PASSED [ 9%] 466s diagnostics/tests/test_graph_layout.py::test_states <- ../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_graph_layout.py PASSED [ 9%] 467s diagnostics/tests/test_graph_layout.py::test_release_tasks <- ../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_graph_layout.py PASSED [ 9%] 467s diagnostics/tests/test_graph_layout.py::test_forget <- ../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_graph_layout.py PASSED [ 9%] 467s diagnostics/tests/test_graph_layout.py::test_unique_positions <- ../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_graph_layout.py PASSED [ 9%] 467s diagnostics/tests/test_graph_layout.py::test_layout_scatter <- ../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_graph_layout.py PASSED [ 9%] 467s diagnostics/tests/test_install_plugin.py::test_pip_install <- ../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_install_plugin.py PASSED [ 9%] 467s diagnostics/tests/test_install_plugin.py::test_conda_install <- ../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_install_plugin.py PASSED [ 9%] 467s diagnostics/tests/test_install_plugin.py::test_pip_install_fails <- ../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_install_plugin.py PASSED [ 9%] 467s diagnostics/tests/test_install_plugin.py::test_conda_install_fails_when_conda_not_found <- ../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_install_plugin.py PASSED [ 10%] 467s diagnostics/tests/test_install_plugin.py::test_conda_install_fails_when_conda_raises <- ../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_install_plugin.py PASSED [ 10%] 467s diagnostics/tests/test_install_plugin.py::test_conda_install_fails_on_returncode <- ../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_install_plugin.py PASSED [ 10%] 467s diagnostics/tests/test_install_plugin.py::test_package_install_on_worker <- ../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_install_plugin.py PASSED [ 10%] 468s diagnostics/tests/test_install_plugin.py::test_package_install_on_nanny <- ../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_install_plugin.py PASSED [ 10%] 470s diagnostics/tests/test_install_plugin.py::test_package_install_restarts_on_nanny <- ../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_install_plugin.py PASSED [ 10%] 471s diagnostics/tests/test_install_plugin.py::test_package_install_failing_does_not_restart_on_nanny <- ../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_install_plugin.py PASSED [ 10%] 473s diagnostics/tests/test_memory_sampler.py::test_sync <- ../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_memory_sampler.py PASSED [ 10%] 473s diagnostics/tests/test_memory_sampler.py::test_at_least_one_sample <- ../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_memory_sampler.py PASSED [ 10%] 473s diagnostics/tests/test_memory_sampler.py::test_multi_sample <- ../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_memory_sampler.py PASSED [ 10%] 474s diagnostics/tests/test_memory_sampler.py::test_pandas[False] <- ../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_memory_sampler.py PASSED [ 10%] 474s diagnostics/tests/test_memory_sampler.py::test_pandas[True] <- ../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_memory_sampler.py PASSED [ 10%] 474s diagnostics/tests/test_memory_sampler.py::test_pandas_multiseries[False] <- ../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_memory_sampler.py PASSED [ 10%] 475s diagnostics/tests/test_memory_sampler.py::test_pandas_multiseries[True] <- ../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_memory_sampler.py PASSED [ 10%] 476s diagnostics/tests/test_nanny_plugin.py::test_register_worker_plugin_is_deprecated <- ../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_nanny_plugin.py PASSED [ 10%] 477s diagnostics/tests/test_nanny_plugin.py::test_register_worker_plugin_typing_over_nanny_keyword <- ../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_nanny_plugin.py PASSED [ 10%] 478s diagnostics/tests/test_nanny_plugin.py::test_duck_typed_register_nanny_plugin_is_deprecated <- ../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_nanny_plugin.py PASSED [ 10%] 479s diagnostics/tests/test_nanny_plugin.py::test_register_idempotent_plugin <- ../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_nanny_plugin.py PASSED [ 10%] 480s diagnostics/tests/test_nanny_plugin.py::test_register_non_idempotent_plugin <- ../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_nanny_plugin.py PASSED [ 10%] 481s diagnostics/tests/test_nanny_plugin.py::test_register_plugin_with_idempotent_keyword_is_deprecated <- ../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_nanny_plugin.py PASSED [ 10%] 483s diagnostics/tests/test_nanny_plugin.py::test_register_plugin_with_broken_setup_to_existing_nannies_raises <- ../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_nanny_plugin.py PASSED [ 10%] 484s diagnostics/tests/test_nanny_plugin.py::test_plugin_with_broken_setup_on_new_nanny_logs <- ../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_nanny_plugin.py PASSED [ 10%] 485s diagnostics/tests/test_nanny_plugin.py::test_unregister_nanny_plugin_with_broken_teardown_raises <- ../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_nanny_plugin.py PASSED [ 10%] 486s diagnostics/tests/test_nanny_plugin.py::test_nanny_plugin_with_broken_teardown_logs_on_close <- ../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_nanny_plugin.py PASSED [ 10%] 486s diagnostics/tests/test_progress.py::test_many_Progress <- ../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_progress.py PASSED [ 10%] 486s diagnostics/tests/test_progress.py::test_multiprogress <- ../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_progress.py PASSED [ 10%] 486s diagnostics/tests/test_progress.py::test_multiprogress_cancel <- ../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_progress.py PASSED [ 10%] 487s diagnostics/tests/test_progress.py::test_multiprogress_with_spans <- ../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_progress.py PASSED [ 10%] 487s diagnostics/tests/test_progress.py::test_multiprogress_with_prefix <- ../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_progress.py PASSED [ 10%] 487s diagnostics/tests/test_progress.py::test_multiprogress_warns <- ../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_progress.py PASSED [ 10%] 487s diagnostics/tests/test_progress.py::test_robust_to_bad_plugin <- ../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_progress.py PASSED [ 10%] 491s diagnostics/tests/test_progress.py::test_AllProgress <- ../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_progress.py PASSED [ 10%] 493s diagnostics/tests/test_progress.py::test_AllProgress_lost_key <- ../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_progress.py PASSED [ 10%] 498s diagnostics/tests/test_progress.py::test_group_timing <- ../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_progress.py PASSED [ 10%] 499s diagnostics/tests/test_progressbar.py::test_text_progressbar <- ../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_progressbar.py PASSED [ 10%] 499s diagnostics/tests/test_progressbar.py::test_TextProgressBar_error <- ../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_progressbar.py PASSED [ 10%] 499s diagnostics/tests/test_progressbar.py::test_TextProgressBar_empty <- ../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_progressbar.py PASSED [ 11%] 501s diagnostics/tests/test_progressbar.py::test_progress_function <- ../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_progressbar.py PASSED [ 11%] 503s diagnostics/tests/test_progressbar.py::test_progress_function_w_kwargs <- ../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_progressbar.py PASSED [ 11%] 504s diagnostics/tests/test_progressbar.py::test_progress_function_warns <- ../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_progressbar.py PASSED [ 11%] 504s diagnostics/tests/test_progressbar.py::test_progress_function_raises <- ../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_progressbar.py PASSED [ 11%] 504s diagnostics/tests/test_progressbar.py::test_deprecated_loop_properties <- ../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_progressbar.py PASSED [ 11%] 504s diagnostics/tests/test_scheduler_plugin.py::test_simple <- ../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_scheduler_plugin.py PASSED [ 11%] 504s diagnostics/tests/test_scheduler_plugin.py::test_add_remove_worker <- ../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_scheduler_plugin.py PASSED [ 11%] 504s diagnostics/tests/test_scheduler_plugin.py::test_remove_worker_renamed_kwargs_allowed <- ../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_scheduler_plugin.py PASSED [ 11%] 504s diagnostics/tests/test_scheduler_plugin.py::test_remove_worker_without_kwargs_deprecated <- ../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_scheduler_plugin.py PASSED [ 11%] 504s diagnostics/tests/test_scheduler_plugin.py::test_async_add_remove_worker <- ../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_scheduler_plugin.py PASSED [ 11%] 504s diagnostics/tests/test_scheduler_plugin.py::test_async_and_sync_add_remove_worker <- ../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_scheduler_plugin.py PASSED [ 11%] 504s diagnostics/tests/test_scheduler_plugin.py::test_failing_async_add_remove_worker <- ../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_scheduler_plugin.py PASSED [ 11%] 504s diagnostics/tests/test_scheduler_plugin.py::test_failing_sync_add_remove_worker <- ../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_scheduler_plugin.py PASSED [ 11%] 504s diagnostics/tests/test_scheduler_plugin.py::test_lifecycle <- ../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_scheduler_plugin.py PASSED [ 11%] 505s diagnostics/tests/test_scheduler_plugin.py::test_register_plugin <- ../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_scheduler_plugin.py PASSED [ 11%] 505s diagnostics/tests/test_scheduler_plugin.py::test_register_scheduler_plugin_deprecated <- ../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_scheduler_plugin.py PASSED [ 11%] 505s diagnostics/tests/test_scheduler_plugin.py::test_unregister_scheduler_plugin <- ../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_scheduler_plugin.py PASSED [ 11%] 505s diagnostics/tests/test_scheduler_plugin.py::test_unregister_scheduler_plugin_from_client <- ../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_scheduler_plugin.py PASSED [ 11%] 505s diagnostics/tests/test_scheduler_plugin.py::test_register_plugin_on_scheduler <- ../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_scheduler_plugin.py PASSED [ 11%] 507s diagnostics/tests/test_scheduler_plugin.py::test_closing_errors_ok <- ../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_scheduler_plugin.py PASSED [ 11%] 507s diagnostics/tests/test_scheduler_plugin.py::test_update_graph_hook_simple <- ../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_scheduler_plugin.py PASSED [ 11%] 507s diagnostics/tests/test_scheduler_plugin.py::test_update_graph_hook_complex <- ../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_scheduler_plugin.py PASSED [ 11%] 507s diagnostics/tests/test_scheduler_plugin.py::test_scheduler_plugin_in_register_worker_plugin_overrides <- ../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_scheduler_plugin.py PASSED [ 11%] 508s diagnostics/tests/test_scheduler_plugin.py::test_scheduler_plugin_in_register_worker_plugin_overrides_nanny <- ../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_scheduler_plugin.py PASSED [ 11%] 508s diagnostics/tests/test_scheduler_plugin.py::test_register_idempotent_plugin <- ../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_scheduler_plugin.py PASSED [ 11%] 508s diagnostics/tests/test_scheduler_plugin.py::test_register_non_idempotent_plugin <- ../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_scheduler_plugin.py PASSED [ 11%] 508s diagnostics/tests/test_scheduler_plugin.py::test_register_plugin_with_idempotent_keyword_is_deprecated <- ../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_scheduler_plugin.py PASSED [ 11%] 508s diagnostics/tests/test_scheduler_plugin.py::test_register_idempotent_plugins_directly <- ../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_scheduler_plugin.py PASSED [ 11%] 508s diagnostics/tests/test_scheduler_plugin.py::test_register_non_idempotent_plugins_directly <- ../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_scheduler_plugin.py PASSED [ 11%] 508s diagnostics/tests/test_task_stream.py::test_TaskStreamPlugin <- ../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_task_stream.py PASSED [ 11%] 508s diagnostics/tests/test_task_stream.py::test_maxlen <- ../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_task_stream.py PASSED [ 11%] 509s diagnostics/tests/test_task_stream.py::test_collect <- ../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_task_stream.py PASSED [ 11%] 509s diagnostics/tests/test_task_stream.py::test_no_startstops <- ../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_task_stream.py PASSED [ 11%] 509s diagnostics/tests/test_task_stream.py::test_client <- ../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_task_stream.py PASSED [ 11%] 511s diagnostics/tests/test_task_stream.py::test_client_sync <- ../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_task_stream.py PASSED [ 11%] 511s diagnostics/tests/test_task_stream.py::test_get_task_stream_plot <- ../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_task_stream.py SKIPPED [ 12%] 513s diagnostics/tests/test_task_stream.py::test_get_task_stream_save <- ../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_task_stream.py SKIPPED [ 12%] 513s diagnostics/tests/test_worker_plugin.py::test_create_with_client <- ../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_worker_plugin.py PASSED [ 12%] 513s diagnostics/tests/test_worker_plugin.py::test_remove_with_client <- ../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_worker_plugin.py PASSED [ 12%] 513s diagnostics/tests/test_worker_plugin.py::test_remove_with_client_raises <- ../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_worker_plugin.py PASSED [ 12%] 513s diagnostics/tests/test_worker_plugin.py::test_create_on_construction <- ../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_worker_plugin.py PASSED [ 12%] 513s diagnostics/tests/test_worker_plugin.py::test_normal_task_transitions_called <- ../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_worker_plugin.py PASSED [ 12%] 513s diagnostics/tests/test_worker_plugin.py::test_failing_task_transitions_called <- ../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_worker_plugin.py PASSED [ 12%] 513s diagnostics/tests/test_worker_plugin.py::test_superseding_task_transitions_called <- ../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_worker_plugin.py PASSED [ 12%] 513s diagnostics/tests/test_worker_plugin.py::test_dependent_tasks <- ../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_worker_plugin.py PASSED [ 12%] 513s diagnostics/tests/test_worker_plugin.py::test_empty_plugin <- ../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_worker_plugin.py PASSED [ 12%] 513s diagnostics/tests/test_worker_plugin.py::test_default_name <- ../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_worker_plugin.py PASSED [ 12%] 513s diagnostics/tests/test_worker_plugin.py::test_assert_no_warning_no_overload <- ../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_worker_plugin.py PASSED [ 12%] 513s diagnostics/tests/test_worker_plugin.py::test_WorkerPlugin_overwrite <- ../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_worker_plugin.py PASSED [ 12%] 513s diagnostics/tests/test_worker_plugin.py::test_register_worker_plugin_is_deprecated <- ../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_worker_plugin.py PASSED [ 12%] 513s diagnostics/tests/test_worker_plugin.py::test_register_worker_plugin_typing_over_nanny_keyword <- ../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_worker_plugin.py PASSED [ 12%] 513s diagnostics/tests/test_worker_plugin.py::test_duck_typed_register_worker_plugin_is_deprecated <- ../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_worker_plugin.py PASSED [ 12%] 513s diagnostics/tests/test_worker_plugin.py::test_register_idempotent_plugin <- ../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_worker_plugin.py PASSED [ 12%] 513s diagnostics/tests/test_worker_plugin.py::test_register_non_idempotent_plugin <- ../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_worker_plugin.py PASSED [ 12%] 513s diagnostics/tests/test_worker_plugin.py::test_register_plugin_with_idempotent_keyword_is_deprecated <- ../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_worker_plugin.py PASSED [ 12%] 514s diagnostics/tests/test_worker_plugin.py::test_register_plugin_with_broken_setup_to_existing_workers_raises <- ../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_worker_plugin.py PASSED [ 12%] 514s diagnostics/tests/test_worker_plugin.py::test_plugin_with_broken_setup_on_new_worker_logs <- ../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_worker_plugin.py PASSED [ 12%] 514s diagnostics/tests/test_worker_plugin.py::test_unregister_worker_plugin_with_broken_teardown_raises <- ../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_worker_plugin.py PASSED [ 12%] 514s diagnostics/tests/test_worker_plugin.py::test_plugin_with_broken_teardown_logs_on_close <- ../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_worker_plugin.py PASSED [ 12%] 514s http/scheduler/tests/test_missing_bokeh.py::test_missing_bokeh <- ../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_missing_bokeh.py PASSED [ 12%] 514s http/scheduler/tests/test_missing_bokeh.py::test_bokeh_version_too_low <- ../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_missing_bokeh.py SKIPPED [ 12%] 514s http/scheduler/tests/test_missing_bokeh.py::test_bokeh_version_too_high <- ../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_missing_bokeh.py SKIPPED [ 12%] 514s http/scheduler/tests/test_scheduler_http.py::test_connect <- ../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 12%] 514s http/scheduler/tests/test_scheduler_http.py::test_worker_404 <- ../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 12%] 514s http/scheduler/tests/test_scheduler_http.py::test_prefix <- ../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py SKIPPED [ 12%] 514s http/scheduler/tests/test_scheduler_http.py::test_prometheus <- ../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 12%] 514s http/scheduler/tests/test_scheduler_http.py::test_metrics_when_prometheus_client_not_installed <- ../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 12%] 514s http/scheduler/tests/test_scheduler_http.py::test_prometheus_collect_client_connections_totals <- ../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 12%] 514s http/scheduler/tests/test_scheduler_http.py::test_prometheus_collect_task_states <- ../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 12%] 515s http/scheduler/tests/test_scheduler_http.py::test_prometheus_collect_task_groups <- ../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 12%] 515s http/scheduler/tests/test_scheduler_http.py::test_prometheus_collect_task_prefix_counts <- ../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 12%] 515s http/scheduler/tests/test_scheduler_http.py::test_prometheus_collect_worker_totals <- ../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 12%] 515s http/scheduler/tests/test_scheduler_http.py::test_prometheus_collect_worker_states <- ../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 13%] 515s http/scheduler/tests/test_scheduler_http.py::test_health <- ../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 13%] 515s http/scheduler/tests/test_scheduler_http.py::test_sitemap <- ../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 13%] 515s http/scheduler/tests/test_scheduler_http.py::test_task_page[1_0] <- ../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 13%] 515s http/scheduler/tests/test_scheduler_http.py::test_task_page[1_1] <- ../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 13%] 515s http/scheduler/tests/test_scheduler_http.py::test_task_page[x] <- ../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 13%] 516s http/scheduler/tests/test_scheduler_http.py::test_task_page[a+b] <- ../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 13%] 516s http/scheduler/tests/test_scheduler_http.py::test_task_page[a b] <- ../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 13%] 516s http/scheduler/tests/test_scheduler_http.py::test_task_page[key5] <- ../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 13%] 516s http/scheduler/tests/test_scheduler_http.py::test_task_page[key6] <- ../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 13%] 516s http/scheduler/tests/test_scheduler_http.py::test_task_page[key7] <- ../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 13%] 516s http/scheduler/tests/test_scheduler_http.py::test_task_page[key8] <- ../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 13%] 516s http/scheduler/tests/test_scheduler_http.py::test_task_page[(] <- ../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 13%] 516s http/scheduler/tests/test_scheduler_http.py::test_task_page[[] <- ../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 13%] 516s http/scheduler/tests/test_scheduler_http.py::test_task_page['] <- ../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 13%] 516s http/scheduler/tests/test_scheduler_http.py::test_task_page["] <- ../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 13%] 516s http/scheduler/tests/test_scheduler_http.py::test_task_page[123] <- ../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 13%] 516s http/scheduler/tests/test_scheduler_http.py::test_task_page[key14] <- ../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 13%] 516s http/scheduler/tests/test_scheduler_http.py::test_task_page[key15] <- ../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 13%] 516s http/scheduler/tests/test_scheduler_http.py::test_task_page[key16] <- ../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 13%] 516s http/scheduler/tests/test_scheduler_http.py::test_task_page[key17] <- ../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 13%] 516s http/scheduler/tests/test_scheduler_http.py::test_task_page[key18] <- ../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 13%] 516s http/scheduler/tests/test_scheduler_http.py::test_call_stack_page[1_0] <- ../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 13%] 516s http/scheduler/tests/test_scheduler_http.py::test_call_stack_page[1_1] <- ../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 13%] 517s http/scheduler/tests/test_scheduler_http.py::test_call_stack_page[x] <- ../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 13%] 517s http/scheduler/tests/test_scheduler_http.py::test_call_stack_page[a+b] <- ../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 13%] 517s http/scheduler/tests/test_scheduler_http.py::test_call_stack_page[a b] <- ../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 13%] 517s http/scheduler/tests/test_scheduler_http.py::test_call_stack_page[key5] <- ../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 13%] 517s http/scheduler/tests/test_scheduler_http.py::test_call_stack_page[key6] <- ../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 13%] 517s http/scheduler/tests/test_scheduler_http.py::test_call_stack_page[key7] <- ../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 13%] 517s http/scheduler/tests/test_scheduler_http.py::test_call_stack_page[key8] <- ../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 13%] 517s http/scheduler/tests/test_scheduler_http.py::test_call_stack_page[(] <- ../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 13%] 517s http/scheduler/tests/test_scheduler_http.py::test_call_stack_page[[] <- ../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 13%] 517s http/scheduler/tests/test_scheduler_http.py::test_call_stack_page['] <- ../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 13%] 517s http/scheduler/tests/test_scheduler_http.py::test_call_stack_page["] <- ../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 13%] 517s http/scheduler/tests/test_scheduler_http.py::test_call_stack_page[123] <- ../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 13%] 517s http/scheduler/tests/test_scheduler_http.py::test_call_stack_page[key14] <- ../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 14%] 517s http/scheduler/tests/test_scheduler_http.py::test_call_stack_page[key15] <- ../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 14%] 518s http/scheduler/tests/test_scheduler_http.py::test_call_stack_page[key16] <- ../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 14%] 518s http/scheduler/tests/test_scheduler_http.py::test_call_stack_page[key17] <- ../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 14%] 518s http/scheduler/tests/test_scheduler_http.py::test_call_stack_page[key18] <- ../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 14%] 518s http/scheduler/tests/test_scheduler_http.py::test_allow_websocket_origin <- ../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py SKIPPED [ 14%] 518s http/scheduler/tests/test_scheduler_http.py::test_eventstream <- ../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 14%] 518s http/scheduler/tests/test_scheduler_http.py::test_api_disabled_by_default <- ../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 14%] 518s http/scheduler/tests/test_scheduler_http.py::test_api <- ../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 14%] 518s http/scheduler/tests/test_scheduler_http.py::test_retire_workers <- ../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 14%] 518s http/scheduler/tests/test_scheduler_http.py::test_get_workers <- ../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 14%] 518s http/scheduler/tests/test_scheduler_http.py::test_adaptive_target <- ../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 14%] 518s http/scheduler/tests/test_scheduler_http.py::test_check_idle <- ../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 14%] 518s http/scheduler/tests/test_semaphore_http.py::test_prometheus <- ../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_semaphore_http.py PASSED [ 14%] 518s http/scheduler/tests/test_semaphore_http.py::test_prometheus_without_semaphore_extension <- ../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_semaphore_http.py PASSED [ 14%] 518s http/scheduler/tests/test_stealing_http.py::test_prometheus <- ../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_stealing_http.py PASSED [ 14%] 519s http/scheduler/tests/test_stealing_http.py::test_prometheus_collect_count_total_by_cost_multipliers <- ../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_stealing_http.py PASSED [ 14%] 519s http/scheduler/tests/test_stealing_http.py::test_prometheus_collect_cost_total_by_cost_multipliers <- ../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_stealing_http.py PASSED [ 14%] 519s http/scheduler/tests/test_stealing_http.py::test_prometheus_without_stealing_extension <- ../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_stealing_http.py PASSED [ 14%] 519s http/tests/test_core.py::test_scheduler <- ../../../usr/lib/python3/dist-packages/distributed/http/tests/test_core.py PASSED [ 14%] 519s http/tests/test_routing.py::test_basic <- ../../../usr/lib/python3/dist-packages/distributed/http/tests/test_routing.py PASSED [ 14%] 519s http/worker/tests/test_worker_http.py::test_prometheus <- ../../../usr/lib/python3/dist-packages/distributed/http/worker/tests/test_worker_http.py PASSED [ 14%] 519s http/worker/tests/test_worker_http.py::test_metrics_when_prometheus_client_not_installed <- ../../../usr/lib/python3/dist-packages/distributed/http/worker/tests/test_worker_http.py PASSED [ 14%] 520s http/worker/tests/test_worker_http.py::test_prometheus_collect_task_states <- ../../../usr/lib/python3/dist-packages/distributed/http/worker/tests/test_worker_http.py PASSED [ 14%] 520s http/worker/tests/test_worker_http.py::test_health <- ../../../usr/lib/python3/dist-packages/distributed/http/worker/tests/test_worker_http.py PASSED [ 14%] 520s http/worker/tests/test_worker_http.py::test_sitemap <- ../../../usr/lib/python3/dist-packages/distributed/http/worker/tests/test_worker_http.py PASSED [ 14%] 520s http/worker/tests/test_worker_http.py::test_prometheus_collect_memory_metrics <- ../../../usr/lib/python3/dist-packages/distributed/http/worker/tests/test_worker_http.py PASSED [ 14%] 520s http/worker/tests/test_worker_http.py::test_prometheus_collect_memory_metrics_spill_disabled <- ../../../usr/lib/python3/dist-packages/distributed/http/worker/tests/test_worker_http.py PASSED [ 14%] 520s http/worker/tests/test_worker_http.py::test_prometheus_collect_memory_metrics_bogus_sizeof <- ../../../usr/lib/python3/dist-packages/distributed/http/worker/tests/test_worker_http.py SKIPPED [ 14%] 520s protocol/tests/test_collection.py::test_serialize_collection[y0-dask-tuple] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_collection.py PASSED [ 14%] 520s protocol/tests/test_collection.py::test_serialize_collection[y0-dask-dict] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_collection.py PASSED [ 14%] 520s protocol/tests/test_collection.py::test_serialize_collection[y0-dask-list] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_collection.py PASSED [ 14%] 520s protocol/tests/test_collection.py::test_serialize_collection[y1-pickle-tuple] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_collection.py PASSED [ 14%] 520s protocol/tests/test_collection.py::test_serialize_collection[y1-pickle-dict] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_collection.py PASSED [ 14%] 520s protocol/tests/test_collection.py::test_serialize_collection[y1-pickle-list] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_collection.py PASSED [ 14%] 520s protocol/tests/test_collection.py::test_serialize_collection[None-pickle-tuple] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_collection.py PASSED [ 14%] 520s protocol/tests/test_collection.py::test_serialize_collection[None-pickle-dict] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_collection.py PASSED [ 15%] 520s protocol/tests/test_collection.py::test_serialize_collection[None-pickle-list] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_collection.py PASSED [ 15%] 520s protocol/tests/test_collection.py::test_large_collections_serialize_simply <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_collection.py PASSED [ 15%] 520s protocol/tests/test_collection.py::test_nested_types <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_collection.py PASSED [ 15%] 520s protocol/tests/test_collection_cuda.py::test_serialize_cupy[50-cuda-tuple] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_collection_cuda.py SKIPPED [ 15%] 520s protocol/tests/test_collection_cuda.py::test_serialize_cupy[50-cuda-dict] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_collection_cuda.py SKIPPED [ 15%] 520s protocol/tests/test_collection_cuda.py::test_serialize_cupy[None-pickle-tuple] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_collection_cuda.py SKIPPED [ 15%] 520s protocol/tests/test_collection_cuda.py::test_serialize_cupy[None-pickle-dict] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_collection_cuda.py SKIPPED [ 15%] 520s protocol/tests/test_collection_cuda.py::test_serialize_pandas_pandas[df20-cuda-tuple] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_collection_cuda.py SKIPPED [ 15%] 520s protocol/tests/test_collection_cuda.py::test_serialize_pandas_pandas[df20-cuda-dict] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_collection_cuda.py SKIPPED [ 15%] 520s protocol/tests/test_collection_cuda.py::test_serialize_pandas_pandas[None-pickle-tuple] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_collection_cuda.py SKIPPED [ 15%] 520s protocol/tests/test_collection_cuda.py::test_serialize_pandas_pandas[None-pickle-dict] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_collection_cuda.py SKIPPED [ 15%] 520s protocol/tests/test_compression.py::test_get_compression_settings <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py PASSED [ 15%] 520s protocol/tests/test_compression.py::test_auto_compression <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py PASSED [ 15%] 520s protocol/tests/test_compression.py::test_compression_1 <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py PASSED [ 15%] 520s protocol/tests/test_compression.py::test_compression_2 <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py PASSED [ 15%] 520s protocol/tests/test_compression.py::test_compression_3 <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py PASSED [ 15%] 520s protocol/tests/test_compression.py::test_compression_without_deserialization <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py PASSED [ 15%] 520s protocol/tests/test_compression.py::test_lz4_decompression_avoids_deep_copy <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py PASSED [ 15%] 520s protocol/tests/test_compression.py::test_maybe_compress[None-bytes] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py PASSED [ 15%] 520s protocol/tests/test_compression.py::test_maybe_compress[None-memoryview] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py PASSED [ 15%] 520s protocol/tests/test_compression.py::test_maybe_compress[zlib-bytes] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py PASSED [ 15%] 520s protocol/tests/test_compression.py::test_maybe_compress[zlib-memoryview] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py PASSED [ 15%] 520s protocol/tests/test_compression.py::test_maybe_compress[lz4-bytes] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py PASSED [ 15%] 520s protocol/tests/test_compression.py::test_maybe_compress[lz4-memoryview] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py PASSED [ 15%] 520s protocol/tests/test_compression.py::test_maybe_compress[snappy-bytes] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py SKIPPED [ 15%] 520s protocol/tests/test_compression.py::test_maybe_compress[snappy-memoryview] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py SKIPPED [ 15%] 520s protocol/tests/test_compression.py::test_maybe_compress[zstd-bytes] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py SKIPPED [ 15%] 520s protocol/tests/test_compression.py::test_maybe_compress[zstd-memoryview] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py SKIPPED [ 15%] 520s protocol/tests/test_compression.py::test_maybe_compress_sample[None] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py PASSED [ 15%] 520s protocol/tests/test_compression.py::test_maybe_compress_sample[zlib] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py PASSED [ 15%] 520s protocol/tests/test_compression.py::test_maybe_compress_sample[lz4] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py PASSED [ 15%] 520s protocol/tests/test_compression.py::test_maybe_compress_sample[snappy] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py SKIPPED [ 15%] 520s protocol/tests/test_compression.py::test_maybe_compress_sample[zstd] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py SKIPPED [ 15%] 520s protocol/tests/test_compression.py::test_maybe_compress_memoryviews[None] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py PASSED [ 15%] 521s protocol/tests/test_compression.py::test_maybe_compress_memoryviews[zlib] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py PASSED [ 15%] 521s protocol/tests/test_compression.py::test_maybe_compress_memoryviews[lz4] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py PASSED [ 16%] 521s protocol/tests/test_compression.py::test_maybe_compress_memoryviews[snappy] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py SKIPPED [ 16%] 521s protocol/tests/test_compression.py::test_maybe_compress_memoryviews[zstd] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py SKIPPED [ 16%] 521s protocol/tests/test_compression.py::test_maybe_compress_auto <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py PASSED [ 16%] 521s protocol/tests/test_compression.py::test_compression_thread_safety[None-bytes] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py PASSED [ 16%] 521s protocol/tests/test_compression.py::test_compression_thread_safety[None-memoryview] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py PASSED [ 16%] 522s protocol/tests/test_compression.py::test_compression_thread_safety[zlib-bytes] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py PASSED [ 16%] 522s protocol/tests/test_compression.py::test_compression_thread_safety[zlib-memoryview] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py PASSED [ 16%] 523s protocol/tests/test_compression.py::test_compression_thread_safety[lz4-bytes] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py PASSED [ 16%] 523s protocol/tests/test_compression.py::test_compression_thread_safety[lz4-memoryview] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py PASSED [ 16%] 523s protocol/tests/test_compression.py::test_compression_thread_safety[snappy-bytes] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py SKIPPED [ 16%] 523s protocol/tests/test_compression.py::test_compression_thread_safety[snappy-memoryview] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py SKIPPED [ 16%] 523s protocol/tests/test_compression.py::test_compression_thread_safety[zstd-bytes] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py SKIPPED [ 16%] 523s protocol/tests/test_compression.py::test_compression_thread_safety[zstd-memoryview] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py SKIPPED [ 16%] 524s protocol/tests/test_compression.py::test_large_messages[None] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py PASSED [ 16%] 530s protocol/tests/test_compression.py::test_large_messages[zlib] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py PASSED [ 16%] 531s protocol/tests/test_compression.py::test_large_messages[lz4] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py PASSED [ 16%] 531s protocol/tests/test_compression.py::test_large_messages[snappy] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py SKIPPED [ 16%] 531s protocol/tests/test_compression.py::test_large_messages[zstd] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py SKIPPED [ 16%] 531s protocol/tests/test_compression.py::test_loads_without_deserialization_avoids_compression <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py PASSED [ 16%] 531s protocol/tests/test_compression.py::test_compress_remote_comms <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py PASSED [ 16%] 531s protocol/tests/test_compression.py::test_disable_compression_on_localhost[None] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py PASSED [ 16%] 532s protocol/tests/test_compression.py::test_disable_compression_on_localhost[127.0.0.1] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py PASSED [ 16%] 532s protocol/tests/test_compression.py::test_disable_compression_on_localhost[localhost] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py PASSED [ 16%] 532s protocol/tests/test_h5py.py::test_serialize_deserialize_file <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_h5py.py PASSED [ 16%] 532s protocol/tests/test_h5py.py::test_serialize_deserialize_group <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_h5py.py PASSED [ 16%] 532s protocol/tests/test_h5py.py::test_serialize_deserialize_dataset <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_h5py.py PASSED [ 16%] 532s protocol/tests/test_h5py.py::test_raise_error_on_serialize_write_permissions <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_h5py.py PASSED [ 16%] 532s protocol/tests/test_h5py.py::test_h5py_serialize <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_h5py.py PASSED [ 16%] 532s protocol/tests/test_h5py.py::test_h5py_serialize_2 <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_h5py.py PASSED [ 16%] 532s protocol/tests/test_highlevelgraph.py::test_combo_of_layer_types <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_highlevelgraph.py PASSED [ 16%] 532s protocol/tests/test_highlevelgraph.py::test_blockwise <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_highlevelgraph.py PASSED [ 16%] 533s protocol/tests/test_highlevelgraph.py::test_shuffle <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_highlevelgraph.py PASSED [ 16%] 533s protocol/tests/test_highlevelgraph.py::test_array_annotations <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_highlevelgraph.py PASSED [ 16%] 533s protocol/tests/test_highlevelgraph.py::test_dataframe_annotations <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_highlevelgraph.py PASSED [ 16%] 533s protocol/tests/test_netcdf4.py::test_serialize_deserialize_dataset <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_netcdf4.py PASSED [ 16%] 533s protocol/tests/test_netcdf4.py::test_serialize_deserialize_variable <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_netcdf4.py PASSED [ 16%] 533s protocol/tests/test_netcdf4.py::test_serialize_deserialize_group <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_netcdf4.py PASSED [ 17%] 533s protocol/tests/test_netcdf4.py::test_netcdf4_serialize <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_netcdf4.py PASSED [ 17%] 533s protocol/tests/test_numpy.py::test_serialize <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 17%] 533s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x0] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 17%] 533s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x1] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 17%] 533s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x2] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 17%] 533s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x3] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 17%] 533s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x4] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 17%] 533s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x5] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 17%] 533s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x6] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 17%] 533s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x7] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 17%] 533s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x8] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 17%] 533s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x9] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 17%] 533s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x10] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 17%] 533s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x11] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 17%] 533s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x12] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 17%] 533s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x13] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 17%] 533s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x14] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 17%] 533s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x15] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 17%] 533s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x16] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 17%] 533s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x17] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 17%] 533s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x18] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 17%] 533s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x19] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 17%] 533s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x20] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 17%] 533s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x21] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 17%] 533s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x22] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 17%] 533s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x23] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 17%] 533s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x24] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 17%] 533s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x25] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 17%] 533s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x26] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 17%] 533s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x27] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 17%] 533s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x28] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 17%] 533s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x29] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 17%] 533s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x30] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 17%] 533s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x31] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 17%] 533s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x32] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 17%] 533s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x33] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 18%] 533s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x34] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 18%] 533s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x35] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 18%] 533s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x36] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 18%] 533s protocol/tests/test_numpy.py::test_dumps_numpy_writable[True] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 18%] 533s protocol/tests/test_numpy.py::test_dumps_numpy_writable[False] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 18%] 533s protocol/tests/test_numpy.py::test_serialize_numpy_ma_masked_array[x0] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 18%] 533s protocol/tests/test_numpy.py::test_serialize_numpy_ma_masked_array[x1] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 18%] 533s protocol/tests/test_numpy.py::test_serialize_numpy_ma_masked_array[x2] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 18%] 533s protocol/tests/test_numpy.py::test_serialize_numpy_ma_masked_array[x3] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 18%] 533s protocol/tests/test_numpy.py::test_serialize_numpy_ma_masked_array[x4] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 18%] 533s protocol/tests/test_numpy.py::test_serialize_numpy_ma_masked_array[x5] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 18%] 533s protocol/tests/test_numpy.py::test_serialize_numpy_ma_masked <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 18%] 533s protocol/tests/test_numpy.py::test_dumps_serialize_numpy_custom_dtype <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py SKIPPED [ 18%] 533s protocol/tests/test_numpy.py::test_memmap <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 18%] 534s protocol/tests/test_numpy.py::test_dumps_serialize_numpy_large <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 18%] 534s protocol/tests/test_numpy.py::test_itemsize[f8-8] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 18%] 534s protocol/tests/test_numpy.py::test_itemsize[i4-4] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 18%] 534s protocol/tests/test_numpy.py::test_itemsize[c16-16] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 18%] 534s protocol/tests/test_numpy.py::test_itemsize[b-1] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 18%] 534s protocol/tests/test_numpy.py::test_itemsize[S3-3] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 18%] 534s protocol/tests/test_numpy.py::test_itemsize[M8[us]-8] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 18%] 534s protocol/tests/test_numpy.py::test_itemsize[M8[s]-8] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 18%] 534s protocol/tests/test_numpy.py::test_itemsize[U3-12] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 18%] 534s protocol/tests/test_numpy.py::test_itemsize[dt8-12] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 18%] 534s protocol/tests/test_numpy.py::test_itemsize[dt9-4] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 18%] 534s protocol/tests/test_numpy.py::test_itemsize[dt10-8] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 18%] 534s protocol/tests/test_numpy.py::test_itemsize[dt11-88] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 18%] 534s protocol/tests/test_numpy.py::test_itemsize[dt12-8] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 18%] 534s protocol/tests/test_numpy.py::test_compress_numpy <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 18%] 534s protocol/tests/test_numpy.py::test_compress_memoryview <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 18%] 534s protocol/tests/test_numpy.py::test_dumps_large <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 18%] 534s protocol/tests/test_numpy.py::test_zero_strided_numpy_array[True-x0] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 18%] 534s protocol/tests/test_numpy.py::test_zero_strided_numpy_array[True-x1] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 18%] 534s protocol/tests/test_numpy.py::test_zero_strided_numpy_array[True-x2] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 18%] 534s protocol/tests/test_numpy.py::test_zero_strided_numpy_array[True-x3] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 18%] 534s protocol/tests/test_numpy.py::test_zero_strided_numpy_array[False-x0] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 19%] 534s protocol/tests/test_numpy.py::test_zero_strided_numpy_array[False-x1] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 19%] 534s protocol/tests/test_numpy.py::test_zero_strided_numpy_array[False-x2] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 19%] 534s protocol/tests/test_numpy.py::test_zero_strided_numpy_array[False-x3] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 19%] 534s protocol/tests/test_numpy.py::test_non_zero_strided_array <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 19%] 534s protocol/tests/test_numpy.py::test_serialize_writeable_array_readonly_base_object <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 19%] 534s protocol/tests/test_pandas.py::test_dumps_serialize_pandas[df0] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pandas.py PASSED [ 19%] 534s protocol/tests/test_pandas.py::test_dumps_serialize_pandas[df1] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pandas.py PASSED [ 19%] 534s protocol/tests/test_pandas.py::test_dumps_serialize_pandas[df2] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pandas.py PASSED [ 19%] 534s protocol/tests/test_pandas.py::test_dumps_serialize_pandas[df3] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pandas.py PASSED [ 19%] 534s protocol/tests/test_pandas.py::test_dumps_serialize_pandas[df4] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pandas.py PASSED [ 19%] 534s protocol/tests/test_pandas.py::test_dumps_serialize_pandas[df5] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pandas.py PASSED [ 19%] 534s protocol/tests/test_pandas.py::test_dumps_serialize_pandas[df6] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pandas.py PASSED [ 19%] 534s protocol/tests/test_pandas.py::test_dumps_serialize_pandas[df7] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pandas.py PASSED [ 19%] 534s protocol/tests/test_pandas.py::test_dumps_serialize_pandas[df8] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pandas.py PASSED [ 19%] 534s protocol/tests/test_pandas.py::test_dumps_serialize_pandas[df9] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pandas.py PASSED [ 19%] 534s protocol/tests/test_pandas.py::test_dumps_serialize_pandas[df10] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pandas.py PASSED [ 19%] 534s protocol/tests/test_pandas.py::test_dumps_serialize_pandas[df11] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pandas.py PASSED [ 19%] 534s protocol/tests/test_pandas.py::test_dumps_serialize_pandas[df12] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pandas.py PASSED [ 19%] 534s protocol/tests/test_pandas.py::test_dumps_serialize_pandas[df13] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pandas.py PASSED [ 19%] 534s protocol/tests/test_pandas.py::test_dumps_serialize_pandas[df14] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pandas.py PASSED [ 19%] 534s protocol/tests/test_pandas.py::test_dumps_serialize_pandas[df15] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pandas.py PASSED [ 19%] 534s protocol/tests/test_pandas.py::test_dumps_serialize_pandas[df16] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pandas.py PASSED [ 19%] 534s protocol/tests/test_pandas.py::test_dumps_serialize_pandas[df17] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pandas.py PASSED [ 19%] 534s protocol/tests/test_pandas.py::test_dumps_serialize_pandas[df18] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pandas.py PASSED [ 19%] 534s protocol/tests/test_pandas.py::test_dumps_serialize_pandas[df19] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pandas.py PASSED [ 19%] 534s protocol/tests/test_pandas.py::test_dumps_serialize_pandas[df20] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pandas.py PASSED [ 19%] 534s protocol/tests/test_pandas.py::test_dumps_serialize_pandas[df21] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pandas.py PASSED [ 19%] 534s protocol/tests/test_pandas.py::test_dumps_serialize_pandas[df22] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pandas.py PASSED [ 19%] 534s protocol/tests/test_pandas.py::test_dumps_serialize_pandas[df23] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pandas.py PASSED [ 19%] 534s protocol/tests/test_pandas.py::test_dumps_serialize_pandas[df24] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pandas.py PASSED [ 19%] 534s protocol/tests/test_pandas.py::test_dumps_serialize_pandas[df25] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pandas.py PASSED [ 19%] 534s protocol/tests/test_pandas.py::test_dumps_pandas_writable <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pandas.py PASSED [ 19%] 534s protocol/tests/test_pickle.py::test_pickle_data[4] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pickle.py PASSED [ 19%] 534s protocol/tests/test_pickle.py::test_pickle_data[5] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pickle.py PASSED [ 19%] 534s protocol/tests/test_pickle.py::test_pickle_out_of_band[4] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pickle.py PASSED [ 19%] 534s protocol/tests/test_pickle.py::test_pickle_out_of_band[5] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pickle.py PASSED [ 20%] 534s protocol/tests/test_pickle.py::test_pickle_empty[4] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pickle.py PASSED [ 20%] 534s protocol/tests/test_pickle.py::test_pickle_empty[5] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pickle.py PASSED [ 20%] 534s protocol/tests/test_pickle.py::test_pickle_numpy[4] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pickle.py PASSED [ 20%] 534s protocol/tests/test_pickle.py::test_pickle_numpy[5] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pickle.py PASSED [ 20%] 534s protocol/tests/test_pickle.py::test_pickle_functions[4] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pickle.py PASSED [ 20%] 534s protocol/tests/test_pickle.py::test_pickle_functions[5] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pickle.py PASSED [ 20%] 534s protocol/tests/test_pickle.py::test_pickle_by_value_when_registered <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pickle.py PASSED [ 20%] 534s protocol/tests/test_pickle.py::test_allow_pickle_if_registered_in_dask_serialize <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pickle.py PASSED [ 20%] 534s protocol/tests/test_pickle.py::test_nopickle_nested <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pickle.py PASSED [ 20%] 536s protocol/tests/test_pickle.py::test_pickle_functions_in_main <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pickle.py PASSED [ 20%] 536s protocol/tests/test_pickle.py::test_pickle_zero_copy_read_only_flag[dask] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pickle.py PASSED [ 20%] 536s protocol/tests/test_pickle.py::test_pickle_zero_copy_read_only_flag[pickle] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pickle.py PASSED [ 20%] 536s protocol/tests/test_protocol.py::test_protocol <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol.py PASSED [ 20%] 536s protocol/tests/test_protocol.py::test_small <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol.py PASSED [ 20%] 536s protocol/tests/test_protocol.py::test_small_and_big <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol.py PASSED [ 20%] 536s protocol/tests/test_protocol.py::test_large_bytes[bytes] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol.py PASSED [ 20%] 536s protocol/tests/test_protocol.py::test_large_bytes[memoryview] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol.py PASSED [ 20%] 536s protocol/tests/test_protocol.py::test_large_messages_map <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol.py PASSED [ 20%] 536s protocol/tests/test_protocol.py::test_loads_deserialize_False <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol.py PASSED [ 20%] 536s protocol/tests/test_protocol.py::test_dumps_loads_Serialize <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol.py PASSED [ 20%] 536s protocol/tests/test_protocol.py::test_dumps_loads_Serialized <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol.py PASSED [ 20%] 536s protocol/tests/test_protocol.py::test_preserve_header[serializers0] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol.py PASSED [ 20%] 536s protocol/tests/test_protocol.py::test_preserve_header[serializers1] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol.py PASSED [ 20%] 536s protocol/tests/test_protocol.py::test_sizeof_serialize[Serialize-Serialized0] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol.py PASSED [ 20%] 536s protocol/tests/test_protocol.py::test_sizeof_serialize[Serialize-Serialized1] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol.py PASSED [ 20%] 536s protocol/tests/test_protocol.py::test_sizeof_serialize[ToPickle-Pickled] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol.py PASSED [ 20%] 536s protocol/tests/test_protocol.py::test_fallback_to_pickle <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol.py PASSED [ 20%] 544s protocol/tests/test_protocol.py::test_large_payload[bytes] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol.py PASSED [ 20%] 550s protocol/tests/test_protocol.py::test_large_payload[str] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol.py PASSED [ 20%] 557s protocol/tests/test_protocol.py::test_large_payload[ext] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol.py PASSED [ 20%] 557s protocol/tests/test_protocol_utils.py::test_pack_frames <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol_utils.py PASSED [ 20%] 557s protocol/tests/test_protocol_utils.py::test_unpack_frames_remainder[456] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol_utils.py PASSED [ 20%] 557s protocol/tests/test_protocol_utils.py::test_unpack_frames_remainder[] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol_utils.py PASSED [ 20%] 557s protocol/tests/test_protocol_utils.py::test_unpack_frames_partial <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol_utils.py PASSED [ 20%] 557s protocol/tests/test_protocol_utils.py::TestMergeMemroyviews::test_empty <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol_utils.py PASSED [ 20%] 557s protocol/tests/test_protocol_utils.py::TestMergeMemroyviews::test_one <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol_utils.py PASSED [ 20%] 557s protocol/tests/test_protocol_utils.py::TestMergeMemroyviews::test_parts[slices0] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol_utils.py PASSED [ 21%] 557s protocol/tests/test_protocol_utils.py::TestMergeMemroyviews::test_parts[slices1] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol_utils.py PASSED [ 21%] 557s protocol/tests/test_protocol_utils.py::TestMergeMemroyviews::test_parts[slices2] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol_utils.py PASSED [ 21%] 557s protocol/tests/test_protocol_utils.py::TestMergeMemroyviews::test_parts[slices3] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol_utils.py PASSED [ 21%] 557s protocol/tests/test_protocol_utils.py::TestMergeMemroyviews::test_parts[slices4] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol_utils.py PASSED [ 21%] 557s protocol/tests/test_protocol_utils.py::TestMergeMemroyviews::test_parts[slices5] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol_utils.py PASSED [ 21%] 557s protocol/tests/test_protocol_utils.py::TestMergeMemroyviews::test_parts[slices6] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol_utils.py PASSED [ 21%] 557s protocol/tests/test_protocol_utils.py::TestMergeMemroyviews::test_parts[slices7] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol_utils.py PASSED [ 21%] 557s protocol/tests/test_protocol_utils.py::TestMergeMemroyviews::test_parts[slices8] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol_utils.py PASSED [ 21%] 557s protocol/tests/test_protocol_utils.py::TestMergeMemroyviews::test_parts[slices9] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol_utils.py PASSED [ 21%] 557s protocol/tests/test_protocol_utils.py::TestMergeMemroyviews::test_readonly_buffer <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol_utils.py PASSED [ 21%] 557s protocol/tests/test_protocol_utils.py::TestMergeMemroyviews::test_catch_non_memoryview <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol_utils.py PASSED [ 21%] 557s protocol/tests/test_protocol_utils.py::TestMergeMemroyviews::test_catch_gaps[slices0] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol_utils.py PASSED [ 21%] 557s protocol/tests/test_protocol_utils.py::TestMergeMemroyviews::test_catch_gaps[slices1] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol_utils.py PASSED [ 21%] 557s protocol/tests/test_protocol_utils.py::TestMergeMemroyviews::test_catch_gaps[slices2] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol_utils.py PASSED [ 21%] 557s protocol/tests/test_protocol_utils.py::TestMergeMemroyviews::test_catch_different_buffer <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol_utils.py PASSED [ 21%] 557s protocol/tests/test_protocol_utils.py::TestMergeMemroyviews::test_catch_different_non_contiguous <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol_utils.py PASSED [ 21%] 557s protocol/tests/test_protocol_utils.py::TestMergeMemroyviews::test_catch_multidimensional <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol_utils.py PASSED [ 21%] 557s protocol/tests/test_protocol_utils.py::TestMergeMemroyviews::test_catch_different_formats <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol_utils.py PASSED [ 21%] 557s protocol/tests/test_scipy.py::test_serialize_scipy_sparse[dtype0-bsr_matrix] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_scipy.py PASSED [ 21%] 557s protocol/tests/test_scipy.py::test_serialize_scipy_sparse[dtype0-coo_matrix] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_scipy.py PASSED [ 21%] 557s protocol/tests/test_scipy.py::test_serialize_scipy_sparse[dtype0-csc_matrix] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_scipy.py PASSED [ 21%] 557s protocol/tests/test_scipy.py::test_serialize_scipy_sparse[dtype0-csr_matrix] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_scipy.py PASSED [ 21%] 557s protocol/tests/test_scipy.py::test_serialize_scipy_sparse[dtype0-dia_matrix] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_scipy.py PASSED [ 21%] 557s protocol/tests/test_scipy.py::test_serialize_scipy_sparse[dtype0-dok_matrix] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_scipy.py PASSED [ 21%] 557s protocol/tests/test_scipy.py::test_serialize_scipy_sparse[dtype0-lil_matrix] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_scipy.py PASSED [ 21%] 557s protocol/tests/test_scipy.py::test_serialize_scipy_sparse[dtype1-bsr_matrix] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_scipy.py PASSED [ 21%] 557s protocol/tests/test_scipy.py::test_serialize_scipy_sparse[dtype1-coo_matrix] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_scipy.py PASSED [ 21%] 557s protocol/tests/test_scipy.py::test_serialize_scipy_sparse[dtype1-csc_matrix] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_scipy.py PASSED [ 21%] 557s protocol/tests/test_scipy.py::test_serialize_scipy_sparse[dtype1-csr_matrix] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_scipy.py PASSED [ 21%] 557s protocol/tests/test_scipy.py::test_serialize_scipy_sparse[dtype1-dia_matrix] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_scipy.py PASSED [ 21%] 557s protocol/tests/test_scipy.py::test_serialize_scipy_sparse[dtype1-dok_matrix] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_scipy.py PASSED [ 21%] 557s protocol/tests/test_scipy.py::test_serialize_scipy_sparse[dtype1-lil_matrix] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_scipy.py PASSED [ 21%] 557s protocol/tests/test_scipy.py::test_serialize_scipy_sparse[dtype2-bsr_matrix] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_scipy.py PASSED [ 21%] 557s protocol/tests/test_scipy.py::test_serialize_scipy_sparse[dtype2-coo_matrix] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_scipy.py PASSED [ 21%] 557s protocol/tests/test_scipy.py::test_serialize_scipy_sparse[dtype2-csc_matrix] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_scipy.py PASSED [ 21%] 557s protocol/tests/test_scipy.py::test_serialize_scipy_sparse[dtype2-csr_matrix] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_scipy.py PASSED [ 22%] 557s protocol/tests/test_scipy.py::test_serialize_scipy_sparse[dtype2-dia_matrix] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_scipy.py PASSED [ 22%] 557s protocol/tests/test_scipy.py::test_serialize_scipy_sparse[dtype2-dok_matrix] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_scipy.py PASSED [ 22%] 557s protocol/tests/test_scipy.py::test_serialize_scipy_sparse[dtype2-lil_matrix] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_scipy.py PASSED [ 22%] 557s protocol/tests/test_scipy.py::test_serialize_scipy_sparse[dtype3-bsr_matrix] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_scipy.py PASSED [ 22%] 557s protocol/tests/test_scipy.py::test_serialize_scipy_sparse[dtype3-coo_matrix] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_scipy.py PASSED [ 22%] 557s protocol/tests/test_scipy.py::test_serialize_scipy_sparse[dtype3-csc_matrix] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_scipy.py PASSED [ 22%] 557s protocol/tests/test_scipy.py::test_serialize_scipy_sparse[dtype3-csr_matrix] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_scipy.py PASSED [ 22%] 557s protocol/tests/test_scipy.py::test_serialize_scipy_sparse[dtype3-dia_matrix] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_scipy.py PASSED [ 22%] 557s protocol/tests/test_scipy.py::test_serialize_scipy_sparse[dtype3-dok_matrix] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_scipy.py PASSED [ 22%] 557s protocol/tests/test_scipy.py::test_serialize_scipy_sparse[dtype3-lil_matrix] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_scipy.py PASSED [ 22%] 557s protocol/tests/test_serialize.py::test_dumps_serialize <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 22%] 557s protocol/tests/test_serialize.py::test_serialize_bytestrings <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 22%] 557s protocol/tests/test_serialize.py::test_serialize_empty_array <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 22%] 557s protocol/tests/test_serialize.py::test_serialize_arrays[b] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 22%] 557s protocol/tests/test_serialize.py::test_serialize_arrays[B] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 22%] 557s protocol/tests/test_serialize.py::test_serialize_arrays[h] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 22%] 557s protocol/tests/test_serialize.py::test_serialize_arrays[H] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 22%] 557s protocol/tests/test_serialize.py::test_serialize_arrays[i] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 22%] 557s protocol/tests/test_serialize.py::test_serialize_arrays[I] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 22%] 557s protocol/tests/test_serialize.py::test_serialize_arrays[l] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 22%] 557s protocol/tests/test_serialize.py::test_serialize_arrays[L] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 22%] 557s protocol/tests/test_serialize.py::test_serialize_arrays[q] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 22%] 557s protocol/tests/test_serialize.py::test_serialize_arrays[Q] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 22%] 557s protocol/tests/test_serialize.py::test_serialize_arrays[f] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 22%] 557s protocol/tests/test_serialize.py::test_serialize_arrays[d] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 22%] 557s protocol/tests/test_serialize.py::test_Serialize <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 22%] 557s protocol/tests/test_serialize.py::test_Serialized <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 22%] 557s protocol/tests/test_serialize.py::test_nested_deserialize <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 22%] 557s protocol/tests/test_serialize.py::test_serialize_iterate_collection <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 22%] 557s protocol/tests/test_serialize.py::test_object_in_graph <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 22%] 557s protocol/tests/test_serialize.py::test_scatter <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 22%] 557s protocol/tests/test_serialize.py::test_inter_worker_comms <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 22%] 557s protocol/tests/test_serialize.py::test_empty <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 22%] 557s protocol/tests/test_serialize.py::test_empty_loads <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 22%] 557s protocol/tests/test_serialize.py::test_empty_loads_deep <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 22%] 558s protocol/tests/test_serialize.py::test_serialize_bytes[kwargs0] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 23%] 560s protocol/tests/test_serialize.py::test_serialize_bytes[kwargs1] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 23%] 560s protocol/tests/test_serialize.py::test_serialize_bytes_numpy[kwargs0] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 23%] 560s protocol/tests/test_serialize.py::test_serialize_bytes_numpy[kwargs1] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 23%] 560s protocol/tests/test_serialize.py::test_deserialize_bytes_zero_copy_read_only <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 23%] 560s protocol/tests/test_serialize.py::test_deserialize_bytes_zero_copy_writeable <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 23%] 560s protocol/tests/test_serialize.py::test_serialize_list_compress <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 23%] 560s protocol/tests/test_serialize.py::test_malicious_exception <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 23%] 560s protocol/tests/test_serialize.py::test_errors <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 23%] 560s protocol/tests/test_serialize.py::test_err_on_bad_deserializer <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 23%] 560s protocol/tests/test_serialize.py::test_context_specific_serialization <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 23%] 561s protocol/tests/test_serialize.py::test_context_specific_serialization_class <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 23%] 561s protocol/tests/test_serialize.py::test_serialize_raises <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 23%] 561s protocol/tests/test_serialize.py::test_different_compression_families <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 23%] 561s protocol/tests/test_serialize.py::test_frame_split <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 23%] 561s protocol/tests/test_serialize.py::test_check_dask_serializable[data0-False] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 23%] 561s protocol/tests/test_serialize.py::test_check_dask_serializable[data1-False] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 23%] 561s protocol/tests/test_serialize.py::test_check_dask_serializable[data2-False] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 23%] 561s protocol/tests/test_serialize.py::test_check_dask_serializable[data3-False] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 23%] 561s protocol/tests/test_serialize.py::test_check_dask_serializable[data4-False] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 23%] 561s protocol/tests/test_serialize.py::test_check_dask_serializable[data5-True] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 23%] 561s protocol/tests/test_serialize.py::test_check_dask_serializable[data6-True] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 23%] 561s protocol/tests/test_serialize.py::test_check_dask_serializable[data7-True] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py XFAIL [ 23%] 561s protocol/tests/test_serialize.py::test_check_dask_serializable[data8-True] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 23%] 561s protocol/tests/test_serialize.py::test_check_dask_serializable[data9-True] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 23%] 561s protocol/tests/test_serialize.py::test_check_dask_serializable[data10-True] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 23%] 561s protocol/tests/test_serialize.py::test_check_dask_serializable[data11-True] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 23%] 561s protocol/tests/test_serialize.py::test_check_dask_serializable[data12-True] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 23%] 561s protocol/tests/test_serialize.py::test_serialize_lists[serializers0] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 23%] 561s protocol/tests/test_serialize.py::test_serialize_lists[serializers1] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 23%] 561s protocol/tests/test_serialize.py::test_serialize_lists[serializers2] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 23%] 561s protocol/tests/test_serialize.py::test_serialize_lists[serializers3] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 23%] 561s protocol/tests/test_serialize.py::test_deser_memoryview[data_in0] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 23%] 561s protocol/tests/test_serialize.py::test_deser_memoryview[data_in1] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 23%] 561s protocol/tests/test_serialize.py::test_ser_memoryview_object <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 23%] 561s protocol/tests/test_serialize.py::test_ser_empty_1d_memoryview <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 23%] 561s protocol/tests/test_serialize.py::test_ser_empty_nd_memoryview <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 24%] 563s protocol/tests/test_serialize.py::test_large_pickled_object <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 24%] 563s protocol/tests/test_serialize.py::test__is_msgpack_serializable <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 24%] 563s protocol/tests/test_to_pickle.py::test_ToPickle <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_to_pickle.py PASSED [ 24%] 563s protocol/tests/test_utils.py::test_host_array <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_utils.py PASSED [ 24%] 563s protocol/tests/test_utils.py::test_host_array_from_buffers <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_utils.py PASSED [ 24%] 563s protocol/tests/test_utils.py::test_host_array_from_buffers_numpy <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_utils.py PASSED [ 24%] 563s protocol/tests/test_utils_test.py::test_get_host_array <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_utils_test.py PASSED [ 24%] 563s shuffle/tests/test_buffer.py::test_memory_limit[big_payloads0] <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_buffer.py PASSED [ 24%] 564s shuffle/tests/test_buffer.py::test_memory_limit[big_payloads1] <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_buffer.py PASSED [ 24%] 564s shuffle/tests/test_buffer.py::test_memory_limit[big_payloads2] <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_buffer.py PASSED [ 24%] 565s shuffle/tests/test_buffer.py::test_memory_limit[big_payloads3] <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_buffer.py PASSED [ 24%] 565s shuffle/tests/test_buffer.py::test_memory_limit_blocked_exception <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_buffer.py PASSED [ 24%] 565s shuffle/tests/test_comm_buffer.py::test_basic <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_comm_buffer.py PASSED [ 24%] 565s shuffle/tests/test_comm_buffer.py::test_exceptions <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_comm_buffer.py PASSED [ 24%] 565s shuffle/tests/test_comm_buffer.py::test_slow_send <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_comm_buffer.py PASSED [ 24%] 565s shuffle/tests/test_comm_buffer.py::test_concurrent_puts <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_comm_buffer.py PASSED [ 24%] 565s shuffle/tests/test_comm_buffer.py::test_concurrent_puts_error <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_comm_buffer.py PASSED [ 24%] 565s shuffle/tests/test_core.py::test_mean_shard_size <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_core.py PASSED [ 24%] 565s shuffle/tests/test_core.py::test_mean_shard_size_numpy <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_core.py PASSED [ 24%] 565s shuffle/tests/test_disk_buffer.py::test_basic <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_disk_buffer.py PASSED [ 24%] 565s shuffle/tests/test_disk_buffer.py::test_read_before_flush <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_disk_buffer.py PASSED [ 24%] 565s shuffle/tests/test_disk_buffer.py::test_many[2] <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_disk_buffer.py PASSED [ 24%] 565s shuffle/tests/test_disk_buffer.py::test_many[100] <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_disk_buffer.py PASSED [ 24%] 565s shuffle/tests/test_disk_buffer.py::test_many[1000] <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_disk_buffer.py PASSED [ 24%] 565s shuffle/tests/test_disk_buffer.py::test_exceptions <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_disk_buffer.py PASSED [ 24%] 566s shuffle/tests/test_disk_buffer.py::test_high_pressure_flush_with_exception <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_disk_buffer.py PASSED [ 24%] 566s shuffle/tests/test_limiter.py::test_limiter_basic <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_limiter.py PASSED [ 24%] 566s shuffle/tests/test_limiter.py::test_unlimited_limiter <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_limiter.py PASSED [ 24%] 566s shuffle/tests/test_limiter.py::test_limiter_concurrent_decrease_releases_waiter <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_limiter.py PASSED [ 24%] 566s shuffle/tests/test_limiter.py::test_limiter_statistics <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_limiter.py PASSED [ 24%] 566s shuffle/tests/test_limiter.py::test_limiter_no_limit_no_statistics <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_limiter.py PASSED [ 24%] 566s shuffle/tests/test_memory_buffer.py::test_basic <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_memory_buffer.py PASSED [ 24%] 566s shuffle/tests/test_memory_buffer.py::test_read_before_flush <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_memory_buffer.py PASSED [ 24%] 566s shuffle/tests/test_memory_buffer.py::test_many[2] <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_memory_buffer.py PASSED [ 24%] 566s shuffle/tests/test_memory_buffer.py::test_many[100] <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_memory_buffer.py PASSED [ 24%] 566s shuffle/tests/test_memory_buffer.py::test_many[1000] <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_memory_buffer.py PASSED [ 24%] 566s shuffle/tests/test_pickle.py::test_pickle <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_pickle.py PASSED [ 25%] 566s shuffle/tests/test_pickle.py::test_pickle_numpy <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_pickle.py PASSED [ 25%] 566s shuffle/tests/test_pickle.py::test_pickle_zero_copy <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_pickle.py PASSED [ 25%] 566s shuffle/tests/test_read_write_lock.py::test_basic <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_read_write_lock.py PASSED [ 25%] 566s shuffle/tests/test_read_write_lock.py::test_lock_timeout <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_read_write_lock.py PASSED [ 25%] 566s shuffle/tests/test_read_write_lock.py::test_concurrent_reads_are_allowed <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_read_write_lock.py PASSED [ 25%] 567s shuffle/tests/test_read_write_lock.py::test_read_blocks_write <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_read_write_lock.py PASSED [ 25%] 567s shuffle/tests/test_read_write_lock.py::test_write_blocks_read <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_read_write_lock.py PASSED [ 25%] 567s shuffle/tests/test_read_write_lock.py::test_write_blocks_write <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_read_write_lock.py PASSED [ 25%] 567s shuffle/tests/test_read_write_lock.py::test_write_preferred_over_read <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_read_write_lock.py PASSED [ 25%] 567s shuffle/tests/test_rechunk.py::test_lowlevel_rechunk[True-True-1] <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 25%] 567s shuffle/tests/test_rechunk.py::test_lowlevel_rechunk[True-True-10] <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 25%] 567s shuffle/tests/test_rechunk.py::test_lowlevel_rechunk[True-False-1] <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 25%] 567s shuffle/tests/test_rechunk.py::test_lowlevel_rechunk[True-False-10] <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 25%] 567s shuffle/tests/test_rechunk.py::test_lowlevel_rechunk[False-True-1] <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 25%] 567s shuffle/tests/test_rechunk.py::test_lowlevel_rechunk[False-True-10] <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 25%] 567s shuffle/tests/test_rechunk.py::test_lowlevel_rechunk[False-False-1] <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 25%] 567s shuffle/tests/test_rechunk.py::test_lowlevel_rechunk[False-False-10] <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 25%] 567s shuffle/tests/test_rechunk.py::test_rechunk_configuration[tasks-tasks] <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 25%] 568s shuffle/tests/test_rechunk.py::test_rechunk_configuration[tasks-p2p] <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 25%] 568s shuffle/tests/test_rechunk.py::test_rechunk_configuration[tasks-None] <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 25%] 568s shuffle/tests/test_rechunk.py::test_rechunk_configuration[p2p-tasks] <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 25%] 568s shuffle/tests/test_rechunk.py::test_rechunk_configuration[p2p-p2p] <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 25%] 568s shuffle/tests/test_rechunk.py::test_rechunk_configuration[p2p-None] <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 25%] 568s shuffle/tests/test_rechunk.py::test_rechunk_configuration[None-tasks] <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 25%] 569s shuffle/tests/test_rechunk.py::test_rechunk_configuration[None-p2p] <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 25%] 569s shuffle/tests/test_rechunk.py::test_rechunk_configuration[None-None] <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 25%] 570s shuffle/tests/test_rechunk.py::test_rechunk_heuristic[new0-p2p] <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 25%] 570s shuffle/tests/test_rechunk.py::test_rechunk_heuristic[new1-tasks] <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 25%] 571s shuffle/tests/test_rechunk.py::test_rechunk_heuristic[new2-tasks] <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 25%] 573s shuffle/tests/test_rechunk.py::test_rechunk_heuristic[new3-p2p] <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 25%] 573s shuffle/tests/test_rechunk.py::test_cull_p2p_rechunk_independent_partitions <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 25%] 573s shuffle/tests/test_rechunk.py::test_cull_p2p_rechunking_single_chunk <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 25%] 573s shuffle/tests/test_rechunk.py::test_cull_p2p_rechunk_overlapping_partitions <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 25%] 573s shuffle/tests/test_rechunk.py::test_rechunk_2d[True] <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 25%] 573s shuffle/tests/test_rechunk.py::test_rechunk_2d[False] <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 25%] 574s shuffle/tests/test_rechunk.py::test_rechunk_4d[True] <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 26%] 574s shuffle/tests/test_rechunk.py::test_rechunk_4d[False] <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 26%] 574s shuffle/tests/test_rechunk.py::test_rechunk_expand <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 26%] 574s shuffle/tests/test_rechunk.py::test_rechunk_expand2 <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 26%] 578s shuffle/tests/test_rechunk.py::test_rechunk_method <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 26%] 578s shuffle/tests/test_rechunk.py::test_rechunk_blockshape <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 26%] 578s shuffle/tests/test_rechunk.py::test_dtype <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 26%] 578s shuffle/tests/test_rechunk.py::test_rechunk_with_dict <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 26%] 578s shuffle/tests/test_rechunk.py::test_rechunk_with_empty_input <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 26%] 578s shuffle/tests/test_rechunk.py::test_rechunk_with_null_dimensions <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 26%] 578s shuffle/tests/test_rechunk.py::test_rechunk_with_integer <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 26%] 578s shuffle/tests/test_rechunk.py::test_rechunk_0d <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 26%] 578s shuffle/tests/test_rechunk.py::test_rechunk_empty_array[arr0] <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 26%] 578s shuffle/tests/test_rechunk.py::test_rechunk_empty_array[arr1] <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 26%] 578s shuffle/tests/test_rechunk.py::test_rechunk_empty_array[arr2] <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 26%] 578s shuffle/tests/test_rechunk.py::test_rechunk_empty <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 26%] 578s shuffle/tests/test_rechunk.py::test_rechunk_zero_dim_array <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 26%] 579s shuffle/tests/test_rechunk.py::test_rechunk_zero_dim_array_II <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 26%] 579s shuffle/tests/test_rechunk.py::test_rechunk_same <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 26%] 579s shuffle/tests/test_rechunk.py::test_rechunk_same_fully_unknown <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 26%] 579s shuffle/tests/test_rechunk.py::test_rechunk_same_fully_unknown_floats <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 26%] 579s shuffle/tests/test_rechunk.py::test_rechunk_same_partially_unknown <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 26%] 579s shuffle/tests/test_rechunk.py::test_rechunk_with_zero_placeholders <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 26%] 579s shuffle/tests/test_rechunk.py::test_rechunk_minus_one <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 26%] 579s shuffle/tests/test_rechunk.py::test_rechunk_warning <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 26%] 579s shuffle/tests/test_rechunk.py::test_rechunk_unknown_from_pandas <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 26%] 579s shuffle/tests/test_rechunk.py::test_rechunk_unknown_from_array <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 26%] 580s shuffle/tests/test_rechunk.py::test_rechunk_with_fully_unknown_dimension[x0-chunks0] <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 26%] 580s shuffle/tests/test_rechunk.py::test_rechunk_with_fully_unknown_dimension[x1-chunks1] <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 26%] 580s shuffle/tests/test_rechunk.py::test_rechunk_with_fully_unknown_dimension[x2-chunks2] <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 26%] 581s shuffle/tests/test_rechunk.py::test_rechunk_with_fully_unknown_dimension[x3-chunks3] <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 26%] 582s shuffle/tests/test_rechunk.py::test_rechunk_with_fully_unknown_dimension[x4-chunks4] <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 26%] 584s shuffle/tests/test_rechunk.py::test_rechunk_with_fully_unknown_dimension[x5-chunks5] <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 26%] 584s shuffle/tests/test_rechunk.py::test_rechunk_with_fully_unknown_dimension[x6-chunks6] <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 26%] 584s shuffle/tests/test_rechunk.py::test_rechunk_with_fully_unknown_dimension[x7-chunks7] <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 26%] 584s shuffle/tests/test_rechunk.py::test_rechunk_with_fully_unknown_dimension[x8-chunks8] <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 26%] 584s shuffle/tests/test_rechunk.py::test_rechunk_with_fully_unknown_dimension[x9-chunks9] <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 27%] 584s shuffle/tests/test_rechunk.py::test_rechunk_with_fully_unknown_dimension[x10-chunks10] <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 27%] 585s shuffle/tests/test_rechunk.py::test_rechunk_with_fully_unknown_dimension[x11-chunks11] <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 27%] 585s shuffle/tests/test_rechunk.py::test_rechunk_with_partially_unknown_dimension[x0-chunks0] <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 27%] 585s shuffle/tests/test_rechunk.py::test_rechunk_with_partially_unknown_dimension[x1-chunks1] <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 27%] 585s shuffle/tests/test_rechunk.py::test_rechunk_with_partially_unknown_dimension[x2-chunks2] <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 27%] 588s shuffle/tests/test_rechunk.py::test_rechunk_with_partially_unknown_dimension[x3-chunks3] <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 27%] 590s shuffle/tests/test_rechunk.py::test_rechunk_with_partially_unknown_dimension[x4-chunks4] <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 27%] 592s shuffle/tests/test_rechunk.py::test_rechunk_with_partially_unknown_dimension[x5-chunks5] <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 27%] 593s shuffle/tests/test_rechunk.py::test_rechunk_with_partially_unknown_dimension[x6-chunks6] <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 27%] 593s shuffle/tests/test_rechunk.py::test_rechunk_with_partially_unknown_dimension[x7-chunks7] <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 27%] 593s shuffle/tests/test_rechunk.py::test_rechunk_with_partially_unknown_dimension[x8-chunks8] <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 27%] 593s shuffle/tests/test_rechunk.py::test_rechunk_with_partially_unknown_dimension[x9-chunks9] <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 27%] 593s shuffle/tests/test_rechunk.py::test_rechunk_with_partially_unknown_dimension[x10-chunks10] <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 27%] 594s shuffle/tests/test_rechunk.py::test_rechunk_with_partially_unknown_dimension[x11-chunks11] <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 27%] 594s shuffle/tests/test_rechunk.py::test_rechunk_with_fully_unknown_dimension_explicit[new_chunks0] <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 27%] 594s shuffle/tests/test_rechunk.py::test_rechunk_with_fully_unknown_dimension_explicit[new_chunks1] <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 27%] 595s shuffle/tests/test_rechunk.py::test_rechunk_with_fully_unknown_dimension_explicit[new_chunks2] <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 27%] 595s shuffle/tests/test_rechunk.py::test_rechunk_unknown_raises <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 27%] 595s shuffle/tests/test_rechunk.py::test_rechunk_zero_dim <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 27%] 595s shuffle/tests/test_rechunk.py::test_rechunk_empty_chunks <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 27%] 595s shuffle/tests/test_rechunk.py::test_rechunk_avoid_needless_chunking <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 27%] 595s shuffle/tests/test_rechunk.py::test_rechunk_auto_1d[100-1-10-expected0] <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 27%] 595s shuffle/tests/test_rechunk.py::test_rechunk_auto_1d[100-50-10-expected1] <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 27%] 595s shuffle/tests/test_rechunk.py::test_rechunk_auto_1d[100-100-10-expected2] <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 27%] 595s shuffle/tests/test_rechunk.py::test_rechunk_auto_1d[20-7-10-expected3] <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 27%] 595s shuffle/tests/test_rechunk.py::test_rechunk_auto_1d[20-chunks4-5-expected4] <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 27%] 595s shuffle/tests/test_rechunk.py::test_rechunk_auto_2d <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 27%] 595s shuffle/tests/test_rechunk.py::test_rechunk_auto_3d <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 27%] 596s shuffle/tests/test_rechunk.py::test_rechunk_auto_image_stack[100] <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 27%] 596s shuffle/tests/test_rechunk.py::test_rechunk_auto_image_stack[1000] <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 27%] 596s shuffle/tests/test_rechunk.py::test_rechunk_down <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 27%] 596s shuffle/tests/test_rechunk.py::test_rechunk_zero <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 27%] 596s shuffle/tests/test_rechunk.py::test_rechunk_bad_keys <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 27%] 596s shuffle/tests/test_rechunk.py::test_rechunk_with_zero <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 27%] 596s shuffle/tests/test_rechunk.py::test_split_axes_1 <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 27%] 596s shuffle/tests/test_rechunk.py::test_split_axes_2 <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 28%] 596s shuffle/tests/test_rechunk.py::test_split_axes_nan <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 28%] 596s shuffle/tests/test_rechunk.py::test_split_axes_nan_single <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 28%] 596s shuffle/tests/test_rechunk.py::test_split_axes_nan_long <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 28%] 596s shuffle/tests/test_rechunk.py::test_split_axes_with_nonzero <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 28%] 596s shuffle/tests/test_rechunk.py::test_split_axes_with_zero <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 28%] 596s shuffle/tests/test_rechunk.py::test_preserve_writeable_flag <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 28%] 596s shuffle/tests/test_rechunk.py::test_rechunk_in_memory_shards_dont_share_buffer <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 28%] 596s shuffle/tests/test_rechunk.py::test_pick_worker_homogeneous_distribution[1] <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 28%] 596s shuffle/tests/test_rechunk.py::test_pick_worker_homogeneous_distribution[2] <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 28%] 596s shuffle/tests/test_rechunk.py::test_pick_worker_homogeneous_distribution[41] <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 28%] 596s shuffle/tests/test_rechunk.py::test_pick_worker_homogeneous_distribution[50] <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 28%] 597s shuffle/tests/test_rechunk.py::test_partial_rechunk_homogeneous_distribution <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 28%] 597s shuffle/tests/test_rechunk.py::test_partial_rechunk_taskgroups <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 28%] 597s shuffle/tests/test_rechunk.py::test_calculate_prechunking_1d[old0-new0-expected0] <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 28%] 597s shuffle/tests/test_rechunk.py::test_calculate_prechunking_1d[old1-new1-expected1] <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 28%] 597s shuffle/tests/test_rechunk.py::test_calculate_prechunking_1d[old2-new2-expected2] <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 28%] 597s shuffle/tests/test_rechunk.py::test_calculate_prechunking_1d[old3-new3-expected3] <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 28%] 597s shuffle/tests/test_rechunk.py::test_calculate_prechunking_1d[old4-new4-expected4] <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 28%] 597s shuffle/tests/test_rechunk.py::test_calculate_prechunking_2d[old0-new0-expected0] <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 28%] 597s shuffle/tests/test_rechunk.py::test_calculate_prechunking_2d[old1-new1-expected1] <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 28%] 597s shuffle/tests/test_rechunk.py::test_calculate_prechunking_2d[old2-new2-expected2] <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 28%] 597s shuffle/tests/test_rechunk.py::test_calculate_prechunking_2d[old3-new3-expected3] <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 28%] 597s shuffle/tests/test_rechunk.py::test_calculate_prechunking_2d[old4-new4-expected4] <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 28%] 597s shuffle/tests/test_rechunk.py::test_calculate_prechunking_2d[old5-new5-expected5] <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 28%] 597s shuffle/tests/test_rechunk.py::test_calculate_prechunking_3d[old0-new0-expected0] <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 28%] 597s shuffle/tests/test_rechunk.py::test_calculate_prechunking_3d[old1-new1-expected1] <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 28%] 597s shuffle/tests/test_rechunk.py::test_calculate_prechunking_3d[old2-new2-expected2] <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 28%] 597s shuffle/tests/test_rechunk.py::test_calculate_prechunking_3d[old3-new3-expected3] <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 28%] 597s shuffle/tests/test_rechunk.py::test_calculate_prechunking_concatenation[1 B-expected0] <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 28%] 597s shuffle/tests/test_rechunk.py::test_calculate_prechunking_concatenation[20 B-expected1] <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 28%] 597s shuffle/tests/test_rechunk.py::test_calculate_prechunking_concatenation[40 B-expected2] <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 28%] 597s shuffle/tests/test_rechunk.py::test_calculate_prechunking_concatenation[100 B-expected3] <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 28%] 597s shuffle/tests/test_rechunk.py::test_calculate_prechunking_does_not_concatenate_object_type <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 28%] 597s shuffle/tests/test_rechunk.py::test_calculate_prechunking_splitting[old0-new0-expected0] <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 28%] 597s shuffle/tests/test_rechunk.py::test_calculate_prechunking_splitting[old1-new1-expected1] <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 28%] 597s shuffle/tests/test_rechunk.py::test_calculate_prechunking_splitting[old2-new2-expected2] <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 28%] 601s shuffle/tests/test_rechunk.py::test_homogeneously_schedule_unpack <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 29%] 601s shuffle/tests/test_rechunk.py::test_rechunk_datetime[tasks] <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 29%] 601s shuffle/tests/test_rechunk.py::test_rechunk_datetime[p2p] <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 29%] 601s shuffle/tests/test_shuffle_plugins.py::test_installation_on_worker <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_shuffle_plugins.py PASSED [ 29%] 601s shuffle/tests/test_shuffle_plugins.py::test_installation_on_scheduler <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_shuffle_plugins.py PASSED [ 29%] 601s tests/test_active_memory_manager.py::test_no_policies <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 29%] 602s tests/test_active_memory_manager.py::test_drop <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 29%] 602s tests/test_active_memory_manager.py::test_start_stop <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 29%] 603s tests/test_active_memory_manager.py::test_auto_start <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 29%] 603s tests/test_active_memory_manager.py::test_add_policy <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 29%] 603s tests/test_active_memory_manager.py::test_multi_start <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 29%] 603s tests/test_active_memory_manager.py::test_not_registered <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 29%] 605s tests/test_active_memory_manager.py::test_client_proxy_sync <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 29%] 605s tests/test_active_memory_manager.py::test_client_proxy_async <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 29%] 605s tests/test_active_memory_manager.py::test_drop_not_in_memory <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 29%] 606s tests/test_active_memory_manager.py::test_drop_with_waiter <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 29%] 606s tests/test_active_memory_manager.py::test_double_drop <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 29%] 606s tests/test_active_memory_manager.py::test_double_drop_stress <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 29%] 606s tests/test_active_memory_manager.py::test_drop_from_worker_with_least_free_memory <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 29%] 607s tests/test_active_memory_manager.py::test_drop_with_candidates <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 29%] 607s tests/test_active_memory_manager.py::test_drop_with_empty_candidates <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 29%] 607s tests/test_active_memory_manager.py::test_drop_from_candidates_without_key <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 29%] 608s tests/test_active_memory_manager.py::test_drop_with_bad_candidates <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 29%] 608s tests/test_active_memory_manager.py::test_drop_prefers_paused_workers <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 29%] 608s tests/test_active_memory_manager.py::test_drop_with_paused_workers_with_running_tasks_1 <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 29%] 608s tests/test_active_memory_manager.py::test_drop_with_paused_workers_with_running_tasks_2 <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 29%] 608s tests/test_active_memory_manager.py::test_drop_with_paused_workers_with_running_tasks_3_4[True] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 29%] 608s tests/test_active_memory_manager.py::test_drop_with_paused_workers_with_running_tasks_3_4[False] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 29%] 608s tests/test_active_memory_manager.py::test_drop_with_paused_workers_with_running_tasks_5 <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 29%] 609s tests/test_active_memory_manager.py::test_replicate <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 29%] 609s tests/test_active_memory_manager.py::test_replicate_not_in_memory <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 29%] 609s tests/test_active_memory_manager.py::test_double_replicate_stress <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 29%] 609s tests/test_active_memory_manager.py::test_replicate_to_worker_with_most_free_memory <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 29%] 609s tests/test_active_memory_manager.py::test_replicate_with_candidates <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 29%] 609s tests/test_active_memory_manager.py::test_replicate_with_empty_candidates <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 29%] 610s tests/test_active_memory_manager.py::test_replicate_to_candidates_with_key <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 29%] 610s tests/test_active_memory_manager.py::test_replicate_avoids_paused_workers_1 <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 30%] 610s tests/test_active_memory_manager.py::test_replicate_avoids_paused_workers_2 <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 30%] 610s tests/test_active_memory_manager.py::test_bad_measure <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 30%] 610s tests/test_active_memory_manager.py::test_ReduceReplicas <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 30%] 611s tests/test_active_memory_manager.py::test_ReduceReplicas_with_waiters[0-0-0-1] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 30%] 611s tests/test_active_memory_manager.py::test_ReduceReplicas_with_waiters[1-0-0-1] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 30%] 611s tests/test_active_memory_manager.py::test_ReduceReplicas_with_waiters[0-0-1-1] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 30%] 612s tests/test_active_memory_manager.py::test_ReduceReplicas_with_waiters[2-0-0-1] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 30%] 612s tests/test_active_memory_manager.py::test_ReduceReplicas_with_waiters[1-1-0-2] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 30%] 612s tests/test_active_memory_manager.py::test_ReduceReplicas_with_waiters[1-1-1-3] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 30%] 613s tests/test_active_memory_manager.py::test_ReduceReplicas_with_waiters[1-1-2-4] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 30%] 613s tests/test_active_memory_manager.py::test_ReduceReplicas_with_waiters[2-1-1-3] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 30%] 613s tests/test_active_memory_manager.py::test_ReduceReplicas_with_waiters[1-1-17-4] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 30%] 614s tests/test_active_memory_manager.py::test_ReduceReplicas_with_waiters[17-1-1-3] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 30%] 614s tests/test_active_memory_manager.py::test_ReduceReplicas_with_waiters[18-1-1-4] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 30%] 614s tests/test_active_memory_manager.py::test_RetireWorker_amm_on_off[False] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 30%] 614s tests/test_active_memory_manager.py::test_RetireWorker_amm_on_off[True] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 30%] 614s tests/test_active_memory_manager.py::test_RetireWorker_no_extension <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 30%] 614s tests/test_active_memory_manager.py::test_RetireWorker_no_remove <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 30%] 615s tests/test_active_memory_manager.py::test_RetireWorker_with_ReduceReplicas[False] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 30%] 615s tests/test_active_memory_manager.py::test_RetireWorker_with_ReduceReplicas[True] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 30%] 615s tests/test_active_memory_manager.py::test_RetireWorker_all_replicas_are_being_retired <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 30%] 615s tests/test_active_memory_manager.py::test_RetireWorker_no_recipients <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 30%] 615s tests/test_active_memory_manager.py::test_RetireWorker_all_recipients_are_paused <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 30%] 616s tests/test_active_memory_manager.py::test_RetireWorker_new_keys_arrive_after_all_keys_moved_away <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 30%] 616s tests/test_active_memory_manager.py::test_RetireWorker_faulty_recipient <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 30%] 616s tests/test_active_memory_manager.py::test_RetireWorker_mass <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 30%] 616s tests/test_active_memory_manager.py::test_RetireWorker_incremental <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 30%] 617s tests/test_active_memory_manager.py::test_dont_drop_actors <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 30%] 617s tests/test_active_memory_manager.py::test_dont_replicate_actors <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 30%] 617s tests/test_active_memory_manager.py::test_RetireWorker_with_actor[False] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 30%] 617s tests/test_active_memory_manager.py::test_RetireWorker_with_actor[True] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 30%] 617s tests/test_active_memory_manager.py::test_RetireWorker_with_actor_proxy <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 30%] 622s tests/test_active_memory_manager.py::test_noamm_stress <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 30%] 627s tests/test_active_memory_manager.py::test_drop_stress <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 30%] 632s tests/test_active_memory_manager.py::test_ReduceReplicas_stress <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 30%] 637s tests/test_active_memory_manager.py::test_RetireWorker_stress[False] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 31%] 641s tests/test_active_memory_manager.py::test_RetireWorker_stress[True] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 31%] 641s tests/test_actor.py::test_client_actions[True] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 31%] 642s tests/test_actor.py::test_client_actions[False] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 31%] 642s tests/test_actor.py::test_worker_actions[False] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 31%] 642s tests/test_actor.py::test_worker_actions[True] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 31%] 642s tests/test_actor.py::test_Actor <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 31%] 642s tests/test_actor.py::test_linear_access <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py XFAILges rather than rpc) [ 31%] 643s tests/test_actor.py::test_exceptions_create <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 31%] 643s tests/test_actor.py::test_exceptions_method <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 31%] 643s tests/test_actor.py::test_gc <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 31%] 643s tests/test_actor.py::test_track_dependencies <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 31%] 643s tests/test_actor.py::test_future <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 31%] 644s tests/test_actor.py::test_future_dependencies <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 31%] 645s tests/test_actor.py::test_sync <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 31%] 647s tests/test_actor.py::test_timeout <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 31%] 647s tests/test_actor.py::test_failed_worker <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 31%] 647s tests/test_actor.py::test_numpy_roundtrip <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 31%] 647s tests/test_actor.py::test_numpy_roundtrip_getattr <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 31%] 647s tests/test_actor.py::test_repr <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 31%] 647s tests/test_actor.py::test_dir <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 31%] 647s tests/test_actor.py::test_many_computations <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 31%] 648s tests/test_actor.py::test_thread_safety <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 31%] 648s tests/test_actor.py::test_Actors_create_dependencies <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 31%] 648s tests/test_actor.py::test_load_balance <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 31%] 648s tests/test_actor.py::test_load_balance_map <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 31%] 648s tests/test_actor.py::test_compute <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 31%] 650s tests/test_actor.py::test_compute_sync <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 31%] 650s tests/test_actor.py::test_actors_in_profile <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 31%] 650s tests/test_actor.py::test_waiter <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 31%] 650s tests/test_actor.py::test_worker_actor_handle_is_weakref <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 31%] 652s tests/test_actor.py::test_worker_actor_handle_is_weakref_sync <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 31%] 654s tests/test_actor.py::test_worker_actor_handle_is_weakref_from_compute_sync <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 31%] 655s tests/test_actor.py::test_one_thread_deadlock <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 31%] 657s tests/test_actor.py::test_one_thread_deadlock_timeout <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 31%] 659s tests/test_actor.py::test_one_thread_deadlock_sync_client <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 31%] 659s tests/test_actor.py::test_async_deadlock <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 32%] 660s tests/test_actor.py::test_exception <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 32%] 660s tests/test_actor.py::test_exception_async <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 32%] 662s tests/test_actor.py::test_as_completed <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 32%] 662s tests/test_actor.py::test_actor_future_awaitable <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 32%] 662s tests/test_actor.py::test_actor_future_awaitable_deadlock <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 32%] 662s tests/test_actor.py::test_serialize_with_pickle <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 32%] 662s tests/test_actor.py::test_worker_client_async <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 32%] 663s tests/test_actor.py::test_worker_client_separate_thread <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 32%] 663s tests/test_actor.py::test_get_worker <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 32%] 663s tests/test_as_completed.py::test_as_completed_async <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_as_completed.py PASSED [ 32%] 664s tests/test_as_completed.py::test_as_completed_timeout_async <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_as_completed.py PASSED [ 32%] 666s tests/test_as_completed.py::test_as_completed_timeout_sync <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_as_completed.py PASSED [ 32%] 668s tests/test_as_completed.py::test_as_completed_sync <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_as_completed.py PASSED [ 32%] 669s tests/test_as_completed.py::test_as_completed_with_non_futures <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_as_completed.py PASSED [ 32%] 671s tests/test_as_completed.py::test_as_completed_add <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_as_completed.py PASSED [ 32%] 672s tests/test_as_completed.py::test_as_completed_update <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_as_completed.py PASSED [ 32%] 674s tests/test_as_completed.py::test_as_completed_repeats <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_as_completed.py PASSED [ 32%] 676s tests/test_as_completed.py::test_as_completed_is_empty <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_as_completed.py PASSED [ 32%] 676s tests/test_as_completed.py::test_as_completed_cancel <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_as_completed.py PASSED [ 32%] 678s tests/test_as_completed.py::test_as_completed_cancel_last <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_as_completed.py PASSED [ 32%] 678s tests/test_as_completed.py::test_async_for_py2_equivalent <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_as_completed.py PASSED [ 32%] 678s tests/test_as_completed.py::test_as_completed_error_async <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_as_completed.py PASSED [ 32%] 679s tests/test_as_completed.py::test_as_completed_error <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_as_completed.py PASSED [ 32%] 681s tests/test_as_completed.py::test_as_completed_with_results <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_as_completed.py PASSED [ 32%] 681s tests/test_as_completed.py::test_as_completed_with_results_async <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_as_completed.py PASSED [ 32%] 683s tests/test_as_completed.py::test_as_completed_with_results_no_raise <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_as_completed.py PASSED [ 32%] 683s tests/test_as_completed.py::test_str <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_as_completed.py PASSED [ 32%] 683s tests/test_as_completed.py::test_as_completed_with_results_no_raise_async <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_as_completed.py PASSED [ 32%] 684s tests/test_as_completed.py::test_clear <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_as_completed.py PASSED [ 32%] 684s tests/test_async_task_group.py::test_async_task_group_initialization <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_async_task_group.py PASSED [ 32%] 684s tests/test_async_task_group.py::test_async_task_group_call_soon_executes_task_in_background <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_async_task_group.py PASSED [ 32%] 685s tests/test_async_task_group.py::test_async_task_group_call_later_executes_delayed_task_in_background <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_async_task_group.py PASSED [ 32%] 685s tests/test_async_task_group.py::test_async_task_group_close_closes <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_async_task_group.py PASSED [ 32%] 685s tests/test_async_task_group.py::test_async_task_group_close_does_not_cancel_existing_tasks <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_async_task_group.py PASSED [ 32%] 685s tests/test_async_task_group.py::test_async_task_group_close_prohibits_new_tasks <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_async_task_group.py PASSED [ 32%] 685s tests/test_async_task_group.py::test_async_task_group_stop_disallows_shutdown <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_async_task_group.py PASSED [ 32%] 685s tests/test_async_task_group.py::test_async_task_group_stop_cancels_long_running <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_async_task_group.py PASSED [ 33%] 685s tests/test_asyncio.py::test_rlock <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_asyncio.py PASSED [ 33%] 685s tests/test_asyncio.py::test_rlock_nonreentrant <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_asyncio.py PASSED [ 33%] 685s tests/test_asyncio.py::test_rlock_none <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_asyncio.py PASSED [ 33%] 685s tests/test_asyncio.py::test_rlock_release_on_raise <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_asyncio.py PASSED [ 33%] 687s tests/test_asyncprocess.py::test_simple <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_asyncprocess.py PASSED [ 33%] 688s tests/test_asyncprocess.py::test_exitcode <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_asyncprocess.py PASSED [ 33%] 689s tests/test_asyncprocess.py::test_sigint_from_same_process <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_asyncprocess.py PASSED [ 33%] 689s tests/test_asyncprocess.py::test_sigterm_from_parent_process <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_asyncprocess.py PASSED [ 33%] 689s tests/test_asyncprocess.py::test_terminate <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_asyncprocess.py PASSED [ 33%] 690s tests/test_asyncprocess.py::test_close <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_asyncprocess.py PASSED [ 33%] 692s tests/test_asyncprocess.py::test_exit_callback <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_asyncprocess.py PASSED [ 33%] 693s tests/test_asyncprocess.py::test_child_main_thread <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_asyncprocess.py PASSED [ 33%] 695s tests/test_asyncprocess.py::test_num_fds <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_asyncprocess.py PASSED [ 33%] 695s tests/test_asyncprocess.py::test_terminate_after_stop <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_asyncprocess.py PASSED [ 33%] 696s tests/test_asyncprocess.py::test_kill <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_asyncprocess.py PASSED [ 33%] 698s tests/test_asyncprocess.py::test_asyncprocess_child_teardown_on_parent_exit <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_asyncprocess.py PASSED [ 33%] 698s tests/test_batched.py::test_BatchedSend <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_batched.py PASSED [ 33%] 698s tests/test_batched.py::test_send_before_start <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_batched.py PASSED [ 33%] 698s tests/test_batched.py::test_send_after_stream_start <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_batched.py PASSED [ 33%] 698s tests/test_batched.py::test_send_before_close <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_batched.py PASSED [ 33%] 698s tests/test_batched.py::test_close_closed <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_batched.py PASSED [ 33%] 698s tests/test_batched.py::test_close_not_started <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_batched.py PASSED [ 33%] 698s tests/test_batched.py::test_close_twice <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_batched.py PASSED [ 33%] 702s tests/test_batched.py::test_stress <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_batched.py PASSED [ 33%] 702s tests/test_batched.py::test_sending_traffic_jam <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_batched.py PASSED [ 33%] 704s tests/test_batched.py::test_large_traffic_jam <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_batched.py PASSED [ 33%] 704s tests/test_batched.py::test_serializers <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_batched.py PASSED [ 33%] 704s tests/test_cancelled_state.py::test_abort_execution_release <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 33%] 704s tests/test_cancelled_state.py::test_abort_execution_reschedule <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 33%] 704s tests/test_cancelled_state.py::test_abort_execution_add_as_dependency <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 33%] 704s tests/test_cancelled_state.py::test_abort_execution_to_fetch <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 33%] 704s tests/test_cancelled_state.py::test_worker_stream_died_during_comm <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 33%] 704s tests/test_cancelled_state.py::test_flight_to_executing_via_cancelled_resumed <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 33%] 705s tests/test_cancelled_state.py::test_executing_cancelled_error <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 33%] 705s tests/test_cancelled_state.py::test_flight_cancelled_error <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 33%] 705s tests/test_cancelled_state.py::test_in_flight_lost_after_resumed <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 34%] 705s tests/test_cancelled_state.py::test_cancelled_error <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 34%] 705s tests/test_cancelled_state.py::test_cancelled_error_with_resources <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 34%] 705s tests/test_cancelled_state.py::test_cancelled_resumed_after_flight_with_dependencies <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 34%] 705s tests/test_cancelled_state.py::test_cancelled_resumed_after_flight_with_dependencies_workerstate <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 34%] 705s tests/test_cancelled_state.py::test_resumed_cancelled_handle_compute[True-True] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 34%] 706s tests/test_cancelled_state.py::test_resumed_cancelled_handle_compute[True-False] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 34%] 706s tests/test_cancelled_state.py::test_resumed_cancelled_handle_compute[False-True] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 34%] 706s tests/test_cancelled_state.py::test_resumed_cancelled_handle_compute[False-False] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 34%] 706s tests/test_cancelled_state.py::test_cancelled_handle_compute[True] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 34%] 706s tests/test_cancelled_state.py::test_cancelled_handle_compute[False] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 34%] 707s tests/test_cancelled_state.py::test_cancelled_task_error_rejected <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 34%] 707s tests/test_cancelled_state.py::test_deadlock_cancelled_after_inflight_before_gather_from_worker[True-resumed] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 34%] 708s tests/test_cancelled_state.py::test_deadlock_cancelled_after_inflight_before_gather_from_worker[True-cancelled] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 34%] 708s tests/test_cancelled_state.py::test_workerstate_executing_to_executing[executing] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 34%] 708s tests/test_cancelled_state.py::test_workerstate_executing_to_executing[long-running] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 34%] 708s tests/test_cancelled_state.py::test_workerstate_flight_to_flight <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 34%] 708s tests/test_cancelled_state.py::test_workerstate_executing_skips_fetch_on_success[executing] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 34%] 708s tests/test_cancelled_state.py::test_workerstate_executing_skips_fetch_on_success[long-running] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 34%] 708s tests/test_cancelled_state.py::test_workerstate_executing_failure_to_fetch[executing] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 34%] 708s tests/test_cancelled_state.py::test_workerstate_executing_failure_to_fetch[long-running] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 34%] 708s tests/test_cancelled_state.py::test_workerstate_flight_skips_executing_on_success <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 34%] 708s tests/test_cancelled_state.py::test_workerstate_flight_failure_to_executing[False] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 34%] 708s tests/test_cancelled_state.py::test_workerstate_flight_failure_to_executing[True] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 34%] 708s tests/test_cancelled_state.py::test_workerstate_resumed_fetch_to_cancelled_to_executing[executing] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 34%] 708s tests/test_cancelled_state.py::test_workerstate_resumed_fetch_to_cancelled_to_executing[long-running] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 34%] 708s tests/test_cancelled_state.py::test_workerstate_resumed_fetch_to_executing[executing] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 34%] 708s tests/test_cancelled_state.py::test_workerstate_resumed_fetch_to_executing[long-running] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 34%] 708s tests/test_cancelled_state.py::test_workerstate_resumed_waiting_to_flight <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 34%] 708s tests/test_cancelled_state.py::test_execute_preamble_early_cancel[executing-False] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 34%] 708s tests/test_cancelled_state.py::test_execute_preamble_early_cancel[executing-True] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 34%] 708s tests/test_cancelled_state.py::test_execute_preamble_early_cancel[resumed-False] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 34%] 708s tests/test_cancelled_state.py::test_execute_preamble_early_cancel[resumed-True] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 34%] 708s tests/test_cancelled_state.py::test_cancel_with_dependencies_in_memory[ExecuteSuccessEvent-False] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 34%] 708s tests/test_cancelled_state.py::test_cancel_with_dependencies_in_memory[ExecuteSuccessEvent-True] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 34%] 708s tests/test_cancelled_state.py::test_cancel_with_dependencies_in_memory[ExecuteFailureEvent-False] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 34%] 708s tests/test_cancelled_state.py::test_cancel_with_dependencies_in_memory[ExecuteFailureEvent-True] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 35%] 708s tests/test_cancelled_state.py::test_cancel_with_dependencies_in_memory[RescheduleEvent-False] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 35%] 708s tests/test_cancelled_state.py::test_cancel_with_dependencies_in_memory[RescheduleEvent-True] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 35%] 708s tests/test_cancelled_state.py::test_secede_cancelled_or_resumed_workerstate[ExecuteSuccessEvent-False-False] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 35%] 708s tests/test_cancelled_state.py::test_secede_cancelled_or_resumed_workerstate[ExecuteSuccessEvent-False-True] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 35%] 708s tests/test_cancelled_state.py::test_secede_cancelled_or_resumed_workerstate[ExecuteSuccessEvent-True-False] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 35%] 708s tests/test_cancelled_state.py::test_secede_cancelled_or_resumed_workerstate[ExecuteSuccessEvent-True-True] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 35%] 708s tests/test_cancelled_state.py::test_secede_cancelled_or_resumed_workerstate[ExecuteFailureEvent-False-False] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 35%] 708s tests/test_cancelled_state.py::test_secede_cancelled_or_resumed_workerstate[ExecuteFailureEvent-False-True] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 35%] 708s tests/test_cancelled_state.py::test_secede_cancelled_or_resumed_workerstate[ExecuteFailureEvent-True-False] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 35%] 708s tests/test_cancelled_state.py::test_secede_cancelled_or_resumed_workerstate[ExecuteFailureEvent-True-True] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 35%] 708s tests/test_cancelled_state.py::test_secede_cancelled_or_resumed_workerstate[RescheduleEvent-False-False] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 35%] 708s tests/test_cancelled_state.py::test_secede_cancelled_or_resumed_workerstate[RescheduleEvent-False-True] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 35%] 708s tests/test_cancelled_state.py::test_secede_cancelled_or_resumed_workerstate[RescheduleEvent-True-False] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 35%] 708s tests/test_cancelled_state.py::test_secede_cancelled_or_resumed_workerstate[RescheduleEvent-True-True] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 35%] 709s tests/test_cancelled_state.py::test_secede_cancelled_or_resumed_scheduler <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 35%] 709s tests/test_cancelled_state.py::test_workerstate_remove_replica_of_cancelled_task_dependency <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 35%] 714s tests/test_chaos.py::test_KillWorker[sys.exit] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_chaos.py PASSED [ 35%] 715s tests/test_chaos.py::test_KillWorker[graceful] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_chaos.py PASSED [ 35%] 719s tests/test_chaos.py::test_KillWorker[segfault] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_chaos.py PASSED [ 35%] 719s tests/test_client.py::test_submit <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 35%] 720s tests/test_client.py::test_map <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 35%] 720s tests/test_client.py::test_map_empty <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 35%] 720s tests/test_client.py::test_map_keynames <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 35%] 720s tests/test_client.py::test_map_retries <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 35%] 720s tests/test_client.py::test_map_batch_size <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 35%] 720s tests/test_client.py::test_custom_key_with_batches <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 35%] 720s tests/test_client.py::test_compute_retries <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 35%] 721s tests/test_client.py::test_compute_retries_annotations <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 35%] 722s tests/test_client.py::test_retries_get <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 35%] 723s tests/test_client.py::test_persist_retries <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 35%] 723s tests/test_client.py::test_persist_retries_annotations <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 35%] 723s tests/test_client.py::test_retries_dask_array <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 35%] 723s tests/test_client.py::test_future_repr <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 35%] 723s tests/test_client.py::test_future_tuple_repr <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 35%] 723s tests/test_client.py::test_Future_exception <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 35%] 725s tests/test_client.py::test_Future_exception_sync <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 36%] 725s tests/test_client.py::test_Future_release <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 36%] 727s tests/test_client.py::test_Future_release_sync <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 36%] 729s tests/test_client.py::test_short_tracebacks[result] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 36%] 731s tests/test_client.py::test_short_tracebacks[gather] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 36%] 731s tests/test_client.py::test_short_tracebacks_async[await] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 36%] 731s tests/test_client.py::test_short_tracebacks_async[result] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 36%] 731s tests/test_client.py::test_short_tracebacks_async[gather] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 36%] 731s tests/test_client.py::test_map_naming <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 36%] 731s tests/test_client.py::test_submit_naming <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 36%] 731s tests/test_client.py::test_exceptions <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 36%] 731s tests/test_client.py::test_gc <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 36%] 733s tests/test_client.py::test_thread <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 36%] 735s tests/test_client.py::test_sync_exceptions <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 36%] 735s tests/test_client.py::test_gather <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 36%] 735s tests/test_client.py::test_gather_mismatched_client <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 36%] 735s tests/test_client.py::test_gather_lost <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 36%] 737s tests/test_client.py::test_gather_sync <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 36%] 737s tests/test_client.py::test_gather_strict <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 36%] 737s tests/test_client.py::test_gather_skip <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 36%] 738s tests/test_client.py::test_limit_concurrent_gathering <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 36%] 738s tests/test_client.py::test_get <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 36%] 739s tests/test_client.py::test_get_sync <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 36%] 741s tests/test_client.py::test_no_future_references <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 36%] 743s tests/test_client.py::test_get_sync_optimize_graph_passes_through <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 36%] 743s tests/test_client.py::test_gather_errors <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 36%] 743s tests/test_client.py::test_wait <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 36%] 743s tests/test_client.py::test_wait_first_completed <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 36%] 744s tests/test_client.py::test_wait_timeout <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 36%] 745s tests/test_client.py::test_wait_sync <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 36%] 747s tests/test_client.py::test_wait_informative_error_for_timeouts <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 36%] 747s tests/test_client.py::test_garbage_collection <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 36%] 747s tests/test_client.py::test_garbage_collection_with_scatter <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 36%] 747s tests/test_client.py::test_recompute_released_key <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 36%] 750s tests/test_client.py::test_long_tasks_dont_trigger_timeout <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 36%] 750s tests/test_client.py::test_tokenize_on_futures <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 36%] 751s tests/test_client.py::test_restrictions_submit <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 36%] 751s tests/test_client.py::test_restrictions_ip_port <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 37%] 751s tests/test_client.py::test_restrictions_map <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 37%] 751s tests/test_client.py::test_restrictions_get <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 37%] 751s tests/test_client.py::test_restrictions_get_annotate <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 37%] 751s tests/test_client.py::test_remove_worker <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 37%] 751s tests/test_client.py::test_errors_dont_block <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 37%] 751s tests/test_client.py::test_submit_quotes <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 37%] 751s tests/test_client.py::test_map_quotes <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 37%] 752s tests/test_client.py::test_two_consecutive_clients_share_results <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 37%] 752s tests/test_client.py::test_submit_then_get_with_Future <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 37%] 752s tests/test_client.py::test_aliases <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 37%] 752s tests/test_client.py::test_aliases_2 <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 37%] 752s tests/test_client.py::test_scatter <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 37%] 752s tests/test_client.py::test_scatter_types <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 37%] 752s tests/test_client.py::test_scatter_non_list <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 37%] 752s tests/test_client.py::test_scatter_tokenize_local <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 37%] 752s tests/test_client.py::test_scatter_singletons <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 37%] 752s tests/test_client.py::test_scatter_typename <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 37%] 752s tests/test_client.py::test_scatter_hash <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 37%] 752s tests/test_client.py::test_scatter_hash_2 <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 37%] 752s tests/test_client.py::test_get_releases_data <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 37%] 754s tests/test_client.py::test_current <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 37%] 756s tests/test_client.py::test_current_nested <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 37%] 756s tests/test_client.py::test_current_nested_async <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 37%] 756s tests/test_client.py::test_current_concurrent <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 37%] 756s tests/test_client.py::test_context_manager_used_from_different_tasks <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 37%] 758s tests/test_client.py::test_context_manager_used_from_different_threads <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 37%] 759s tests/test_client.py::test_global_clients <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 37%] 759s tests/test_client.py::test_exception_on_exception <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 37%] 759s tests/test_client.py::test_get_task_prefix_states <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 37%] 759s tests/test_client.py::test_get_nbytes <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 37%] 760s tests/test_client.py::test_nbytes_determines_worker <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 37%] 760s tests/test_client.py::test_if_intermediates_clear_on_error <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 37%] 760s tests/test_client.py::test_pragmatic_move_small_data_to_large_data <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 37%] 760s tests/test_client.py::test_get_with_non_list_key <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 37%] 760s tests/test_client.py::test_get_with_error <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 37%] 762s tests/test_client.py::test_get_with_error_sync <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 38%] 762s tests/test_client.py::test_directed_scatter <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 38%] 762s tests/test_client.py::test_scatter_direct <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 38%] 762s tests/test_client.py::test_scatter_direct_2 <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 38%] 762s tests/test_client.py::test_scatter_direct_numpy <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 38%] 762s tests/test_client.py::test_scatter_direct_broadcast <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 38%] 762s tests/test_client.py::test_scatter_direct_balanced <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 38%] 762s tests/test_client.py::test_scatter_direct_broadcast_target <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 38%] 762s tests/test_client.py::test_scatter_direct_empty <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 38%] 763s tests/test_client.py::test_scatter_direct_spread_evenly <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 38%] 764s tests/test_client.py::test_scatter_gather_sync[True-True] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 38%] 766s tests/test_client.py::test_scatter_gather_sync[True-False] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 38%] 767s tests/test_client.py::test_scatter_gather_sync[False-True] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 38%] 769s tests/test_client.py::test_scatter_gather_sync[False-False] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 38%] 769s tests/test_client.py::test_gather_direct <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 38%] 769s tests/test_client.py::test_many_submits_spread_evenly <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 38%] 769s tests/test_client.py::test_traceback <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 38%] 769s tests/test_client.py::test_get_traceback <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 38%] 769s tests/test_client.py::test_gather_traceback <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 38%] 771s tests/test_client.py::test_traceback_sync <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 38%] 771s tests/test_client.py::test_upload_file <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 38%] 771s tests/test_client.py::test_upload_file_refresh_delayed <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 38%] 771s tests/test_client.py::test_upload_file_no_extension <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 38%] 771s tests/test_client.py::test_upload_file_zip <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 38%] 773s tests/test_client.py::test_upload_file_egg <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 38%] 773s tests/test_client.py::test_upload_large_file <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 38%] 775s tests/test_client.py::test_upload_file_sync <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 38%] 775s tests/test_client.py::test_upload_file_exception <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 38%] 776s tests/test_client.py::test_upload_file_exception_sync <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 38%] 777s tests/test_client.py::test_upload_file_load <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 38%] 777s tests/test_client.py::test_upload_file_new_worker <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 38%] 777s tests/test_client.py::test_multiple_clients <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py SKIPPED [ 38%] 777s tests/test_client.py::test_async_compute <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 38%] 777s tests/test_client.py::test_async_compute_with_scatter <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 38%] 778s tests/test_client.py::test_sync_compute <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 38%] 779s tests/test_client.py::test_remote_scatter_gather <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 38%] 779s tests/test_client.py::test_remote_submit_on_Future <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 39%] 780s tests/test_client.py::test_start_is_idempotent <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 39%] 780s tests/test_client.py::test_client_with_scheduler <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 39%] 781s tests/test_client.py::test_allow_restrictions <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 39%] 781s tests/test_client.py::test_bad_address <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 39%] 781s tests/test_client.py::test_informative_error_on_cluster_type <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 39%] 781s tests/test_client.py::test_long_error <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 39%] 781s tests/test_client.py::test_map_on_futures_with_kwargs <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 39%] 781s tests/test_client.py::test_badly_serialized_input_stderr <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py SKIPPED [ 39%] 783s tests/test_client.py::test_repr[str] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 39%] 784s tests/test_client.py::test_repr[repr] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 39%] 786s tests/test_client.py::test_repr[func2] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 39%] 786s tests/test_client.py::test_repr_async <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 39%] 786s tests/test_client.py::test_repr_no_memory_limit <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 39%] 787s tests/test_client.py::test_repr_localcluster <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 39%] 787s tests/test_client.py::test_forget_simple <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 39%] 787s tests/test_client.py::test_forget_complex <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 39%] 787s tests/test_client.py::test_forget_in_flight <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 39%] 787s tests/test_client.py::test_forget_errors <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 39%] 789s tests/test_client.py::test_repr_sync <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 39%] 789s tests/test_client.py::test_multi_client <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 39%] 790s tests/test_client.py::test_cleanup_after_broken_client_connection <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 39%] 791s tests/test_client.py::test_multi_garbage_collection <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 39%] 791s tests/test_client.py::test__broadcast <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 39%] 791s tests/test_client.py::test__broadcast_integer <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 39%] 791s tests/test_client.py::test__broadcast_dict <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 39%] 791s tests/test_client.py::test_proxy <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 39%] 791s tests/test_client.py::test_cancel <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 39%] 791s tests/test_client.py::test_cancel_tuple_key <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 39%] 791s tests/test_client.py::test_cancel_multi_client <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 39%] 791s tests/test_client.py::test_cancel_before_known_to_scheduler <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 39%] 791s tests/test_client.py::test_cancel_collection <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 39%] 793s tests/test_client.py::test_cancel_sync <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 39%] 793s tests/test_client.py::test_future_type <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 39%] 793s tests/test_client.py::test_traceback_clean <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 39%] 793s tests/test_client.py::test_map_differnet_lengths <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 39%] 795s tests/test_client.py::test_Future_exception_sync_2 <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 40%] 795s tests/test_client.py::test_async_persist <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 40%] 795s tests/test_client.py::test_persist_async <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 40%] 797s tests/test_client.py::test_persist <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 40%] 797s tests/test_client.py::test_long_traceback <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 40%] 797s tests/test_client.py::test_wait_on_collections <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 40%] 797s tests/test_client.py::test_futures_of_get <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 40%] 797s tests/test_client.py::test_futures_of_class <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 40%] 797s tests/test_client.py::test_futures_of_cancelled_raises <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 40%] 797s tests/test_client.py::test_balance_tasks_by_stacks <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py SKIPPED [ 40%] 797s tests/test_client.py::test_run <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 40%] 797s tests/test_client.py::test_run_handles_picklable_data <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 40%] 799s tests/test_client.py::test_run_sync <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 40%] 799s tests/test_client.py::test_run_coroutine <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 40%] 801s tests/test_client.py::test_run_coroutine_sync <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 40%] 801s tests/test_client.py::test_run_exception <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 40%] 802s tests/test_client.py::test_run_rpc_error <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 40%] 804s tests/test_client.py::test_diagnostic_ui <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 40%] 805s tests/test_client.py::test_diagnostic_nbytes_sync <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 40%] 806s tests/test_client.py::test_diagnostic_nbytes <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 40%] 806s tests/test_client.py::test_worker_aliases <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 40%] 807s tests/test_client.py::test_persist_get_sync <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 40%] 808s tests/test_client.py::test_persist_get[True] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 40%] 808s tests/test_client.py::test_persist_get[False] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 40%] 809s tests/test_client.py::test_client_num_fds <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 40%] 810s tests/test_client.py::test_startup_close_startup <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 40%] 811s tests/test_client.py::test_startup_close_startup_sync <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 40%] 812s tests/test_client.py::test_badly_serialized_exceptions <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 40%] 812s tests/test_client.py::test_rebalance <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 40%] 812s tests/test_client.py::test_rebalance_workers_and_keys <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 40%] 812s tests/test_client.py::test_rebalance_sync <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 40%] 812s tests/test_client.py::test_rebalance_unprepared <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 40%] 813s tests/test_client.py::test_receive_lost_key <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 40%] 813s tests/test_client.py::test_unrunnable_task_runs <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 40%] 814s tests/test_client.py::test_add_worker_after_tasks <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 40%] 815s tests/test_client.py::test_workers_register_indirect_data <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 40%] 815s tests/test_client.py::test_submit_on_cancelled_future <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 40%] 815s tests/test_client.py::test_replicate <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 41%] 815s tests/test_client.py::test_replicate_tuple_keys <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 41%] 815s tests/test_client.py::test_replicate_workers <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 41%] 815s tests/test_client.py::test_replicate_tree_branching <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 41%] 816s tests/test_client.py::test_client_replicate <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 41%] 816s tests/test_client.py::test_client_replicate_host <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 41%] 818s tests/test_client.py::test_client_replicate_sync <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 41%] 818s tests/test_client.py::test_task_load_adapts_quickly <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 41%] 818s tests/test_client.py::test_even_load_after_fast_functions <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 41%] 818s tests/test_client.py::test_even_load_on_startup <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 41%] 818s tests/test_client.py::test_contiguous_load <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py SKIPPED [ 41%] 818s tests/test_client.py::test_balanced_with_submit <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 41%] 818s tests/test_client.py::test_balanced_with_submit_and_resident_data <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 41%] 819s tests/test_client.py::test_scheduler_saturates_cores <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 41%] 819s tests/test_client.py::test_scheduler_saturates_cores_random <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 41%] 819s tests/test_client.py::test_cancel_clears_processing <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 41%] 821s tests/test_client.py::test_default_get <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 41%] 821s tests/test_client.py::test_get_scheduler_default_client_config_interleaving <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 41%] 821s tests/test_client.py::test_ensure_default_client <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 41%] 821s tests/test_client.py::test_set_as_default <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 41%] 821s tests/test_client.py::test_get_foo <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 41%] 821s tests/test_client.py::test_get_foo_lost_keys <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 41%] 832s tests/test_client.py::test_bad_tasks_fail <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 41%] 834s tests/test_client.py::test_get_processing_sync <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 41%] 836s tests/test_client.py::test_close_idempotent <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 41%] 837s tests/test_client.py::test_get_returns_early <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 41%] 839s tests/test_client.py::test_Client_clears_references_after_restart <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 41%] 840s tests/test_client.py::test_get_stops_work_after_error <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 41%] 842s tests/test_client.py::test_as_completed_list <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 41%] 844s tests/test_client.py::test_as_completed_results <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 41%] 846s tests/test_client.py::test_as_completed_batches[True] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 41%] 848s tests/test_client.py::test_as_completed_batches[False] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 41%] 850s tests/test_client.py::test_as_completed_next_batch <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 41%] 850s tests/test_client.py::test_status <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 41%] 850s tests/test_client.py::test_persist_optimize_graph <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 41%] 851s tests/test_client.py::test_scatter_raises_if_no_workers <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 41%] 854s tests/test_client.py::test_reconnect <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 42%] 854s tests/test_client.py::test_reconnect_timeout <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 42%] 855s tests/test_client.py::test_idempotence <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 42%] 856s tests/test_client.py::test_scheduler_info <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 42%] 858s tests/test_client.py::test_write_scheduler_file <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 42%] 860s tests/test_client.py::test_get_versions_sync <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 42%] 860s tests/test_client.py::test_get_versions_async <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 42%] 861s tests/test_client.py::test_get_versions_rpc_error <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 42%] 863s tests/test_client.py::test_threaded_get_within_distributed <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 42%] 863s tests/test_client.py::test_lose_scattered_data <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 42%] 863s tests/test_client.py::test_partially_lose_scattered_data <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 42%] 864s tests/test_client.py::test_scatter_compute_lose <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 42%] 864s tests/test_client.py::test_scatter_compute_store_lose <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 42%] 864s tests/test_client.py::test_scatter_compute_store_lose_processing <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 42%] 864s tests/test_client.py::test_temp_default_client <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 42%] 864s tests/test_client.py::test_as_current <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 42%] 866s tests/test_client.py::test_as_current_is_thread_local <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 42%] 866s tests/test_client.py::test_as_current_is_task_local <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 42%] 866s tests/test_client.py::test_persist_workers_annotate <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 42%] 866s tests/test_client.py::test_persist_workers_annotate2 <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 42%] 867s tests/test_client.py::test_persist_workers <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 42%] 867s tests/test_client.py::test_compute_workers_annotate <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 42%] 867s tests/test_client.py::test_compute_workers <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 42%] 867s tests/test_client.py::test_compute_nested_containers <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 42%] 867s tests/test_client.py::test_scatter_type <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 42%] 867s tests/test_client.py::test_retire_workers_2 <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 42%] 867s tests/test_client.py::test_retire_many_workers <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 42%] 868s tests/test_client.py::test_weight_occupancy_against_data_movement <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 42%] 868s tests/test_client.py::test_distribute_tasks_by_nthreads <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 42%] 868s tests/test_client.py::test_add_done_callback <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 42%] 868s tests/test_client.py::test_normalize_collection <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 42%] 868s tests/test_client.py::test_normalize_collection_dask_array <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 42%] 877s tests/test_client.py::test_normalize_collection_with_released_futures <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 42%] 877s tests/test_client.py::test_auto_normalize_collection <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py XPASS [ 42%] 878s tests/test_client.py::test_auto_normalize_collection_sync <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py XPASS [ 42%] 879s tests/test_client.py::test_interleave_computations <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 42%] 879s tests/test_client.py::test_interleave_computations_map <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py SKIPPED [ 43%] 879s tests/test_client.py::test_scatter_dict_workers <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 43%] 882s tests/test_client.py::test_client_timeout <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 43%] 882s tests/test_client.py::test_submit_list_kwargs <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 43%] 882s tests/test_client.py::test_map_list_kwargs <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 43%] 884s tests/test_client.py::test_recreate_error_sync <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 43%] 885s tests/test_client.py::test_recreate_error_not_error <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 43%] 887s tests/test_client.py::test_recreate_task_sync <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 43%] 887s tests/test_client.py::test_retire_workers <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 43%] 891s tests/test_client.py::test_restart_workers <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 43%] 891s tests/test_client.py::test_restart_workers_no_nanny_raises <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 43%] 894s tests/test_client.py::test_restart_workers_kill_timeout[True] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 43%] 897s tests/test_client.py::test_restart_workers_kill_timeout[False] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 43%] 902s tests/test_client.py::test_restart_workers_restart_timeout[True] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 43%] 906s tests/test_client.py::test_restart_workers_restart_timeout[False] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 43%] 910s tests/test_client.py::test_restart_workers_exception <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 43%] 913s tests/test_client.py::test_restart_workers_by_name[True] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 43%] 916s tests/test_client.py::test_restart_workers_by_name[False] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 43%] 916s tests/test_client.py::test_robust_unserializable <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 43%] 916s tests/test_client.py::test_robust_undeserializable <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 43%] 916s tests/test_client.py::test_robust_undeserializable_function <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 43%] 916s tests/test_client.py::test_fire_and_forget <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 43%] 916s tests/test_client.py::test_fire_and_forget_err <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 43%] 917s tests/test_client.py::test_quiet_client_close <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 43%] 918s tests/test_client.py::test_quiet_client_close_when_cluster_is_closed_before_client <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 43%] 918s tests/test_client.py::test_close <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 43%] 920s tests/test_client.py::test_threadsafe <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 43%] 931s tests/test_client.py::test_threadsafe_get <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 43%] 942s tests/test_client.py::test_threadsafe_compute <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 43%] 942s tests/test_client.py::test_identity <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 43%] 942s tests/test_client.py::test_get_client <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 43%] 942s tests/test_client.py::test_get_client_no_cluster <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 43%] 942s tests/test_client.py::test_serialize_collections <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 43%] 942s tests/test_client.py::test_secede_simple <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 43%] 943s tests/test_client.py::test_secede_balances <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 43%] 943s tests/test_client.py::test_long_running_not_in_occupancy[True] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 43%] 943s tests/test_client.py::test_long_running_not_in_occupancy[False] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 44%] 943s tests/test_client.py::test_long_running_removal_clean[True] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 44%] 943s tests/test_client.py::test_long_running_removal_clean[False] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 44%] 944s tests/test_client.py::test_sub_submit_priority <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 44%] 945s tests/test_client.py::test_get_client_sync <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 44%] 945s tests/test_client.py::test_serialize_collections_of_futures <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 44%] 948s tests/test_client.py::test_serialize_collections_of_futures_sync <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 44%] 950s tests/test_client.py::test_dynamic_workloads_sync <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 44%] 956s tests/test_client.py::test_dynamic_workloads_sync_random <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 44%] 956s tests/test_client.py::test_bytes_keys <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 44%] 956s tests/test_client.py::test_unicode_ascii_keys <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 44%] 956s tests/test_client.py::test_unicode_keys <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 44%] 957s tests/test_client.py::test_use_synchronous_client_in_async_context <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 44%] 959s tests/test_client.py::test_quiet_quit_when_cluster_leaves <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 44%] 959s tests/test_client.py::test_call_stack_future <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 44%] 960s tests/test_client.py::test_call_stack_all <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 44%] 962s tests/test_client.py::test_call_stack_collections <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 44%] 964s tests/test_client.py::test_call_stack_collections_all <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 44%] 964s tests/test_client.py::test_profile <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 44%] 965s tests/test_client.py::test_profile_disabled <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 44%] 966s tests/test_client.py::test_profile_keys <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 44%] 966s tests/test_client.py::test_client_with_name <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 44%] 966s tests/test_client.py::test_client_async_before_loop_starts <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 44%] 968s tests/test_client.py::test_nested_compute <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 44%] 968s tests/test_client.py::test_task_metadata <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 44%] 969s tests/test_client.py::test_logs <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 44%] 971s tests/test_client.py::test_logs_from_worker_submodules <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 44%] 971s tests/test_client.py::test_avoid_delayed_finalize <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 44%] 971s tests/test_client.py::test_config_scheduler_address <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 44%] 971s tests/test_client.py::test_warn_when_submitting_large_values <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 44%] 971s tests/test_client.py::test_warn_when_submitting_large_values_memoryview <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 44%] 971s tests/test_client.py::test_unhashable_function <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 44%] 971s tests/test_client.py::test_client_name <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 44%] 973s tests/test_client.py::test_client_doesnt_close_given_loop <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 44%] 975s tests/test_client.py::test_quiet_scheduler_loss <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 44%] 977s tests/test_client.py::test_dashboard_link <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 44%] 977s tests/test_client.py::test_dashboard_link_inproc <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 44%] 977s tests/test_client.py::test_client_timeout_2 <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 45%] 977s tests/test_client.py::test_turn_off_pickle[True] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 45%] 977s tests/test_client.py::test_turn_off_pickle[False] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 45%] 977s tests/test_client.py::test_de_serialization <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 45%] 977s tests/test_client.py::test_de_serialization_none <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 45%] 977s tests/test_client.py::test_client_repr_closed <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 45%] 977s tests/test_client.py::test_client_repr_closed_sync <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py SKIPPED [ 45%] 977s tests/test_client.py::test_nested_prioritization <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py XPASS [ 45%] 978s tests/test_client.py::test_scatter_error_cancel <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 45%] 978s tests/test_client.py::test_scatter_and_replicate_avoid_paused_workers[False-False-False] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 45%] 978s tests/test_client.py::test_scatter_and_replicate_avoid_paused_workers[False-False-True] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 45%] 978s tests/test_client.py::test_scatter_and_replicate_avoid_paused_workers[False-True-False] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 45%] 979s tests/test_client.py::test_scatter_and_replicate_avoid_paused_workers[False-True-True] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 45%] 979s tests/test_client.py::test_scatter_and_replicate_avoid_paused_workers[True-False-False] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 45%] 979s tests/test_client.py::test_scatter_and_replicate_avoid_paused_workers[True-False-True] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 45%] 979s tests/test_client.py::test_scatter_and_replicate_avoid_paused_workers[True-True-False] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 45%] 980s tests/test_client.py::test_scatter_and_replicate_avoid_paused_workers[True-True-True] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 45%] 980s tests/test_client.py::test_scatter_and_replicate_avoid_paused_workers[10-False-False] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 45%] 980s tests/test_client.py::test_scatter_and_replicate_avoid_paused_workers[10-False-True] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 45%] 980s tests/test_client.py::test_scatter_and_replicate_avoid_paused_workers[10-True-False] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 45%] 981s tests/test_client.py::test_scatter_and_replicate_avoid_paused_workers[10-True-True] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 45%] 981s tests/test_client.py::test_no_threads_lingering <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py XPASS [ 45%] 981s tests/test_client.py::test_direct_async <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 45%] 983s tests/test_client.py::test_direct_sync <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 45%] 983s tests/test_client.py::test_mixing_clients_same_scheduler <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 45%] 983s tests/test_client.py::test_mixing_clients_different_scheduler <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 45%] 983s tests/test_client.py::test_tuple_keys <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 45%] 983s tests/test_client.py::test_multiple_scatter <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 45%] 983s tests/test_client.py::test_map_large_kwargs_in_graph <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 45%] 983s tests/test_client.py::test_retry <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 45%] 983s tests/test_client.py::test_retry_dependencies <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 45%] 983s tests/test_client.py::test_released_dependencies <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 45%] 983s tests/test_client.py::test_profile_bokeh <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py SKIPPED [ 45%] 984s tests/test_client.py::test_get_mix_futures_and_SubgraphCallable <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 45%] 984s tests/test_client.py::test_get_mix_futures_and_SubgraphCallable_dask_dataframe <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 45%] 985s tests/test_client.py::test_direct_to_workers <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 45%] 985s tests/test_client.py::test_instances <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 46%] 986s tests/test_client.py::test_wait_for_workers <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 46%] 986s tests/test_client.py::test_file_descriptors_dont_leak[Worker] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 46%] 989s tests/test_client.py::test_file_descriptors_dont_leak[Nanny] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 46%] 990s tests/test_client.py::test_dashboard_link_cluster <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 46%] 990s tests/test_client.py::test_shutdown <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 46%] 990s tests/test_client.py::test_shutdown_localcluster <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 46%] 990s tests/test_client.py::test_shutdown_stops_callbacks <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 46%] 990s tests/test_client.py::test_shutdown_is_quiet_with_cluster <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 46%] 990s tests/test_client.py::test_client_is_quiet_cluster_close <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 46%] 992s tests/test_client.py::test_config_inherited_by_subprocess <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 46%] 992s tests/test_client.py::test_futures_of_sorted <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 46%] 994s tests/test_client.py::test_profile_server <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 46%] 995s tests/test_client.py::test_profile_server_disabled <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 46%] 995s tests/test_client.py::test_await_future <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 46%] 996s tests/test_client.py::test_as_completed_async_for <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 46%] 996s tests/test_client.py::test_as_completed_async_for_results <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 46%] 996s tests/test_client.py::test_as_completed_async_for_cancel <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 46%] 996s tests/test_client.py::test_async_with <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 46%] 998s tests/test_client.py::test_client_sync_with_async_def <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 46%] 998s tests/test_client.py::test_dont_hold_on_to_large_messages <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py SKIPPED [ 46%] 998s tests/test_client.py::test_run_on_scheduler_async_def <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 46%] 998s tests/test_client.py::test_run_on_scheduler_async_def_wait <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 46%] 998s tests/test_client.py::test_performance_report[True] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py SKIPPED [ 46%] 998s tests/test_client.py::test_performance_report[False] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py SKIPPED [ 46%] 998s tests/test_client.py::test_as_completed_condition_loop <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 46%] 1001s tests/test_client.py::test_mixed_compression <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 46%] 1003s tests/test_client.py::test_futures_in_subgraphs <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 46%] 1003s tests/test_client.py::test_get_task_metadata <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 46%] 1003s tests/test_client.py::test_get_task_metadata_multiple <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 46%] 1003s tests/test_client.py::test_register_worker_plugin_instance_required <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 46%] 1003s tests/test_client.py::test_register_worker_plugin_exception <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 46%] 1003s tests/test_client.py::test_annotations_task_state <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 46%] 1004s tests/test_client.py::test_annotations_compute_time[compute] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 46%] 1004s tests/test_client.py::test_annotations_compute_time[persist] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 46%] 1004s tests/test_client.py::test_annotations_survive_optimization <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py XFAIL [ 46%] 1004s tests/test_client.py::test_annotations_priorities <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 47%] 1004s tests/test_client.py::test_annotations_workers <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 47%] 1004s tests/test_client.py::test_annotations_retries <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 47%] 1004s tests/test_client.py::test_annotations_blockwise_unpack <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 47%] 1004s tests/test_client.py::test_annotations_resources <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 47%] 1005s tests/test_client.py::test_annotations_resources_culled <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 47%] 1005s tests/test_client.py::test_annotations_loose_restrictions <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 47%] 1005s tests/test_client.py::test_annotations_submit_map <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 47%] 1005s tests/test_client.py::test_annotations_global_vs_local <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 47%] 1005s tests/test_client.py::test_workers_collection_restriction <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 47%] 1005s tests/test_client.py::test_get_client_functions_spawn_clusters <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py SKIPPED [ 47%] 1005s tests/test_client.py::test_computation_code_walk_frames <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 47%] 1008s tests/test_client.py::test_computation_ignore_ipython_frames[2] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 47%] 1010s tests/test_client.py::test_computation_ignore_ipython_frames[3] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 47%] 1011s tests/test_client.py::test_computation_store_annotations <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 47%] 1012s tests/test_client.py::test_computation_object_code_dask_compute <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 47%] 1014s tests/test_client.py::test_computation_object_code_dask_compute_no_frames_default <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 47%] 1016s tests/test_client.py::test_computation_object_code_not_available <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py SKIPPED [ 47%] 1016s tests/test_client.py::test_computation_object_code_dask_persist <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 47%] 1016s tests/test_client.py::test_computation_object_code_client_submit_simple <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 47%] 1016s tests/test_client.py::test_computation_object_code_client_submit_list_comp <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 47%] 1016s tests/test_client.py::test_computation_object_code_client_submit_dict_comp <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 47%] 1016s tests/test_client.py::test_computation_object_code_client_map <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 47%] 1016s tests/test_client.py::test_computation_object_code_client_compute <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 47%] 1020s tests/test_client.py::test_upload_directory <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 47%] 1020s tests/test_client.py::test_duck_typed_register_plugin_raises <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 47%] 1020s tests/test_client.py::test_exception_text <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 47%] 1020s tests/test_client.py::test_async_task <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 47%] 1020s tests/test_client.py::test_async_task_with_partial <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 47%] 1020s tests/test_client.py::test_warn_manual <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 47%] 1021s tests/test_client.py::test_warn_remote <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 47%] 1022s tests/test_client.py::test_print_remote <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 47%] 1023s tests/test_client.py::test_print_manual <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 47%] 1025s tests/test_client.py::test_print_manual_bad_args <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 47%] 1026s tests/test_client.py::test_print_non_msgpack_serializable <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 47%] 1026s tests/test_client.py::test_print_local <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 47%] 1027s tests/test_client.py::test_forward_logging <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 48%] 1029s tests/test_client.py::test_dump_cluster_state_write_from_scheduler <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 48%] 1031s tests/test_client.py::test_dump_cluster_state_sync[msgpack-True] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 48%] 1033s tests/test_client.py::test_dump_cluster_state_sync[msgpack-False] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 48%] 1035s tests/test_client.py::test_dump_cluster_state_sync[yaml-True] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 48%] 1037s tests/test_client.py::test_dump_cluster_state_sync[yaml-False] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 48%] 1037s tests/test_client.py::test_dump_cluster_state_async[msgpack-True] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 48%] 1037s tests/test_client.py::test_dump_cluster_state_async[msgpack-False] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 48%] 1037s tests/test_client.py::test_dump_cluster_state_async[yaml-True] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 48%] 1037s tests/test_client.py::test_dump_cluster_state_async[yaml-False] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 48%] 1037s tests/test_client.py::test_dump_cluster_state_json[True] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 48%] 1038s tests/test_client.py::test_dump_cluster_state_json[False] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 48%] 1038s tests/test_client.py::test_dump_cluster_state_exclude_default <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 48%] 1038s tests/test_client.py::TestClientSecurityLoader::test_security_loader <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 48%] 1039s tests/test_client.py::TestClientSecurityLoader::test_security_loader_ignored_if_explicit_security_provided <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 48%] 1039s tests/test_client.py::TestClientSecurityLoader::test_security_loader_ignored_if_returns_none <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 48%] 1039s tests/test_client.py::TestClientSecurityLoader::test_security_loader_import_failed <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 48%] 1039s tests/test_client.py::test_benchmark_hardware_no_workers <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 48%] 1039s tests/test_client.py::test_wait_for_workers_updates_info <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 48%] 1041s tests/test_client.py::test_quiet_close_process[True] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 48%] 1047s tests/test_client.py::test_quiet_close_process[False] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py RERUN [ 48%] 1053s tests/test_client.py::test_quiet_close_process[False] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py RERUN [ 48%] 1059s tests/test_client.py::test_quiet_close_process[False] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py RERUN [ 48%] 1060s tests/test_client.py::test_quiet_close_process[False] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 48%] 1060s tests/test_client.py::test_deprecated_loop_properties <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 48%] 1060s tests/test_client.py::test_fast_close_on_aexit_failure <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 48%] 1060s tests/test_client.py::test_wait_for_workers_n_workers_value_check[None-ValueError] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 48%] 1060s tests/test_client.py::test_wait_for_workers_n_workers_value_check[0-ValueError] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 48%] 1060s tests/test_client.py::test_wait_for_workers_n_workers_value_check[1.0-ValueError] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 48%] 1060s tests/test_client.py::test_wait_for_workers_n_workers_value_check[1-None] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 48%] 1060s tests/test_client.py::test_wait_for_workers_n_workers_value_check[2-None] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 48%] 1061s tests/test_client.py::test_unpacks_remotedata_namedtuple[PlainNamedTuple-args0-kwargs0] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 48%] 1061s tests/test_client.py::test_unpacks_remotedata_namedtuple[NewArgsNamedTuple-args1-kwargs1] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 48%] 1061s tests/test_client.py::test_unpacks_remotedata_namedtuple[NewArgsExNamedTuple-args2-kwargs2] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 48%] 1061s tests/test_client.py::test_resolves_future_in_namedtuple[PlainNamedTuple-args0-kwargs0] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 48%] 1061s tests/test_client.py::test_resolves_future_in_namedtuple[NewArgsNamedTuple-args1-kwargs1] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 48%] 1061s tests/test_client.py::test_resolves_future_in_namedtuple[NewArgsExNamedTuple-args2-kwargs2] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 48%] 1061s tests/test_client.py::test_resolves_future_in_dict <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 48%] 1061s tests/test_client.py::test_gather_race_vs_AMM[False] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 48%] 1062s tests/test_client.py::test_gather_race_vs_AMM[True] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 48%] 1064s tests/test_client.py::test_client_disconnect_exception_on_cancelled_futures <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 49%] 1067s tests/test_client.py::test_scheduler_restart_exception_on_cancelled_futures <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 49%] 1067s tests/test_client.py::test_release_persisted_collection <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 49%] 1069s tests/test_client.py::test_release_persisted_collection_sync <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 49%] 1070s tests/test_client.py::test_worker_clients_do_not_claim_ownership_of_serialize_futures[True] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 49%] 1072s tests/test_client.py::test_worker_clients_do_not_claim_ownership_of_serialize_futures[False] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 49%] 1074s tests/test_client_executor.py::test_submit <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client_executor.py PASSED [ 49%] 1076s tests/test_client_executor.py::test_as_completed <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client_executor.py PASSED [ 49%] 1077s tests/test_client_executor.py::test_wait <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client_executor.py PASSED [ 49%] 1079s tests/test_client_executor.py::test_cancellation <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client_executor.py PASSED [ 49%] 1082s tests/test_client_executor.py::test_cancellation_wait <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client_executor.py PASSED [ 49%] 1084s tests/test_client_executor.py::test_cancellation_as_completed <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client_executor.py PASSED [ 49%] 1088s tests/test_client_executor.py::test_map <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client_executor.py PASSED [ 49%] 1090s tests/test_client_executor.py::test_pure <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client_executor.py PASSED [ 49%] 1091s tests/test_client_executor.py::test_workers <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client_executor.py PASSED [ 49%] 1093s tests/test_client_executor.py::test_unsupported_arguments <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client_executor.py PASSED [ 49%] 1095s tests/test_client_executor.py::test_retries <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client_executor.py PASSED [ 49%] 1098s tests/test_client_executor.py::test_shutdown_wait <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client_executor.py PASSED [ 49%] 1099s tests/test_client_executor.py::test_shutdown_nowait <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client_executor.py PASSED [ 49%] 1099s tests/test_client_loop.py::test_close_loop_sync_start_new_loop <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client_loop.py PASSED [ 49%] 1099s tests/test_client_loop.py::test_close_loop_sync_use_running_loop <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client_loop.py PASSED [ 49%] 1099s tests/test_cluster_dump.py::test_tuple_to_list[input0-expected0] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_cluster_dump.py PASSED [ 49%] 1099s tests/test_cluster_dump.py::test_tuple_to_list[input1-expected1] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_cluster_dump.py PASSED [ 49%] 1099s tests/test_cluster_dump.py::test_tuple_to_list[input2-expected2] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_cluster_dump.py PASSED [ 49%] 1099s tests/test_cluster_dump.py::test_tuple_to_list[foo-foo] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_cluster_dump.py PASSED [ 49%] 1099s tests/test_cluster_dump.py::test_write_state_msgpack <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_cluster_dump.py PASSED [ 49%] 1099s tests/test_cluster_dump.py::test_write_state_yaml <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_cluster_dump.py PASSED [ 49%] 1100s tests/test_cluster_dump.py::test_cluster_dump_state <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_cluster_dump.py PASSED [ 49%] 1100s tests/test_cluster_dump.py::test_cluster_dump_story <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_cluster_dump.py PASSED [ 49%] 1100s tests/test_cluster_dump.py::test_cluster_dump_to_yamls <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_cluster_dump.py PASSED [ 49%] 1100s tests/test_collections.py::test_lru <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_collections.py PASSED [ 49%] 1100s tests/test_collections.py::test_heapset <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_collections.py PASSED [ 49%] 1100s tests/test_collections.py::test_heapset_sorted_flag_left <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_collections.py PASSED [ 49%] 1100s tests/test_collections.py::test_heapset_sorted_flag_right <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_collections.py PASSED [ 49%] 1100s tests/test_collections.py::test_heapset_popright[False] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_collections.py PASSED [ 49%] 1100s tests/test_collections.py::test_heapset_popright[True] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_collections.py PASSED [ 49%] 1100s tests/test_collections.py::test_heapset_pickle <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_collections.py PASSED [ 50%] 1100s tests/test_collections.py::test_heapset_sort_duplicate <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_collections.py PASSED [ 50%] 1100s tests/test_collections.py::test_sum_mappings <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_collections.py PASSED [ 50%] 1100s tests/test_compatibility.py::test_randbytes <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_compatibility.py PASSED [ 50%] 1100s tests/test_compatibility.py::test_randbytes_seed <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_compatibility.py PASSED [ 50%] 1100s tests/test_computations.py::test_computations <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_computations.py PASSED [ 50%] 1100s tests/test_computations.py::test_computations_futures <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_computations.py PASSED [ 50%] 1100s tests/test_computations.py::test_computations_no_workers <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_computations.py PASSED [ 50%] 1101s tests/test_computations.py::test_computations_no_resources <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_computations.py PASSED [ 50%] 1101s tests/test_computations.py::test_computations_long_running <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_computations.py PASSED [ 50%] 1101s tests/test_config.py::test_logging_default[config0] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_config.py PASSED [ 50%] 1101s tests/test_config.py::test_logging_default[None] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_config.py PASSED [ 50%] 1102s tests/test_config.py::test_logging_simple_under_distributed <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_config.py PASSED [ 50%] 1103s tests/test_config.py::test_logging_simple <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_config.py PASSED [ 50%] 1104s tests/test_config.py::test_logging_extended <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_config.py PASSED [ 50%] 1104s tests/test_config.py::test_default_logging_does_not_override_basic_config <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_config.py PASSED [ 50%] 1105s tests/test_config.py::test_basic_config_does_not_override_default_logging <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_config.py PASSED [ 50%] 1105s tests/test_config.py::test_logging_mutual_exclusive <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_config.py PASSED [ 50%] 1106s tests/test_config.py::test_logging_file_config <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_config.py PASSED [ 50%] 1106s tests/test_config.py::test_schema <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_config.py PASSED [ 50%] 1106s tests/test_config.py::test_schema_is_complete <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_config.py PASSED [ 50%] 1106s tests/test_config.py::test_uvloop_event_loop <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_config.py SKIPPED [ 50%] 1106s tests/test_config.py::test_deprecations_on_set[args0-kwargs0] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_config.py PASSED [ 50%] 1106s tests/test_config.py::test_deprecations_on_set[args1-kwargs1] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_config.py PASSED [ 50%] 1106s tests/test_config.py::test_deprecations_on_set[args2-kwargs2] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_config.py PASSED [ 50%] 1106s tests/test_config.py::test_deprecations_on_env_variables <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_config.py PASSED [ 50%] 1106s tests/test_config.py::test_deprecations_on_yaml[allowed-failures] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_config.py PASSED [ 50%] 1106s tests/test_config.py::test_deprecations_on_yaml[allowed_failures] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_config.py PASSED [ 50%] 1106s tests/test_core.py::test_server_status_is_always_enum <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_core.py PASSED [ 50%] 1106s tests/test_core.py::test_server_assign_assign_enum_is_quiet <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_core.py PASSED [ 50%] 1106s tests/test_core.py::test_server_status_compare_enum_is_quiet <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_core.py PASSED [ 50%] 1106s tests/test_core.py::test_server_close_stops_gil_monitoring <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_core.py SKIPPED [ 50%] 1106s tests/test_core.py::test_server <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_core.py PASSED [ 50%] 1106s tests/test_core.py::test_server_raises_on_blocked_handlers <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_core.py PASSED [ 50%] 1108s tests/test_core.py::test_server_listen <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_core.py PASSED [ 50%] 1108s tests/test_core.py::test_rpc_default <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_core.py PASSED [ 50%] 1108s tests/test_core.py::test_rpc_tcp <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_core.py PASSED [ 51%] 1108s tests/test_core.py::test_rpc_tls <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_core.py PASSED [ 51%] 1108s tests/test_core.py::test_rpc_inproc <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_core.py PASSED [ 51%] 1108s tests/test_core.py::test_rpc_inputs <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_core.py PASSED [ 51%] 1108s tests/test_core.py::test_rpc_message_lifetime_default <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_core.py PASSED [ 51%] 1108s tests/test_core.py::test_rpc_message_lifetime_tcp <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_core.py PASSED [ 51%] 1108s tests/test_core.py::test_rpc_message_lifetime_inproc <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_core.py PASSED [ 51%] 1108s tests/test_core.py::test_rpc_with_many_connections_tcp <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_core.py PASSED [ 51%] 1108s tests/test_core.py::test_rpc_with_many_connections_inproc <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_core.py PASSED [ 51%] 1110s tests/test_core.py::test_large_packets_tcp <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_core.py PASSED [ 51%] 1110s tests/test_core.py::test_large_packets_inproc <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_core.py PASSED [ 51%] 1110s tests/test_core.py::test_identity_tcp <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_core.py PASSED [ 51%] 1110s tests/test_core.py::test_identity_inproc <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_core.py PASSED [ 51%] 1110s tests/test_core.py::test_ports <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_core.py PASSED [ 51%] 1110s tests/test_core.py::test_errors <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_core.py PASSED [ 51%] 1110s tests/test_core.py::test_connect_raises <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_core.py PASSED [ 51%] 1110s tests/test_core.py::test_send_recv_args <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_core.py PASSED [ 51%] 1111s tests/test_core.py::test_send_recv_cancelled <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_core.py PASSED [ 51%] 1111s tests/test_core.py::test_coerce_to_address <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_core.py PASSED [ 51%] 1111s tests/test_core.py::test_connection_pool <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_core.py PASSED [ 51%] 1111s tests/test_core.py::test_connection_pool_close_while_connecting <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_core.py PASSED [ 51%] 1111s tests/test_core.py::test_connection_pool_outside_cancellation <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_core.py PASSED [ 51%] 1117s tests/test_core.py::test_connection_pool_catch_all_cancellederrors <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_core.py PASSED [ 51%] 1117s tests/test_core.py::test_remove_cancels_connect_attempts <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_core.py PASSED [ 51%] 1117s tests/test_core.py::test_remove_cancels_connect_before_task_running <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_core.py PASSED [ 51%] 1118s tests/test_core.py::test_connection_pool_respects_limit <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_core.py PASSED [ 51%] 1118s tests/test_core.py::test_connection_pool_tls <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_core.py PASSED [ 51%] 1118s tests/test_core.py::test_connection_pool_remove <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_core.py PASSED [ 51%] 1118s tests/test_core.py::test_counters <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_core.py PASSED [ 51%] 1118s tests/test_core.py::test_ticks <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_core.py SKIPPED [ 51%] 1118s tests/test_core.py::test_tick_logging <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_core.py SKIPPED [ 51%] 1118s tests/test_core.py::test_compression[echo_serialize-None] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_core.py PASSED [ 51%] 1118s tests/test_core.py::test_compression[echo_serialize-False] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_core.py PASSED [ 51%] 1118s tests/test_core.py::test_compression[echo_serialize-auto] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_core.py PASSED [ 51%] 1118s tests/test_core.py::test_compression[echo_serialize-zlib] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_core.py PASSED [ 51%] 1118s tests/test_core.py::test_compression[echo_serialize-lz4] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_core.py PASSED [ 51%] 1118s tests/test_core.py::test_compression[echo_no_serialize-None] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_core.py PASSED [ 52%] 1118s tests/test_core.py::test_compression[echo_no_serialize-False] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_core.py PASSED [ 52%] 1118s tests/test_core.py::test_compression[echo_no_serialize-auto] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_core.py PASSED [ 52%] 1118s tests/test_core.py::test_compression[echo_no_serialize-zlib] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_core.py PASSED [ 52%] 1118s tests/test_core.py::test_compression[echo_no_serialize-lz4] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_core.py PASSED [ 52%] 1118s tests/test_core.py::test_rpc_serialization <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_core.py PASSED [ 52%] 1118s tests/test_core.py::test_rpc_closed_exception <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_core.py PASSED [ 52%] 1118s tests/test_core.py::test_thread_id <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_core.py PASSED [ 52%] 1118s tests/test_core.py::test_deserialize_error <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_core.py PASSED [ 52%] 1118s tests/test_core.py::test_connection_pool_detects_remote_close <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_core.py PASSED [ 52%] 1120s tests/test_core.py::test_close_properly <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_core.py PASSED [ 52%] 1120s tests/test_core.py::test_server_redundant_kwarg <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_core.py PASSED [ 52%] 1120s tests/test_core.py::test_server_comms_mark_active_handlers <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_core.py PASSED [ 52%] 1120s tests/test_core.py::test_server_sys_path_local_directory_cleanup <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_core.py PASSED [ 52%] 1120s tests/test_core.py::test_close_fast_without_active_handlers[True] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_core.py PASSED [ 52%] 1120s tests/test_core.py::test_close_fast_without_active_handlers[False] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_core.py PASSED [ 52%] 1120s tests/test_core.py::test_close_grace_period_for_handlers <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_core.py PASSED [ 52%] 1120s tests/test_core.py::test_expects_comm <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_core.py PASSED [ 52%] 1120s tests/test_core.py::test_async_listener_stop <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_core.py PASSED [ 52%] 1121s tests/test_core.py::test_messages_are_ordered_bsend <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_core.py PASSED [ 52%] 1121s tests/test_core.py::test_messages_are_ordered_raw <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_core.py PASSED [ 52%] 1131s tests/test_core.py::test_large_payload <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_core.py PASSED [ 52%] 1131s tests/test_counter.py::test_digest[Counter-] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_counter.py PASSED [ 52%] 1131s tests/test_counter.py::test_digest[None-] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_counter.py SKIPPED [ 52%] 1131s tests/test_counter.py::test_counter <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_counter.py PASSED [ 52%] 1132s tests/test_dask_collections.py::test_dataframes <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_dask_collections.py PASSED [ 52%] 1132s tests/test_dask_collections.py::test_dask_array_collections <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_dask_collections.py PASSED [ 52%] 1132s tests/test_dask_collections.py::test_bag_groupby_tasks_default <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_dask_collections.py PASSED [ 52%] 1134s tests/test_dask_collections.py::test_bag_groupby_key_hashing <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_dask_collections.py PASSED [ 52%] 1137s tests/test_dask_collections.py::test_dataframe_set_index_sync[wait] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_dask_collections.py PASSED [ 52%] 1140s tests/test_dask_collections.py::test_dataframe_set_index_sync[] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_dask_collections.py PASSED [ 52%] 1142s tests/test_dask_collections.py::test_loc_sync <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_dask_collections.py PASSED [ 52%] 1144s tests/test_dask_collections.py::test_rolling_sync <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_dask_collections.py PASSED [ 52%] 1144s tests/test_dask_collections.py::test_loc <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_dask_collections.py PASSED [ 52%] 1148s tests/test_dask_collections.py::test_dataframe_groupby_tasks <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_dask_collections.py PASSED [ 52%] 1148s tests/test_dask_collections.py::test_sparse_arrays <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_dask_collections.py SKIPPED [ 52%] 1148s tests/test_dask_collections.py::test_delayed_none <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_dask_collections.py PASSED [ 52%] 1150s tests/test_dask_collections.py::test_tuple_futures_arg[tuple] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_dask_collections.py PASSED [ 53%] 1153s tests/test_dask_collections.py::test_tuple_futures_arg[list] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_dask_collections.py PASSED [ 53%] 1153s tests/test_deadline.py::test_deadline <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_deadline.py PASSED [ 53%] 1153s tests/test_deadline.py::test_infinite_deadline <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_deadline.py PASSED [ 53%] 1153s tests/test_deadline.py::test_deadline_progress <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_deadline.py PASSED [ 53%] 1153s tests/test_deadline.py::test_deadline_expiration <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_deadline.py PASSED [ 53%] 1153s tests/test_deadline.py::test_deadline_expiration_async <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_deadline.py PASSED [ 53%] 1154s tests/test_diskutils.py::test_workdir_simple <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_diskutils.py PASSED [ 53%] 1157s tests/test_diskutils.py::test_two_workspaces_in_same_directory <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_diskutils.py PASSED [ 53%] 1157s tests/test_diskutils.py::test_workspace_process_crash <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_diskutils.py PASSED [ 53%] 1157s tests/test_diskutils.py::test_workspace_rmtree_failure <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_diskutils.py PASSED [ 53%] 1158s tests/test_diskutils.py::test_locking_disabled <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_diskutils.py PASSED [ 53%] 1174s tests/test_diskutils.py::test_workspace_concurrency <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_diskutils.py PASSED [ 53%] 1174s tests/test_diskutils.py::test_unwritable_base_dir <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_diskutils.py PASSED [ 53%] 1174s tests/test_event_logging.py::test_log_event <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_event_logging.py PASSED [ 53%] 1174s tests/test_event_logging.py::test_log_events <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_event_logging.py PASSED [ 53%] 1174s tests/test_event_logging.py::test_log_event_e2e <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_event_logging.py PASSED [ 53%] 1174s tests/test_event_logging.py::test_log_event_multiple_clients <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_event_logging.py PASSED [ 53%] 1174s tests/test_event_logging.py::test_events_subscribe_topic <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_event_logging.py PASSED [ 53%] 1175s tests/test_event_logging.py::test_events_subscribe_topic_cancelled <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_event_logging.py PASSED [ 53%] 1175s tests/test_event_logging.py::test_topic_subscribe_unsubscribe <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_event_logging.py PASSED [ 53%] 1176s tests/test_event_logging.py::test_events_all_servers_use_same_channel <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_event_logging.py PASSED [ 53%] 1176s tests/test_event_logging.py::test_events_unsubscribe_raises_if_unknown <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_event_logging.py PASSED [ 53%] 1178s tests/test_event_logging.py::test_log_event_msgpack <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_event_logging.py PASSED [ 53%] 1178s tests/test_event_logging.py::test_configurable_events_log_length <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_event_logging.py PASSED [ 53%] 1179s tests/test_event_logging.py::test_log_event_on_nanny <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_event_logging.py PASSED [ 53%] 1179s tests/test_event_logging.py::test_log_event_on_worker <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_event_logging.py PASSED [ 53%] 1179s tests/test_event_logging.py::test_log_event_plugin <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_event_logging.py PASSED [ 53%] 1179s tests/test_event_logging.py::test_log_event_plugin_multiple_topics <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_event_logging.py PASSED [ 53%] 1180s tests/test_events.py::test_event_on_workers <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_events.py PASSED [ 53%] 1180s tests/test_events.py::test_default_event <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_events.py PASSED [ 53%] 1180s tests/test_events.py::test_set_not_set <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_events.py PASSED [ 53%] 1180s tests/test_events.py::test_set_not_set_many_events <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_events.py PASSED [ 53%] 1180s tests/test_events.py::test_timeout <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_events.py PASSED [ 53%] 1182s tests/test_events.py::test_event_sync <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_events.py PASSED [ 53%] 1182s tests/test_events.py::test_event_types <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_events.py PASSED [ 53%] 1183s tests/test_events.py::test_serializable <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_events.py PASSED [ 54%] 1183s tests/test_events.py::test_two_events_on_workers <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_events.py PASSED [ 54%] 1183s tests/test_events.py::test_unpickle_without_client <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_events.py PASSED [ 54%] 1185s tests/test_failed_workers.py::test_submit_after_failed_worker_sync <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_failed_workers.py PASSED [ 54%] 1185s tests/test_failed_workers.py::test_submit_after_failed_worker_async[False-False-closing] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_failed_workers.py PASSED [ 54%] 1185s tests/test_failed_workers.py::test_submit_after_failed_worker_async[False-False-closed] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_failed_workers.py PASSED [ 54%] 1185s tests/test_failed_workers.py::test_submit_after_failed_worker_async[False-True-closing] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_failed_workers.py PASSED [ 54%] 1186s tests/test_failed_workers.py::test_submit_after_failed_worker_async[False-True-closed] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_failed_workers.py PASSED [ 54%] 1186s tests/test_failed_workers.py::test_submit_after_failed_worker_async[True-False-closing] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_failed_workers.py PASSED [ 54%] 1186s tests/test_failed_workers.py::test_submit_after_failed_worker_async[True-False-closed] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_failed_workers.py PASSED [ 54%] 1186s tests/test_failed_workers.py::test_submit_after_failed_worker_async[True-True-closing] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_failed_workers.py PASSED [ 54%] 1186s tests/test_failed_workers.py::test_submit_after_failed_worker_async[True-True-closed] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_failed_workers.py PASSED [ 54%] 1186s tests/test_failed_workers.py::test_submit_after_failed_worker <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_failed_workers.py PASSED [ 54%] 1188s tests/test_failed_workers.py::test_gather_after_failed_worker <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_failed_workers.py PASSED [ 54%] 1191s tests/test_failed_workers.py::test_gather_then_submit_after_failed_workers <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_failed_workers.py PASSED [ 54%] 1194s tests/test_failed_workers.py::test_restart <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_failed_workers.py PASSED [ 54%] 1197s tests/test_failed_workers.py::test_restart_cleared <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_failed_workers.py PASSED [ 54%] 1201s tests/test_failed_workers.py::test_restart_sync <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_failed_workers.py PASSED [ 54%] 1208s tests/test_failed_workers.py::test_worker_doesnt_await_task_completion <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_failed_workers.py PASSED [ 54%] 1211s tests/test_failed_workers.py::test_multiple_clients_restart <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_failed_workers.py PASSED [ 54%] 1214s tests/test_failed_workers.py::test_restart_scheduler <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_failed_workers.py PASSED [ 54%] 1216s tests/test_failed_workers.py::test_forgotten_futures_dont_clean_up_new_futures <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_failed_workers.py PASSED [ 54%] 1224s tests/test_failed_workers.py::test_broken_worker_during_computation <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_failed_workers.py PASSED [ 54%] 1228s tests/test_failed_workers.py::test_restart_during_computation <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_failed_workers.py PASSED [ 54%] 1231s tests/test_failed_workers.py::test_worker_who_has_clears_after_failed_connection <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_failed_workers.py PASSED [ 54%] 1232s tests/test_failed_workers.py::test_worker_same_host_replicas_missing <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_failed_workers.py PASSED [ 54%] 1238s tests/test_failed_workers.py::test_restart_timeout_on_long_running_task <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_failed_workers.py PASSED [ 54%] 1244s tests/test_failed_workers.py::test_worker_time_to_live <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_failed_workers.py PASSED [ 54%] 1252s tests/test_failed_workers.py::test_worker_ttl_restarts_worker[False] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_failed_workers.py PASSED [ 54%] 1264s tests/test_failed_workers.py::test_worker_ttl_restarts_worker[True] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_failed_workers.py PASSED [ 54%] 1270s tests/test_failed_workers.py::test_restart_hung_worker <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_failed_workers.py PASSED [ 54%] 1270s tests/test_failed_workers.py::test_forget_data_not_supposed_to_have <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_failed_workers.py PASSED [ 54%] 1272s tests/test_failed_workers.py::test_failing_worker_with_additional_replicas_on_cluster <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_failed_workers.py PASSED [ 54%] 1272s tests/test_gc.py::test_fractional_timer <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_gc.py PASSED [ 54%] 1290s tests/test_gc.py::test_gc_diagnosis_cpu_time <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_gc.py PASSED [ 54%] 1293s tests/test_gc.py::test_gc_diagnosis_rss_win <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_gc.py XFAIL [ 54%] 1295s tests/test_imports.py::test_can_import_distributed_in_background_thread <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_imports.py PASSED [ 55%] 1295s tests/test_init.py::test_version <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_init.py PASSED [ 55%] 1295s tests/test_itertools.py::test_ffill <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_itertools.py PASSED [ 55%] 1296s tests/test_jupyter.py::test_jupyter_cli <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_jupyter.py PASSED [ 55%] 1297s tests/test_locks.py::test_lock <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_locks.py PASSED [ 55%] 1297s tests/test_locks.py::test_timeout <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_locks.py PASSED [ 55%] 1297s tests/test_locks.py::test_acquires_with_zero_timeout <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_locks.py PASSED [ 55%] 1297s tests/test_locks.py::test_acquires_blocking <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_locks.py PASSED [ 55%] 1299s tests/test_locks.py::test_timeout_sync <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_locks.py PASSED [ 55%] 1299s tests/test_locks.py::test_errors <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_locks.py PASSED [ 55%] 1301s tests/test_locks.py::test_lock_sync <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_locks.py PASSED [ 55%] 1301s tests/test_locks.py::test_lock_types <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_locks.py PASSED [ 55%] 1301s tests/test_locks.py::test_serializable <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_locks.py PASSED [ 55%] 1302s tests/test_locks.py::test_serializable_no_ctx <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_locks.py PASSED [ 55%] 1302s tests/test_locks.py::test_locks <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_locks.py PASSED [ 55%] 1302s tests/test_locks.py::test_locks_inf_lease_timeout <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_locks.py PASSED [ 55%] 1302s tests/test_metrics.py::test_wall_clock[time] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_metrics.py PASSED [ 55%] 1302s tests/test_metrics.py::test_wall_clock[monotonic] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_metrics.py PASSED [ 55%] 1302s tests/test_metrics.py::test_monotonic <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_metrics.py SKIPPED [ 55%] 1302s tests/test_metrics.py::test_meter <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_metrics.py PASSED [ 55%] 1302s tests/test_metrics.py::test_meter_raise <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_metrics.py PASSED [ 55%] 1302s tests/test_metrics.py::test_meter_floor[kwargs0-0] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_metrics.py PASSED [ 55%] 1302s tests/test_metrics.py::test_meter_floor[kwargs1-0.1] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_metrics.py PASSED [ 55%] 1302s tests/test_metrics.py::test_meter_floor[kwargs2--1] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_metrics.py PASSED [ 55%] 1302s tests/test_metrics.py::test_context_meter <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_metrics.py PASSED [ 55%] 1302s tests/test_metrics.py::test_context_meter_raise <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_metrics.py PASSED [ 55%] 1302s tests/test_metrics.py::test_context_meter_nested <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_metrics.py PASSED [ 55%] 1302s tests/test_metrics.py::test_context_meter_decorator <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_metrics.py PASSED [ 55%] 1302s tests/test_metrics.py::test_context_meter_nested_floor <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_metrics.py PASSED [ 55%] 1302s tests/test_metrics.py::test_context_meter_pickle <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_metrics.py PASSED [ 55%] 1302s tests/test_metrics.py::test_context_meter_clear_callbacks <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_metrics.py PASSED [ 55%] 1302s tests/test_metrics.py::test_context_meter_clear_callbacks_raises <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_metrics.py PASSED [ 55%] 1302s tests/test_metrics.py::test_context_meter_allow_offload <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_metrics.py PASSED [ 55%] 1302s tests/test_metrics.py::test_delayed_metrics_ledger <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_metrics.py PASSED [ 55%] 1302s tests/test_metrics.py::test_context_meter_keyed <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_metrics.py PASSED [ 55%] 1302s tests/test_metrics.py::test_delayed_metrics_ledger_keyed <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_metrics.py PASSED [ 55%] 1303s tests/test_multi_locks.py::test_single_lock <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_multi_locks.py PASSED [ 56%] 1303s tests/test_multi_locks.py::test_timeout <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_multi_locks.py PASSED [ 56%] 1304s tests/test_multi_locks.py::test_timeout_wake_waiter <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_multi_locks.py PASSED [ 56%] 1304s tests/test_multi_locks.py::test_multiple_locks <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_multi_locks.py PASSED [ 56%] 1304s tests/test_multi_locks.py::test_num_locks <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_multi_locks.py PASSED [ 56%] 1306s tests/test_nanny.py::test_str <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 56%] 1308s tests/test_nanny.py::test_nanny_process_failure <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 56%] 1309s tests/test_nanny.py::test_run <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 56%] 1310s tests/test_nanny.py::test_no_hang_when_scheduler_closes <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 56%] 1314s tests/test_nanny.py::test_close_on_disconnect <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 56%] 1315s tests/test_nanny.py::test_nanny_worker_class <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 56%] 1317s tests/test_nanny.py::test_nanny_alt_worker_class <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 56%] 1318s tests/test_nanny.py::test_nanny_death_timeout <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 56%] 1319s tests/test_nanny.py::test_random_seed <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 56%] 1325s tests/test_nanny.py::test_num_fds <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 56%] 1328s tests/test_nanny.py::test_worker_uses_same_host_as_nanny <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 56%] 1329s tests/test_nanny.py::test_scheduler_file <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 56%] 1331s tests/test_nanny.py::test_nanny_restart <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 56%] 1334s tests/test_nanny.py::test_nanny_restart_timeout <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 56%] 1336s tests/test_nanny.py::test_nanny_restart_timeout_stress <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 56%] 1337s tests/test_nanny.py::test_throttle_outgoing_transfers <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 56%] 1338s tests/test_nanny.py::test_scheduler_address_config <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 56%] 1344s tests/test_nanny.py::test_wait_for_scheduler <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 56%] 1345s tests/test_nanny.py::test_environment_variable <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 56%] 1347s tests/test_nanny.py::test_environment_variable_by_config <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 56%] 1348s tests/test_nanny.py::test_environment_variable_config <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 56%] 1349s tests/test_nanny.py::test_environment_variable_pre_post_spawn <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 56%] 1351s tests/test_nanny.py::test_environment_variable_overlay <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 56%] 1352s tests/test_nanny.py::test_config_param_overlays <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 56%] 1353s tests/test_nanny.py::test_local_directory <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 56%] 1355s tests/test_nanny.py::test_unwriteable_dask_worker_space <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 56%] 1357s tests/test_nanny.py::test_mp_process_worker_no_daemon <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 56%] 1360s tests/test_nanny.py::test_mp_pool_worker_no_daemon <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 56%] 1362s tests/test_nanny.py::test_nanny_closes_cleanly <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 56%] 1368s tests/test_nanny.py::test_lifetime <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 56%] 1371s tests/test_nanny.py::test_nanny_closes_cleanly_if_worker_is_terminated <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 56%] 1372s tests/test_nanny.py::test_config <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 56%] 1375s tests/test_nanny.py::test_nanny_port_range <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 57%] 1375s tests/test_nanny.py::test_nanny_closed_by_keyboard_interrupt[tcp] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py SKIPPED [ 57%] 1375s tests/test_nanny.py::test_nanny_closed_by_keyboard_interrupt[ucx] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py SKIPPED [ 57%] 1376s tests/test_nanny.py::test_worker_start_exception <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 57%] 1377s tests/test_nanny.py::test_worker_start_exception_while_killing <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 57%] 1378s tests/test_nanny.py::test_failure_during_worker_initialization <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 57%] 1382s tests/test_nanny.py::test_environ_plugin <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 57%] 1383s tests/test_nanny.py::test_no_unnecessary_imports_on_worker[scipy] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 57%] 1384s tests/test_nanny.py::test_no_unnecessary_imports_on_worker[pandas] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py XFAIL [ 57%] 1390s tests/test_nanny.py::test_repeated_restarts <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 57%] 1395s tests/test_nanny.py::test_restart_memory <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 57%] 1400s tests/test_nanny.py::test_close_joins <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 57%] 1404s tests/test_nanny.py::test_scheduler_crash_doesnt_restart <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 57%] 1409s tests/test_nanny.py::test_malloc_trim_threshold <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 57%] 1410s tests/test_nanny.py::test_default_client_does_not_propagate_to_subprocess <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 57%] 1412s tests/test_nanny.py::test_worker_inherits_temp_config <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 57%] 1414s tests/test_nanny.py::test_nanny_plugin_simple <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 57%] 1417s tests/test_nanny.py::test_nanny_plugin_register_during_start_success[True] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 57%] 1418s tests/test_nanny.py::test_nanny_plugin_register_during_start_success[False] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 57%] 1418s tests/test_nanny.py::test_nanny_plugin_register_during_start_failure[True] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 57%] 1418s tests/test_nanny.py::test_nanny_plugin_register_during_start_failure[False] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 57%] 1420s tests/test_nanny.py::test_nanny_plugin_register_nanny_killed[True] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 57%] 1421s tests/test_nanny.py::test_nanny_plugin_register_nanny_killed[False] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 57%] 1422s tests/test_preload.py::test_worker_preload_file <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_preload.py PASSED [ 57%] 1422s tests/test_preload.py::test_worker_preload_text <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_preload.py PASSED [ 57%] 1422s tests/test_preload.py::test_preload_manager_sequence <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_preload.py PASSED [ 57%] 1424s tests/test_preload.py::test_worker_preload_config <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_preload.py PASSED [ 57%] 1425s tests/test_preload.py::test_worker_preload_module <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_preload.py PASSED [ 57%] 1426s tests/test_preload.py::test_worker_preload_click <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_preload.py PASSED [ 57%] 1426s tests/test_preload.py::test_worker_preload_click_async <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_preload.py PASSED [ 57%] 1427s tests/test_preload.py::test_preload_import_time <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_preload.py PASSED [ 57%] 1427s tests/test_preload.py::test_web_preload <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_preload.py PASSED [ 57%] 1427s tests/test_preload.py::test_scheduler_startup <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_preload.py PASSED [ 57%] 1428s tests/test_preload.py::test_scheduler_startup_nanny <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_preload.py PASSED [ 57%] 1429s tests/test_preload.py::test_web_preload_worker <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_preload.py PASSED [ 57%] 1430s tests/test_preload.py::test_client_preload_text <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_preload.py XFAIL [ 57%] 1430s tests/test_preload.py::test_client_preload_config <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_preload.py PASSED [ 58%] 1430s tests/test_preload.py::test_client_preload_click <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_preload.py XFAIL [ 58%] 1430s tests/test_preload.py::test_failure_doesnt_crash_scheduler <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_preload.py PASSED [ 58%] 1430s tests/test_preload.py::test_failure_doesnt_crash_worker <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_preload.py PASSED [ 58%] 1431s tests/test_preload.py::test_failure_doesnt_crash_nanny <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_preload.py PASSED [ 58%] 1431s tests/test_preload.py::test_failure_doesnt_crash_client <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_preload.py PASSED [ 58%] 1431s tests/test_preload.py::test_client_preload_config_click <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_preload.py PASSED [ 58%] 1431s tests/test_priorities.py::test_submit[queue on worker] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_priorities.py PASSED [ 58%] 1432s tests/test_priorities.py::test_submit[queue on scheduler] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_priorities.py PASSED [ 58%] 1432s tests/test_priorities.py::test_map[queue on worker] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_priorities.py PASSED [ 58%] 1432s tests/test_priorities.py::test_map[queue on scheduler] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_priorities.py PASSED [ 58%] 1432s tests/test_priorities.py::test_compute[queue on worker] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_priorities.py PASSED [ 58%] 1432s tests/test_priorities.py::test_compute[queue on scheduler] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_priorities.py PASSED [ 58%] 1432s tests/test_priorities.py::test_persist[queue on worker] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_priorities.py PASSED [ 58%] 1432s tests/test_priorities.py::test_persist[queue on scheduler] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_priorities.py PASSED [ 58%] 1432s tests/test_priorities.py::test_annotate_compute[queue on worker] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_priorities.py PASSED [ 58%] 1433s tests/test_priorities.py::test_annotate_compute[queue on scheduler] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_priorities.py PASSED [ 58%] 1433s tests/test_priorities.py::test_annotate_persist[queue on worker] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_priorities.py PASSED [ 58%] 1433s tests/test_priorities.py::test_annotate_persist[queue on scheduler] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_priorities.py PASSED [ 58%] 1433s tests/test_priorities.py::test_repeated_persists_same_priority[queue on worker] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_priorities.py PASSED [ 58%] 1434s tests/test_priorities.py::test_repeated_persists_same_priority[queue on scheduler] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_priorities.py PASSED [ 58%] 1434s tests/test_priorities.py::test_last_in_first_out[queue on worker] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_priorities.py PASSED [ 58%] 1435s tests/test_priorities.py::test_last_in_first_out[queue on scheduler] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_priorities.py PASSED [ 58%] 1437s tests/test_profile.py::test_basic <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py PASSED [ 58%] 1437s tests/test_profile.py::test_basic_low_level <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py SKIPPED [ 58%] 1437s tests/test_profile.py::test_merge <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py PASSED [ 58%] 1437s tests/test_profile.py::test_merge_empty <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py PASSED [ 58%] 1437s tests/test_profile.py::test_call_stack <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py PASSED [ 58%] 1437s tests/test_profile.py::test_identifier <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py PASSED [ 58%] 1437s tests/test_profile.py::test_watch <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py PASSED [ 58%] 1438s tests/test_profile.py::test_watch_requires_lock_to_run <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py PASSED [ 58%] 1438s tests/test_profile.py::test_info_frame_f_lineno[-1-1] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py PASSED [ 58%] 1438s tests/test_profile.py::test_info_frame_f_lineno[0-2] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py PASSED [ 58%] 1438s tests/test_profile.py::test_info_frame_f_lineno[1-2] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py PASSED [ 58%] 1438s tests/test_profile.py::test_info_frame_f_lineno[11-2] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py PASSED [ 58%] 1438s tests/test_profile.py::test_info_frame_f_lineno[12-3] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py PASSED [ 58%] 1438s tests/test_profile.py::test_info_frame_f_lineno[21-4] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py PASSED [ 59%] 1438s tests/test_profile.py::test_info_frame_f_lineno[22-4] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py PASSED [ 59%] 1438s tests/test_profile.py::test_info_frame_f_lineno[23-4] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py PASSED [ 59%] 1438s tests/test_profile.py::test_info_frame_f_lineno[24-2] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py PASSED [ 59%] 1438s tests/test_profile.py::test_info_frame_f_lineno[25-2] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py PASSED [ 59%] 1438s tests/test_profile.py::test_info_frame_f_lineno[26-2] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py PASSED [ 59%] 1438s tests/test_profile.py::test_info_frame_f_lineno[27-2] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py PASSED [ 59%] 1438s tests/test_profile.py::test_info_frame_f_lineno[100-2] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py PASSED [ 59%] 1438s tests/test_profile.py::test_call_stack_f_lineno[-1-1] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py PASSED [ 59%] 1438s tests/test_profile.py::test_call_stack_f_lineno[0-2] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py PASSED [ 59%] 1438s tests/test_profile.py::test_call_stack_f_lineno[1-2] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py PASSED [ 59%] 1438s tests/test_profile.py::test_call_stack_f_lineno[11-2] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py PASSED [ 59%] 1438s tests/test_profile.py::test_call_stack_f_lineno[12-3] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py PASSED [ 59%] 1438s tests/test_profile.py::test_call_stack_f_lineno[21-4] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py PASSED [ 59%] 1438s tests/test_profile.py::test_call_stack_f_lineno[22-4] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py PASSED [ 59%] 1438s tests/test_profile.py::test_call_stack_f_lineno[23-4] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py PASSED [ 59%] 1438s tests/test_profile.py::test_call_stack_f_lineno[24-2] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py PASSED [ 59%] 1438s tests/test_profile.py::test_call_stack_f_lineno[25-2] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py PASSED [ 59%] 1438s tests/test_profile.py::test_call_stack_f_lineno[26-2] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py PASSED [ 59%] 1438s tests/test_profile.py::test_call_stack_f_lineno[27-2] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py PASSED [ 59%] 1438s tests/test_profile.py::test_call_stack_f_lineno[100-2] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py PASSED [ 59%] 1438s tests/test_profile.py::test_builtin <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py PASSED [ 59%] 1438s tests/test_publish.py::test_publish_simple <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_publish.py PASSED [ 59%] 1438s tests/test_publish.py::test_publish_non_string_key <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_publish.py PASSED [ 59%] 1438s tests/test_publish.py::test_publish_roundtrip <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_publish.py PASSED [ 59%] 1438s tests/test_publish.py::test_unpublish <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_publish.py PASSED [ 59%] 1440s tests/test_publish.py::test_unpublish_sync <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_publish.py PASSED [ 59%] 1440s tests/test_publish.py::test_publish_multiple_datasets <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_publish.py PASSED [ 59%] 1442s tests/test_publish.py::test_unpublish_multiple_datasets_sync <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_publish.py PASSED [ 59%] 1442s tests/test_publish.py::test_publish_bag <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_publish.py PASSED [ 59%] 1443s tests/test_publish.py::test_datasets_setitem <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_publish.py PASSED [ 59%] 1445s tests/test_publish.py::test_datasets_getitem <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_publish.py PASSED [ 59%] 1447s tests/test_publish.py::test_datasets_getitem_default <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_publish.py PASSED [ 59%] 1449s tests/test_publish.py::test_datasets_delitem <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_publish.py PASSED [ 59%] 1450s tests/test_publish.py::test_datasets_keys <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_publish.py PASSED [ 59%] 1452s tests/test_publish.py::test_datasets_contains <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_publish.py PASSED [ 59%] 1454s tests/test_publish.py::test_datasets_republish <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_publish.py PASSED [ 60%] 1455s tests/test_publish.py::test_datasets_iter <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_publish.py PASSED [ 60%] 1455s tests/test_publish.py::test_datasets_async <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_publish.py PASSED [ 60%] 1456s tests/test_publish.py::test_pickle_safe <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_publish.py PASSED [ 60%] 1456s tests/test_publish.py::test_deserialize_client <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_publish.py PASSED [ 60%] 1456s tests/test_publish.py::test_publish_submit_ordering <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_publish.py PASSED [ 60%] 1456s tests/test_pubsub.py::test_speed <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_pubsub.py PASSED [ 60%] 1456s tests/test_pubsub.py::test_client <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_pubsub.py PASSED [ 60%] 1456s tests/test_pubsub.py::test_timeouts <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_pubsub.py PASSED [ 60%] 1456s tests/test_pubsub.py::test_repr <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_pubsub.py PASSED [ 60%] 1457s tests/test_pubsub.py::test_basic <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_pubsub.py XPASS [ 60%] 1457s tests/test_queues.py::test_queue <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_queues.py PASSED [ 60%] 1457s tests/test_queues.py::test_queue_with_data <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_queues.py PASSED [ 60%] 1459s tests/test_queues.py::test_sync <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_queues.py PASSED [ 60%] 1459s tests/test_queues.py::test_hold_futures <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_queues.py PASSED [ 60%] 1459s tests/test_queues.py::test_picklability <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_queues.py PASSED [ 60%] 1461s tests/test_queues.py::test_picklability_sync <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_queues.py PASSED [ 60%] 1466s tests/test_queues.py::test_race <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_queues.py PASSED [ 60%] 1466s tests/test_queues.py::test_same_futures <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_queues.py PASSED [ 60%] 1466s tests/test_queues.py::test_get_many <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_queues.py PASSED [ 60%] 1466s tests/test_queues.py::test_Future_knows_status_immediately <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_queues.py PASSED [ 60%] 1466s tests/test_queues.py::test_erred_future <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_queues.py PASSED [ 60%] 1466s tests/test_queues.py::test_close <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_queues.py PASSED [ 60%] 1467s tests/test_queues.py::test_timeout <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_queues.py PASSED [ 60%] 1467s tests/test_queues.py::test_2220 <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_queues.py PASSED [ 60%] 1467s tests/test_queues.py::test_unpickle_without_client <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_queues.py PASSED [ 60%] 1467s tests/test_queues.py::test_set_cancelled_future <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_queues.py PASSED [ 60%] 1468s tests/test_reschedule.py::test_scheduler_reschedule_warns <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_reschedule.py PASSED [ 60%] 1468s tests/test_reschedule.py::test_raise_reschedule[executing] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_reschedule.py PASSED [ 60%] 1469s tests/test_reschedule.py::test_raise_reschedule[long-running] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_reschedule.py PASSED [ 60%] 1469s tests/test_reschedule.py::test_cancelled_reschedule[executing] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_reschedule.py PASSED [ 60%] 1469s tests/test_reschedule.py::test_cancelled_reschedule[long-running] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_reschedule.py PASSED [ 60%] 1469s tests/test_reschedule.py::test_cancelled_reschedule_worker_state[executing] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_reschedule.py PASSED [ 60%] 1469s tests/test_reschedule.py::test_cancelled_reschedule_worker_state[long-running] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_reschedule.py PASSED [ 60%] 1469s tests/test_reschedule.py::test_reschedule_releases[executing] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_reschedule.py PASSED [ 60%] 1469s tests/test_reschedule.py::test_reschedule_releases[long-running] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_reschedule.py PASSED [ 60%] 1469s tests/test_reschedule.py::test_reschedule_cancelled[executing] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_reschedule.py PASSED [ 60%] 1469s tests/test_reschedule.py::test_reschedule_cancelled[long-running] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_reschedule.py PASSED [ 61%] 1469s tests/test_reschedule.py::test_reschedule_resumed[executing] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_reschedule.py PASSED [ 61%] 1469s tests/test_reschedule.py::test_reschedule_resumed[long-running] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_reschedule.py PASSED [ 61%] 1469s tests/test_resources.py::test_resource_submit <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 61%] 1469s tests/test_resources.py::test_submit_many_non_overlapping <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 61%] 1470s tests/test_resources.py::test_submit_many_non_overlapping_2 <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 61%] 1470s tests/test_resources.py::test_move <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 61%] 1471s tests/test_resources.py::test_dont_work_steal <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 61%] 1471s tests/test_resources.py::test_map <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 61%] 1471s tests/test_resources.py::test_persist <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 61%] 1471s tests/test_resources.py::test_compute <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 61%] 1472s tests/test_resources.py::test_get <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 61%] 1472s tests/test_resources.py::test_persist_multiple_collections <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 61%] 1472s tests/test_resources.py::test_resources_str <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 61%] 1472s tests/test_resources.py::test_minimum_resource <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 61%] 1472s tests/test_resources.py::test_constrained_vs_ready_priority_1[1-0-y-False] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 61%] 1473s tests/test_resources.py::test_constrained_vs_ready_priority_1[1-0-y-True] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 61%] 1473s tests/test_resources.py::test_constrained_vs_ready_priority_1[0-1-x-False] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 61%] 1473s tests/test_resources.py::test_constrained_vs_ready_priority_1[0-1-x-True] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 61%] 1473s tests/test_resources.py::test_constrained_vs_ready_priority_2[1-0-y-False] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 61%] 1473s tests/test_resources.py::test_constrained_vs_ready_priority_2[1-0-y-True] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 61%] 1473s tests/test_resources.py::test_constrained_vs_ready_priority_2[0-1-x-False] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 61%] 1473s tests/test_resources.py::test_constrained_vs_ready_priority_2[0-1-x-True] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 61%] 1473s tests/test_resources.py::test_constrained_tasks_respect_priority <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 61%] 1473s tests/test_resources.py::test_task_cancelled_and_readded_with_resources <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 61%] 1473s tests/test_resources.py::test_balance_resources <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py SKIPPED [ 61%] 1473s tests/test_resources.py::test_set_resources <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 61%] 1473s tests/test_resources.py::test_persist_collections <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 61%] 1473s tests/test_resources.py::test_dont_optimize_out <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py SKIPPED [ 61%] 1473s tests/test_resources.py::test_full_collections <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py SKIPPED [ 61%] 1474s tests/test_resources.py::test_collections_get[True] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py XFAIL [ 61%] 1476s tests/test_resources.py::test_collections_get[False] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 61%] 1476s tests/test_resources.py::test_resources_from_config <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 61%] 1476s tests/test_resources.py::test_resources_from_python_override_config <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 61%] 1476s tests/test_resources.py::test_cancelled_with_resources[executing-ExecuteSuccessEvent] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 61%] 1476s tests/test_resources.py::test_cancelled_with_resources[executing-ExecuteFailureEvent] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 61%] 1476s tests/test_resources.py::test_cancelled_with_resources[executing-RescheduleEvent] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 62%] 1476s tests/test_resources.py::test_cancelled_with_resources[long-running-ExecuteSuccessEvent] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 62%] 1476s tests/test_resources.py::test_cancelled_with_resources[long-running-ExecuteFailureEvent] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 62%] 1476s tests/test_resources.py::test_cancelled_with_resources[long-running-RescheduleEvent] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 62%] 1476s tests/test_resources.py::test_resumed_with_resources[executing-ExecuteSuccessEvent] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 62%] 1476s tests/test_resources.py::test_resumed_with_resources[executing-ExecuteFailureEvent] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 62%] 1476s tests/test_resources.py::test_resumed_with_resources[executing-RescheduleEvent] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 62%] 1476s tests/test_resources.py::test_resumed_with_resources[long-running-ExecuteSuccessEvent] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 62%] 1476s tests/test_resources.py::test_resumed_with_resources[long-running-ExecuteFailureEvent] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 62%] 1476s tests/test_resources.py::test_resumed_with_resources[long-running-RescheduleEvent] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 62%] 1476s tests/test_resources.py::test_resumed_with_different_resources[executing-ExecuteSuccessEvent] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 62%] 1476s tests/test_resources.py::test_resumed_with_different_resources[executing-ExecuteFailureEvent] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 62%] 1476s tests/test_resources.py::test_resumed_with_different_resources[executing-RescheduleEvent] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 62%] 1476s tests/test_resources.py::test_resumed_with_different_resources[long-running-ExecuteSuccessEvent] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 62%] 1476s tests/test_resources.py::test_resumed_with_different_resources[long-running-ExecuteFailureEvent] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 62%] 1476s tests/test_resources.py::test_resumed_with_different_resources[long-running-RescheduleEvent] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 62%] 1476s tests/test_scheduler.py::test_administration <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 62%] 1477s tests/test_scheduler.py::test_respect_data_in_memory <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 62%] 1477s tests/test_scheduler.py::test_recompute_released_results <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 62%] 1477s tests/test_scheduler.py::test_decide_worker_with_many_independent_leaves <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 62%] 1477s tests/test_scheduler.py::test_decide_worker_with_restrictions <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 62%] 1478s tests/test_scheduler.py::test_decide_worker_coschedule_order_neighbors[nthreads0-0] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 62%] 1478s tests/test_scheduler.py::test_decide_worker_coschedule_order_neighbors[nthreads0-1] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 62%] 1479s tests/test_scheduler.py::test_decide_worker_coschedule_order_neighbors[nthreads0-4] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 62%] 1479s tests/test_scheduler.py::test_decide_worker_coschedule_order_neighbors[nthreads1-0] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 62%] 1480s tests/test_scheduler.py::test_decide_worker_coschedule_order_neighbors[nthreads1-1] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 62%] 1481s tests/test_scheduler.py::test_decide_worker_coschedule_order_neighbors[nthreads1-4] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 62%] 1481s tests/test_scheduler.py::test_decide_worker_rootish_while_last_worker_is_retiring <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py SKIPPED [ 62%] 1481s tests/test_scheduler.py::test_graph_execution_width <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 62%] 1483s tests/test_scheduler.py::test_forget_tasks_while_processing <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 62%] 1487s tests/test_scheduler.py::test_restart_while_processing <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 62%] 1487s tests/test_scheduler.py::test_queued_release_multiple_workers <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 62%] 1487s tests/test_scheduler.py::test_queued_paused_new_worker <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 62%] 1488s tests/test_scheduler.py::test_queued_paused_unpaused[True] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 62%] 1488s tests/test_scheduler.py::test_queued_paused_unpaused[False] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 62%] 1488s tests/test_scheduler.py::test_queued_remove_add_worker <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 62%] 1489s tests/test_scheduler.py::test_secede_opens_slot <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 63%] 1489s tests/test_scheduler.py::test_saturation_factor[2.5-expected_task_counts0] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 63%] 1489s tests/test_scheduler.py::test_saturation_factor[2.0-expected_task_counts1] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 63%] 1489s tests/test_scheduler.py::test_saturation_factor[1.1-expected_task_counts2] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 63%] 1489s tests/test_scheduler.py::test_saturation_factor[1.0-expected_task_counts3] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 63%] 1489s tests/test_scheduler.py::test_saturation_factor[0.1-expected_task_counts4] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 63%] 1489s tests/test_scheduler.py::test_saturation_factor[inf-expected_task_counts5] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 63%] 1490s tests/test_scheduler.py::test_saturation_factor[inf-expected_task_counts6] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 63%] 1490s tests/test_scheduler.py::test_bad_saturation_factor <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 63%] 1490s tests/test_scheduler.py::test_move_data_over_break_restrictions <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 63%] 1490s tests/test_scheduler.py::test_balance_with_restrictions <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 63%] 1490s tests/test_scheduler.py::test_no_valid_workers <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 63%] 1490s tests/test_scheduler.py::test_no_valid_workers_loose_restrictions <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 63%] 1490s tests/test_scheduler.py::test_no_workers[False] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 63%] 1490s tests/test_scheduler.py::test_no_workers[True] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 63%] 1491s tests/test_scheduler.py::test_retire_workers_empty <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 63%] 1491s tests/test_scheduler.py::test_retire_workers_lock <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 63%] 1491s tests/test_scheduler.py::test_retire_workers_concurrently <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 63%] 1491s tests/test_scheduler.py::test_server_listens_to_other_ops <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 63%] 1491s tests/test_scheduler.py::test_remove_worker_from_scheduler <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 63%] 1491s tests/test_scheduler.py::test_remove_worker_from_scheduler_warns_on_safe <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 63%] 1492s tests/test_scheduler.py::test_remove_worker_by_name_from_scheduler <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 63%] 1492s tests/test_scheduler.py::test_clear_events_worker_removal <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 63%] 1492s tests/test_scheduler.py::test_clear_events_client_removal <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 63%] 1492s tests/test_scheduler.py::test_add_worker <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 63%] 1492s tests/test_scheduler.py::test_blocked_handlers_are_respected <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 63%] 1492s tests/test_scheduler.py::test_scheduler_init_pulls_blocked_handlers_from_config <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 63%] 1492s tests/test_scheduler.py::test_feed <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 63%] 1493s tests/test_scheduler.py::test_feed_setup_teardown <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 63%] 1493s tests/test_scheduler.py::test_feed_large_bytestring <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 63%] 1493s tests/test_scheduler.py::test_delete_data <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 63%] 1493s tests/test_scheduler.py::test_delete <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 63%] 1493s tests/test_scheduler.py::test_dumps_function <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 63%] 1494s tests/test_scheduler.py::test_ready_remove_worker[1.0] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 63%] 1494s tests/test_scheduler.py::test_ready_remove_worker[inf] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 63%] 1497s tests/test_scheduler.py::test_restart <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 63%] 1501s tests/test_scheduler.py::test_restart_waits_for_new_workers <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 64%] 1503s tests/test_scheduler.py::test_restart_nanny_timeout_exceeded <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 64%] 1504s tests/test_scheduler.py::test_restart_not_all_workers_return <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 64%] 1505s tests/test_scheduler.py::test_restart_worker_rejoins_after_timeout_expired <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 64%] 1505s tests/test_scheduler.py::test_restart_no_wait_for_workers <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 64%] 1526s tests/test_scheduler.py::test_restart_some_nannies_some_not <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 64%] 1529s tests/test_scheduler.py::test_restart_heartbeat_before_closing <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 64%] 1529s tests/test_scheduler.py::test_broadcast <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 64%] 1530s tests/test_scheduler.py::test_broadcast_tls <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 64%] 1531s tests/test_scheduler.py::test_broadcast_nanny <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 64%] 1532s tests/test_scheduler.py::test_broadcast_on_error <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 64%] 1532s tests/test_scheduler.py::test_broadcast_deprecation <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 64%] 1532s tests/test_scheduler.py::test_worker_name <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 64%] 1532s tests/test_scheduler.py::test_coerce_address <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 64%] 1532s tests/test_scheduler.py::test_config_stealing <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 64%] 1532s tests/test_scheduler.py::test_config_no_stealing <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 64%] 1532s tests/test_scheduler.py::test_file_descriptors_dont_leak <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 64%] 1532s tests/test_scheduler.py::test_update_graph_culls <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 64%] 1532s tests/test_scheduler.py::test_io_loop <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 64%] 1533s tests/test_scheduler.py::test_story <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 64%] 1533s tests/test_scheduler.py::test_scatter_no_workers[False] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 64%] 1533s tests/test_scheduler.py::test_scatter_no_workers[True] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 64%] 1534s tests/test_scheduler.py::test_scheduler_sees_memory_limits <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 64%] 1534s tests/test_scheduler.py::test_retire_workers <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 64%] 1534s tests/test_scheduler.py::test_retire_workers_n <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 64%] 1534s tests/test_scheduler.py::test_workers_to_close <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 64%] 1534s tests/test_scheduler.py::test_workers_to_close_grouped <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 64%] 1534s tests/test_scheduler.py::test_workers_to_close_never_close_long_running[True] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 64%] 1535s tests/test_scheduler.py::test_workers_to_close_never_close_long_running[False] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 64%] 1535s tests/test_scheduler.py::test_retire_workers_no_suspicious_tasks <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 64%] 1549s tests/test_scheduler.py::test_file_descriptors <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 64%] 1550s tests/test_scheduler.py::test_learn_occupancy <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 64%] 1550s tests/test_scheduler.py::test_learn_occupancy_2 <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 64%] 1551s tests/test_scheduler.py::test_balance_many_workers <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 64%] 1553s tests/test_scheduler.py::test_balance_many_workers_2 <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 64%] 1555s tests/test_scheduler.py::test_include_communication_in_occupancy <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 64%] 1555s tests/test_scheduler.py::test_nonempty_data_is_rejected <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 64%] 1556s tests/test_scheduler.py::test_worker_arrives_with_data_is_rejected <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 65%] 1558s tests/test_scheduler.py::test_run_on_scheduler_sync <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 65%] 1558s tests/test_scheduler.py::test_run_on_scheduler <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 65%] 1558s tests/test_scheduler.py::test_allow_pickle_false <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 65%] 1558s tests/test_scheduler.py::test_close_worker <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 65%] 1563s tests/test_scheduler.py::test_close_nanny <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 65%] 1563s tests/test_scheduler.py::test_retire_workers_close <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 65%] 1566s tests/test_scheduler.py::test_retire_nannies_close <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 65%] 1567s tests/test_scheduler.py::test_fifo_submission <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 65%] 1567s tests/test_scheduler.py::test_scheduler_file <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 65%] 1567s tests/test_scheduler.py::test_dashboard_host[None-expect0-tcp://0.0.0.0] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 65%] 1567s tests/test_scheduler.py::test_dashboard_host[None-expect0-tcp://127.0.0.1] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 65%] 1567s tests/test_scheduler.py::test_dashboard_host[None-expect0-tcp://127.0.0.1:38275] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 65%] 1567s tests/test_scheduler.py::test_dashboard_host[127.0.0.1:0-expect1-tcp://0.0.0.0] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 65%] 1567s tests/test_scheduler.py::test_dashboard_host[127.0.0.1:0-expect1-tcp://127.0.0.1] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 65%] 1567s tests/test_scheduler.py::test_dashboard_host[127.0.0.1:0-expect1-tcp://127.0.0.1:38275] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 65%] 1568s tests/test_scheduler.py::test_profile_metadata <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 65%] 1569s tests/test_scheduler.py::test_profile_metadata_timeout <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 65%] 1570s tests/test_scheduler.py::test_profile_metadata_keys <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 65%] 1570s tests/test_scheduler.py::test_statistical_profiling <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 65%] 1571s tests/test_scheduler.py::test_statistical_profiling_failure <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 65%] 1571s tests/test_scheduler.py::test_cancel_fire_and_forget <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 65%] 1582s tests/test_scheduler.py::test_log_tasks_during_restart <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 65%] 1582s tests/test_scheduler.py::test_get_task_status <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 65%] 1582s tests/test_scheduler.py::test_deque_handler <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 65%] 1582s tests/test_scheduler.py::test_retries <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 65%] 1583s tests/test_scheduler.py::test_missing_data_errant_worker <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 65%] 1583s tests/test_scheduler.py::test_dont_recompute_if_persisted <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 65%] 1583s tests/test_scheduler.py::test_dont_recompute_if_persisted_2 <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 65%] 1583s tests/test_scheduler.py::test_dont_recompute_if_persisted_3 <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 65%] 1583s tests/test_scheduler.py::test_dont_recompute_if_persisted_4 <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 65%] 1584s tests/test_scheduler.py::test_dont_forget_released_keys <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 65%] 1584s tests/test_scheduler.py::test_dont_recompute_if_erred <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 65%] 1584s tests/test_scheduler.py::test_closing_scheduler_closes_workers <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 65%] 1584s tests/test_scheduler.py::test_resources_reset_after_cancelled_task <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 65%] 1584s tests/test_scheduler.py::test_gh2187 <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 65%] 1584s tests/test_scheduler.py::test_collect_versions <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 66%] 1587s tests/test_scheduler.py::test_idle_timeout <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 66%] 1587s tests/test_scheduler.py::test_idle_during_update_graph <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 66%] 1588s tests/test_scheduler.py::test_idle_timeout_no_workers <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 66%] 1588s tests/test_scheduler.py::test_no_workers_timeout_disabled <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 66%] 1589s tests/test_scheduler.py::test_no_workers_timeout_without_workers <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 66%] 1589s tests/test_scheduler.py::test_no_workers_timeout_bad_restrictions <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 66%] 1589s tests/test_scheduler.py::test_no_workers_timeout_queued <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 66%] 1590s tests/test_scheduler.py::test_no_workers_timeout_processing <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 66%] 1590s tests/test_scheduler.py::test_bandwidth <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 66%] 1593s tests/test_scheduler.py::test_bandwidth_clear <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 66%] 1593s tests/test_scheduler.py::test_workerstate_clean <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 66%] 1593s tests/test_scheduler.py::test_result_type <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 66%] 1593s tests/test_scheduler.py::test_close_workers <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 66%] 1593s tests/test_scheduler.py::test_host_address <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 66%] 1593s tests/test_scheduler.py::test_dashboard_address <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py SKIPPED [ 66%] 1594s tests/test_scheduler.py::test_adaptive_target <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 66%] 1594s tests/test_scheduler.py::test_adaptive_target_empty_cluster[True] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 66%] 1594s tests/test_scheduler.py::test_adaptive_target_empty_cluster[False] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 66%] 1594s tests/test_scheduler.py::test_async_context_manager <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 66%] 1594s tests/test_scheduler.py::test_allowed_failures_config <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 66%] 1594s tests/test_scheduler.py::test_finished <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 66%] 1594s tests/test_scheduler.py::test_retire_names_str <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 66%] 1595s tests/test_scheduler.py::test_retire_workers_bad_params <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 66%] 1595s tests/test_scheduler.py::test_get_task_duration <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 66%] 1596s tests/test_scheduler.py::test_default_task_duration_splits <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 66%] 1596s tests/test_scheduler.py::test_no_dangling_asyncio_tasks <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 66%] 1596s tests/test_scheduler.py::test_task_group_and_prefix_statistics <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 66%] 1597s tests/test_scheduler.py::test_task_groups_update_start_stop <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 66%] 1597s tests/test_scheduler.py::test_task_group_done <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 66%] 1597s tests/test_scheduler.py::test_task_group_not_done_waiting <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 66%] 1597s tests/test_scheduler.py::test_task_group_not_done_noworker <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 66%] 1597s tests/test_scheduler.py::test_task_group_not_done_queued <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 66%] 1597s tests/test_scheduler.py::test_task_group_not_done_processing <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 66%] 1598s tests/test_scheduler.py::test_task_prefix <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 66%] 1602s tests/test_scheduler.py::test_failing_task_increments_suspicious <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 66%] 1602s tests/test_scheduler.py::test_task_group_non_tuple_key <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 67%] 1602s tests/test_scheduler.py::test_task_unique_groups <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 67%] 1604s tests/test_scheduler.py::test_task_group_on_fire_and_forget <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 67%] 1604s tests/test_scheduler.py::test_gather_failing_can_recover <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 67%] 1604s tests/test_scheduler.py::test_gather_failing_cnn_error <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 67%] 1605s tests/test_scheduler.py::test_gather_no_workers <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 67%] 1605s tests/test_scheduler.py::test_gather_bad_worker[False] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 67%] 1605s tests/test_scheduler.py::test_gather_bad_worker[True] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 67%] 1605s tests/test_scheduler.py::test_too_many_groups <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 67%] 1605s tests/test_scheduler.py::test_multiple_listeners[{scheme}://{host}:{port}/status-dashboard at:\\s*http://] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 67%] 1605s tests/test_scheduler.py::test_multiple_listeners[{ENV_VAR_MISSING}-dashboard at:\\s*:\\d*] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 67%] 1606s tests/test_scheduler.py::test_worker_name_collision <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 67%] 1606s tests/test_scheduler.py::test_unknown_task_duration_config <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 67%] 1606s tests/test_scheduler.py::test_unknown_task_duration_config_2 <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 67%] 1606s tests/test_scheduler.py::test_retire_state_change <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 67%] 1606s tests/test_scheduler.py::test_get_worker_monitor_info <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 67%] 1606s tests/test_scheduler.py::test_quiet_cluster_round_robin <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 67%] 1606s tests/test_scheduler.py::test_memorystate <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 67%] 1606s tests/test_scheduler.py::test_memorystate_sum <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 67%] 1606s tests/test_scheduler.py::test_memorystate_adds_up[0-0-0-0] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 67%] 1606s tests/test_scheduler.py::test_memorystate_adds_up[0-0-0-1] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 67%] 1606s tests/test_scheduler.py::test_memorystate_adds_up[0-0-0-2] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 67%] 1606s tests/test_scheduler.py::test_memorystate_adds_up[0-0-0-3] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 67%] 1606s tests/test_scheduler.py::test_memorystate_adds_up[0-0-1-0] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 67%] 1606s tests/test_scheduler.py::test_memorystate_adds_up[0-0-1-1] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 67%] 1606s tests/test_scheduler.py::test_memorystate_adds_up[0-0-1-2] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 67%] 1606s tests/test_scheduler.py::test_memorystate_adds_up[0-0-1-3] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 67%] 1606s tests/test_scheduler.py::test_memorystate_adds_up[0-0-2-0] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 67%] 1606s tests/test_scheduler.py::test_memorystate_adds_up[0-0-2-1] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 67%] 1606s tests/test_scheduler.py::test_memorystate_adds_up[0-0-2-2] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 67%] 1606s tests/test_scheduler.py::test_memorystate_adds_up[0-0-2-3] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 67%] 1606s tests/test_scheduler.py::test_memorystate_adds_up[0-0-3-0] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 67%] 1606s tests/test_scheduler.py::test_memorystate_adds_up[0-0-3-1] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 67%] 1606s tests/test_scheduler.py::test_memorystate_adds_up[0-0-3-2] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 67%] 1606s tests/test_scheduler.py::test_memorystate_adds_up[0-0-3-3] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 67%] 1606s tests/test_scheduler.py::test_memorystate_adds_up[0-1-0-0] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 67%] 1606s tests/test_scheduler.py::test_memorystate_adds_up[0-1-0-1] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 68%] 1606s tests/test_scheduler.py::test_memorystate_adds_up[0-1-0-2] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 68%] 1606s tests/test_scheduler.py::test_memorystate_adds_up[0-1-0-3] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 68%] 1606s tests/test_scheduler.py::test_memorystate_adds_up[0-1-1-0] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 68%] 1606s tests/test_scheduler.py::test_memorystate_adds_up[0-1-1-1] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 68%] 1606s tests/test_scheduler.py::test_memorystate_adds_up[0-1-1-2] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 68%] 1606s tests/test_scheduler.py::test_memorystate_adds_up[0-1-1-3] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 68%] 1606s tests/test_scheduler.py::test_memorystate_adds_up[0-1-2-0] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 68%] 1606s tests/test_scheduler.py::test_memorystate_adds_up[0-1-2-1] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 68%] 1606s tests/test_scheduler.py::test_memorystate_adds_up[0-1-2-2] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 68%] 1606s tests/test_scheduler.py::test_memorystate_adds_up[0-1-2-3] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 68%] 1606s tests/test_scheduler.py::test_memorystate_adds_up[0-1-3-0] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 68%] 1606s tests/test_scheduler.py::test_memorystate_adds_up[0-1-3-1] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 68%] 1606s tests/test_scheduler.py::test_memorystate_adds_up[0-1-3-2] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 68%] 1606s tests/test_scheduler.py::test_memorystate_adds_up[0-1-3-3] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 68%] 1606s tests/test_scheduler.py::test_memorystate_adds_up[0-2-0-0] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 68%] 1606s tests/test_scheduler.py::test_memorystate_adds_up[0-2-0-1] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 68%] 1606s tests/test_scheduler.py::test_memorystate_adds_up[0-2-0-2] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 68%] 1606s tests/test_scheduler.py::test_memorystate_adds_up[0-2-0-3] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 68%] 1606s tests/test_scheduler.py::test_memorystate_adds_up[0-2-1-0] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 68%] 1606s tests/test_scheduler.py::test_memorystate_adds_up[0-2-1-1] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 68%] 1606s tests/test_scheduler.py::test_memorystate_adds_up[0-2-1-2] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 68%] 1606s tests/test_scheduler.py::test_memorystate_adds_up[0-2-1-3] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 68%] 1606s tests/test_scheduler.py::test_memorystate_adds_up[0-2-2-0] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 68%] 1606s tests/test_scheduler.py::test_memorystate_adds_up[0-2-2-1] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 68%] 1606s tests/test_scheduler.py::test_memorystate_adds_up[0-2-2-2] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 68%] 1606s tests/test_scheduler.py::test_memorystate_adds_up[0-2-2-3] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 68%] 1606s tests/test_scheduler.py::test_memorystate_adds_up[0-2-3-0] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 68%] 1606s tests/test_scheduler.py::test_memorystate_adds_up[0-2-3-1] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 68%] 1606s tests/test_scheduler.py::test_memorystate_adds_up[0-2-3-2] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 68%] 1606s tests/test_scheduler.py::test_memorystate_adds_up[0-2-3-3] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 68%] 1606s tests/test_scheduler.py::test_memorystate_adds_up[0-3-0-0] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 68%] 1606s tests/test_scheduler.py::test_memorystate_adds_up[0-3-0-1] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 68%] 1606s tests/test_scheduler.py::test_memorystate_adds_up[0-3-0-2] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 68%] 1606s tests/test_scheduler.py::test_memorystate_adds_up[0-3-0-3] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 68%] 1606s tests/test_scheduler.py::test_memorystate_adds_up[0-3-1-0] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 68%] 1606s tests/test_scheduler.py::test_memorystate_adds_up[0-3-1-1] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 68%] 1606s tests/test_scheduler.py::test_memorystate_adds_up[0-3-1-2] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 69%] 1606s tests/test_scheduler.py::test_memorystate_adds_up[0-3-1-3] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 69%] 1606s tests/test_scheduler.py::test_memorystate_adds_up[0-3-2-0] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 69%] 1606s tests/test_scheduler.py::test_memorystate_adds_up[0-3-2-1] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 69%] 1606s tests/test_scheduler.py::test_memorystate_adds_up[0-3-2-2] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 69%] 1606s tests/test_scheduler.py::test_memorystate_adds_up[0-3-2-3] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 69%] 1606s tests/test_scheduler.py::test_memorystate_adds_up[0-3-3-0] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 69%] 1606s tests/test_scheduler.py::test_memorystate_adds_up[0-3-3-1] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 69%] 1606s tests/test_scheduler.py::test_memorystate_adds_up[0-3-3-2] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 69%] 1606s tests/test_scheduler.py::test_memorystate_adds_up[0-3-3-3] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 69%] 1606s tests/test_scheduler.py::test_memorystate_adds_up[1-0-0-0] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 69%] 1606s tests/test_scheduler.py::test_memorystate_adds_up[1-0-0-1] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 69%] 1606s tests/test_scheduler.py::test_memorystate_adds_up[1-0-0-2] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 69%] 1606s tests/test_scheduler.py::test_memorystate_adds_up[1-0-0-3] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 69%] 1606s tests/test_scheduler.py::test_memorystate_adds_up[1-0-1-0] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 69%] 1606s tests/test_scheduler.py::test_memorystate_adds_up[1-0-1-1] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 69%] 1606s tests/test_scheduler.py::test_memorystate_adds_up[1-0-1-2] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 69%] 1606s tests/test_scheduler.py::test_memorystate_adds_up[1-0-1-3] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 69%] 1606s tests/test_scheduler.py::test_memorystate_adds_up[1-0-2-0] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 69%] 1606s tests/test_scheduler.py::test_memorystate_adds_up[1-0-2-1] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 69%] 1606s tests/test_scheduler.py::test_memorystate_adds_up[1-0-2-2] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 69%] 1606s tests/test_scheduler.py::test_memorystate_adds_up[1-0-2-3] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 69%] 1606s tests/test_scheduler.py::test_memorystate_adds_up[1-0-3-0] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 69%] 1606s tests/test_scheduler.py::test_memorystate_adds_up[1-0-3-1] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 69%] 1606s tests/test_scheduler.py::test_memorystate_adds_up[1-0-3-2] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 69%] 1606s tests/test_scheduler.py::test_memorystate_adds_up[1-0-3-3] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 69%] 1606s tests/test_scheduler.py::test_memorystate_adds_up[1-1-0-0] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 69%] 1606s tests/test_scheduler.py::test_memorystate_adds_up[1-1-0-1] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 69%] 1606s tests/test_scheduler.py::test_memorystate_adds_up[1-1-0-2] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 69%] 1606s tests/test_scheduler.py::test_memorystate_adds_up[1-1-0-3] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 69%] 1606s tests/test_scheduler.py::test_memorystate_adds_up[1-1-1-0] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 69%] 1606s tests/test_scheduler.py::test_memorystate_adds_up[1-1-1-1] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 69%] 1606s tests/test_scheduler.py::test_memorystate_adds_up[1-1-1-2] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 69%] 1606s tests/test_scheduler.py::test_memorystate_adds_up[1-1-1-3] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 69%] 1606s tests/test_scheduler.py::test_memorystate_adds_up[1-1-2-0] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 69%] 1606s tests/test_scheduler.py::test_memorystate_adds_up[1-1-2-1] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 69%] 1606s tests/test_scheduler.py::test_memorystate_adds_up[1-1-2-2] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 70%] 1606s tests/test_scheduler.py::test_memorystate_adds_up[1-1-2-3] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 70%] 1606s tests/test_scheduler.py::test_memorystate_adds_up[1-1-3-0] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 70%] 1606s tests/test_scheduler.py::test_memorystate_adds_up[1-1-3-1] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 70%] 1606s tests/test_scheduler.py::test_memorystate_adds_up[1-1-3-2] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 70%] 1606s tests/test_scheduler.py::test_memorystate_adds_up[1-1-3-3] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 70%] 1606s tests/test_scheduler.py::test_memorystate_adds_up[1-2-0-0] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 70%] 1606s tests/test_scheduler.py::test_memorystate_adds_up[1-2-0-1] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 70%] 1606s tests/test_scheduler.py::test_memorystate_adds_up[1-2-0-2] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 70%] 1606s tests/test_scheduler.py::test_memorystate_adds_up[1-2-0-3] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 70%] 1606s tests/test_scheduler.py::test_memorystate_adds_up[1-2-1-0] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 70%] 1606s tests/test_scheduler.py::test_memorystate_adds_up[1-2-1-1] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 70%] 1606s tests/test_scheduler.py::test_memorystate_adds_up[1-2-1-2] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 70%] 1606s tests/test_scheduler.py::test_memorystate_adds_up[1-2-1-3] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 70%] 1606s tests/test_scheduler.py::test_memorystate_adds_up[1-2-2-0] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 70%] 1606s tests/test_scheduler.py::test_memorystate_adds_up[1-2-2-1] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 70%] 1606s tests/test_scheduler.py::test_memorystate_adds_up[1-2-2-2] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 70%] 1606s tests/test_scheduler.py::test_memorystate_adds_up[1-2-2-3] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 70%] 1606s tests/test_scheduler.py::test_memorystate_adds_up[1-2-3-0] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 70%] 1606s tests/test_scheduler.py::test_memorystate_adds_up[1-2-3-1] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 70%] 1606s tests/test_scheduler.py::test_memorystate_adds_up[1-2-3-2] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 70%] 1606s tests/test_scheduler.py::test_memorystate_adds_up[1-2-3-3] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 70%] 1606s tests/test_scheduler.py::test_memorystate_adds_up[1-3-0-0] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 70%] 1606s tests/test_scheduler.py::test_memorystate_adds_up[1-3-0-1] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 70%] 1606s tests/test_scheduler.py::test_memorystate_adds_up[1-3-0-2] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 70%] 1606s tests/test_scheduler.py::test_memorystate_adds_up[1-3-0-3] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 70%] 1606s tests/test_scheduler.py::test_memorystate_adds_up[1-3-1-0] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 70%] 1606s tests/test_scheduler.py::test_memorystate_adds_up[1-3-1-1] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 70%] 1606s tests/test_scheduler.py::test_memorystate_adds_up[1-3-1-2] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 70%] 1606s tests/test_scheduler.py::test_memorystate_adds_up[1-3-1-3] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 70%] 1606s tests/test_scheduler.py::test_memorystate_adds_up[1-3-2-0] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 70%] 1606s tests/test_scheduler.py::test_memorystate_adds_up[1-3-2-1] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 70%] 1606s tests/test_scheduler.py::test_memorystate_adds_up[1-3-2-2] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 70%] 1606s tests/test_scheduler.py::test_memorystate_adds_up[1-3-2-3] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 70%] 1606s tests/test_scheduler.py::test_memorystate_adds_up[1-3-3-0] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 70%] 1606s tests/test_scheduler.py::test_memorystate_adds_up[1-3-3-1] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 70%] 1606s tests/test_scheduler.py::test_memorystate_adds_up[1-3-3-2] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 71%] 1606s tests/test_scheduler.py::test_memorystate_adds_up[1-3-3-3] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 71%] 1606s tests/test_scheduler.py::test_memorystate_adds_up[2-0-0-0] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 71%] 1606s tests/test_scheduler.py::test_memorystate_adds_up[2-0-0-1] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 71%] 1606s tests/test_scheduler.py::test_memorystate_adds_up[2-0-0-2] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 71%] 1606s tests/test_scheduler.py::test_memorystate_adds_up[2-0-0-3] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 71%] 1606s tests/test_scheduler.py::test_memorystate_adds_up[2-0-1-0] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 71%] 1606s tests/test_scheduler.py::test_memorystate_adds_up[2-0-1-1] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 71%] 1606s tests/test_scheduler.py::test_memorystate_adds_up[2-0-1-2] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 71%] 1606s tests/test_scheduler.py::test_memorystate_adds_up[2-0-1-3] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 71%] 1606s tests/test_scheduler.py::test_memorystate_adds_up[2-0-2-0] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 71%] 1606s tests/test_scheduler.py::test_memorystate_adds_up[2-0-2-1] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 71%] 1606s tests/test_scheduler.py::test_memorystate_adds_up[2-0-2-2] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 71%] 1606s tests/test_scheduler.py::test_memorystate_adds_up[2-0-2-3] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 71%] 1606s tests/test_scheduler.py::test_memorystate_adds_up[2-0-3-0] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 71%] 1606s tests/test_scheduler.py::test_memorystate_adds_up[2-0-3-1] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 71%] 1606s tests/test_scheduler.py::test_memorystate_adds_up[2-0-3-2] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 71%] 1606s tests/test_scheduler.py::test_memorystate_adds_up[2-0-3-3] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 71%] 1606s tests/test_scheduler.py::test_memorystate_adds_up[2-1-0-0] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 71%] 1606s tests/test_scheduler.py::test_memorystate_adds_up[2-1-0-1] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 71%] 1606s tests/test_scheduler.py::test_memorystate_adds_up[2-1-0-2] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 71%] 1606s tests/test_scheduler.py::test_memorystate_adds_up[2-1-0-3] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 71%] 1606s tests/test_scheduler.py::test_memorystate_adds_up[2-1-1-0] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 71%] 1606s tests/test_scheduler.py::test_memorystate_adds_up[2-1-1-1] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 71%] 1606s tests/test_scheduler.py::test_memorystate_adds_up[2-1-1-2] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 71%] 1606s tests/test_scheduler.py::test_memorystate_adds_up[2-1-1-3] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 71%] 1606s tests/test_scheduler.py::test_memorystate_adds_up[2-1-2-0] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 71%] 1606s tests/test_scheduler.py::test_memorystate_adds_up[2-1-2-1] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 71%] 1606s tests/test_scheduler.py::test_memorystate_adds_up[2-1-2-2] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 71%] 1606s tests/test_scheduler.py::test_memorystate_adds_up[2-1-2-3] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 71%] 1606s tests/test_scheduler.py::test_memorystate_adds_up[2-1-3-0] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 71%] 1606s tests/test_scheduler.py::test_memorystate_adds_up[2-1-3-1] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 71%] 1606s tests/test_scheduler.py::test_memorystate_adds_up[2-1-3-2] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 71%] 1606s tests/test_scheduler.py::test_memorystate_adds_up[2-1-3-3] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 71%] 1606s tests/test_scheduler.py::test_memorystate_adds_up[2-2-0-0] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 71%] 1606s tests/test_scheduler.py::test_memorystate_adds_up[2-2-0-1] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 71%] 1606s tests/test_scheduler.py::test_memorystate_adds_up[2-2-0-2] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 72%] 1606s tests/test_scheduler.py::test_memorystate_adds_up[2-2-0-3] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 72%] 1606s tests/test_scheduler.py::test_memorystate_adds_up[2-2-1-0] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 72%] 1606s tests/test_scheduler.py::test_memorystate_adds_up[2-2-1-1] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 72%] 1606s tests/test_scheduler.py::test_memorystate_adds_up[2-2-1-2] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 72%] 1606s tests/test_scheduler.py::test_memorystate_adds_up[2-2-1-3] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 72%] 1606s tests/test_scheduler.py::test_memorystate_adds_up[2-2-2-0] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 72%] 1606s tests/test_scheduler.py::test_memorystate_adds_up[2-2-2-1] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 72%] 1606s tests/test_scheduler.py::test_memorystate_adds_up[2-2-2-2] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 72%] 1606s tests/test_scheduler.py::test_memorystate_adds_up[2-2-2-3] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 72%] 1606s tests/test_scheduler.py::test_memorystate_adds_up[2-2-3-0] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 72%] 1606s tests/test_scheduler.py::test_memorystate_adds_up[2-2-3-1] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 72%] 1606s tests/test_scheduler.py::test_memorystate_adds_up[2-2-3-2] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 72%] 1606s tests/test_scheduler.py::test_memorystate_adds_up[2-2-3-3] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 72%] 1606s tests/test_scheduler.py::test_memorystate_adds_up[2-3-0-0] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 72%] 1606s tests/test_scheduler.py::test_memorystate_adds_up[2-3-0-1] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 72%] 1606s tests/test_scheduler.py::test_memorystate_adds_up[2-3-0-2] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 72%] 1606s tests/test_scheduler.py::test_memorystate_adds_up[2-3-0-3] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 72%] 1606s tests/test_scheduler.py::test_memorystate_adds_up[2-3-1-0] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 72%] 1607s tests/test_scheduler.py::test_memorystate_adds_up[2-3-1-1] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 72%] 1607s tests/test_scheduler.py::test_memorystate_adds_up[2-3-1-2] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 72%] 1607s tests/test_scheduler.py::test_memorystate_adds_up[2-3-1-3] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 72%] 1607s tests/test_scheduler.py::test_memorystate_adds_up[2-3-2-0] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 72%] 1607s tests/test_scheduler.py::test_memorystate_adds_up[2-3-2-1] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 72%] 1607s tests/test_scheduler.py::test_memorystate_adds_up[2-3-2-2] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 72%] 1607s tests/test_scheduler.py::test_memorystate_adds_up[2-3-2-3] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 72%] 1607s tests/test_scheduler.py::test_memorystate_adds_up[2-3-3-0] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 72%] 1607s tests/test_scheduler.py::test_memorystate_adds_up[2-3-3-1] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 72%] 1607s tests/test_scheduler.py::test_memorystate_adds_up[2-3-3-2] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 72%] 1607s tests/test_scheduler.py::test_memorystate_adds_up[2-3-3-3] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 72%] 1607s tests/test_scheduler.py::test_memorystate_adds_up[3-0-0-0] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 72%] 1607s tests/test_scheduler.py::test_memorystate_adds_up[3-0-0-1] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 72%] 1607s tests/test_scheduler.py::test_memorystate_adds_up[3-0-0-2] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 72%] 1607s tests/test_scheduler.py::test_memorystate_adds_up[3-0-0-3] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 72%] 1607s tests/test_scheduler.py::test_memorystate_adds_up[3-0-1-0] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 72%] 1607s tests/test_scheduler.py::test_memorystate_adds_up[3-0-1-1] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 72%] 1607s tests/test_scheduler.py::test_memorystate_adds_up[3-0-1-2] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 72%] 1607s tests/test_scheduler.py::test_memorystate_adds_up[3-0-1-3] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 73%] 1607s tests/test_scheduler.py::test_memorystate_adds_up[3-0-2-0] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 73%] 1607s tests/test_scheduler.py::test_memorystate_adds_up[3-0-2-1] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 73%] 1607s tests/test_scheduler.py::test_memorystate_adds_up[3-0-2-2] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 73%] 1607s tests/test_scheduler.py::test_memorystate_adds_up[3-0-2-3] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 73%] 1607s tests/test_scheduler.py::test_memorystate_adds_up[3-0-3-0] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 73%] 1607s tests/test_scheduler.py::test_memorystate_adds_up[3-0-3-1] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 73%] 1607s tests/test_scheduler.py::test_memorystate_adds_up[3-0-3-2] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 73%] 1607s tests/test_scheduler.py::test_memorystate_adds_up[3-0-3-3] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 73%] 1607s tests/test_scheduler.py::test_memorystate_adds_up[3-1-0-0] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 73%] 1607s tests/test_scheduler.py::test_memorystate_adds_up[3-1-0-1] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 73%] 1607s tests/test_scheduler.py::test_memorystate_adds_up[3-1-0-2] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 73%] 1607s tests/test_scheduler.py::test_memorystate_adds_up[3-1-0-3] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 73%] 1607s tests/test_scheduler.py::test_memorystate_adds_up[3-1-1-0] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 73%] 1607s tests/test_scheduler.py::test_memorystate_adds_up[3-1-1-1] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 73%] 1607s tests/test_scheduler.py::test_memorystate_adds_up[3-1-1-2] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 73%] 1607s tests/test_scheduler.py::test_memorystate_adds_up[3-1-1-3] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 73%] 1607s tests/test_scheduler.py::test_memorystate_adds_up[3-1-2-0] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 73%] 1607s tests/test_scheduler.py::test_memorystate_adds_up[3-1-2-1] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 73%] 1607s tests/test_scheduler.py::test_memorystate_adds_up[3-1-2-2] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 73%] 1607s tests/test_scheduler.py::test_memorystate_adds_up[3-1-2-3] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 73%] 1607s tests/test_scheduler.py::test_memorystate_adds_up[3-1-3-0] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 73%] 1607s tests/test_scheduler.py::test_memorystate_adds_up[3-1-3-1] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 73%] 1607s tests/test_scheduler.py::test_memorystate_adds_up[3-1-3-2] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 73%] 1607s tests/test_scheduler.py::test_memorystate_adds_up[3-1-3-3] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 73%] 1607s tests/test_scheduler.py::test_memorystate_adds_up[3-2-0-0] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 73%] 1607s tests/test_scheduler.py::test_memorystate_adds_up[3-2-0-1] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 73%] 1607s tests/test_scheduler.py::test_memorystate_adds_up[3-2-0-2] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 73%] 1607s tests/test_scheduler.py::test_memorystate_adds_up[3-2-0-3] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 73%] 1607s tests/test_scheduler.py::test_memorystate_adds_up[3-2-1-0] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 73%] 1607s tests/test_scheduler.py::test_memorystate_adds_up[3-2-1-1] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 73%] 1607s tests/test_scheduler.py::test_memorystate_adds_up[3-2-1-2] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 73%] 1607s tests/test_scheduler.py::test_memorystate_adds_up[3-2-1-3] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 73%] 1607s tests/test_scheduler.py::test_memorystate_adds_up[3-2-2-0] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 73%] 1607s tests/test_scheduler.py::test_memorystate_adds_up[3-2-2-1] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 73%] 1607s tests/test_scheduler.py::test_memorystate_adds_up[3-2-2-2] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 73%] 1607s tests/test_scheduler.py::test_memorystate_adds_up[3-2-2-3] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 74%] 1607s tests/test_scheduler.py::test_memorystate_adds_up[3-2-3-0] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 74%] 1607s tests/test_scheduler.py::test_memorystate_adds_up[3-2-3-1] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 74%] 1607s tests/test_scheduler.py::test_memorystate_adds_up[3-2-3-2] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 74%] 1607s tests/test_scheduler.py::test_memorystate_adds_up[3-2-3-3] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 74%] 1607s tests/test_scheduler.py::test_memorystate_adds_up[3-3-0-0] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 74%] 1607s tests/test_scheduler.py::test_memorystate_adds_up[3-3-0-1] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 74%] 1607s tests/test_scheduler.py::test_memorystate_adds_up[3-3-0-2] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 74%] 1607s tests/test_scheduler.py::test_memorystate_adds_up[3-3-0-3] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 74%] 1607s tests/test_scheduler.py::test_memorystate_adds_up[3-3-1-0] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 74%] 1607s tests/test_scheduler.py::test_memorystate_adds_up[3-3-1-1] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 74%] 1607s tests/test_scheduler.py::test_memorystate_adds_up[3-3-1-2] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 74%] 1607s tests/test_scheduler.py::test_memorystate_adds_up[3-3-1-3] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 74%] 1607s tests/test_scheduler.py::test_memorystate_adds_up[3-3-2-0] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 74%] 1607s tests/test_scheduler.py::test_memorystate_adds_up[3-3-2-1] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 74%] 1607s tests/test_scheduler.py::test_memorystate_adds_up[3-3-2-2] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 74%] 1607s tests/test_scheduler.py::test_memorystate_adds_up[3-3-2-3] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 74%] 1607s tests/test_scheduler.py::test_memorystate_adds_up[3-3-3-0] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 74%] 1607s tests/test_scheduler.py::test_memorystate_adds_up[3-3-3-1] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 74%] 1607s tests/test_scheduler.py::test_memorystate_adds_up[3-3-3-2] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 74%] 1607s tests/test_scheduler.py::test_memorystate_adds_up[3-3-3-3] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 74%] 1607s tests/test_scheduler.py::test_memorystate__to_dict <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 74%] 1620s tests/test_scheduler.py::test_memory <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 74%] 1620s tests/test_scheduler.py::test_memory_no_zict <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 74%] 1620s tests/test_scheduler.py::test_memory_no_workers <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 74%] 1620s tests/test_scheduler.py::test_infrequent_sysmon <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 74%] 1620s tests/test_scheduler.py::test_close_scheduler__close_workers_Worker <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 74%] 1623s tests/test_scheduler.py::test_close_scheduler__close_workers_Nanny <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 74%] 1627s tests/test_scheduler.py::test_rebalance <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 74%] 1627s tests/test_scheduler.py::test_rebalance_managed_memory <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 74%] 1627s tests/test_scheduler.py::test_rebalance_workers_and_keys <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 74%] 1628s tests/test_scheduler.py::test_rebalance_missing_data1 <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 74%] 1628s tests/test_scheduler.py::test_rebalance_missing_data2 <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 74%] 1628s tests/test_scheduler.py::test_rebalance_raises_missing_data3[False] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 74%] 1628s tests/test_scheduler.py::test_rebalance_raises_missing_data3[True] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py XFAIL subject to a race 1628s condition. This test assumes that the data is freed before 1628s the rebalance get_data requests come in but merely deleting 1628s the futures is not sufficient to guarantee this) [ 74%] 1628s tests/test_scheduler.py::test_rebalance_no_workers <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 74%] 1628s tests/test_scheduler.py::test_rebalance_no_limit <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 75%] 1631s tests/test_scheduler.py::test_rebalance_no_recipients <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 75%] 1631s tests/test_scheduler.py::test_rebalance_skip_recipient <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 75%] 1631s tests/test_scheduler.py::test_rebalance_skip_all_recipients <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 75%] 1634s tests/test_scheduler.py::test_rebalance_sender_below_mean <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 75%] 1636s tests/test_scheduler.py::test_rebalance_least_recently_inserted_sender_min <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 75%] 1636s tests/test_scheduler.py::test_gather_on_worker <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 75%] 1636s tests/test_scheduler.py::test_gather_on_worker_bad_recipient <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 75%] 1637s tests/test_scheduler.py::test_gather_on_worker_bad_sender <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 75%] 1637s tests/test_scheduler.py::test_gather_on_worker_bad_sender_replicated[False] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 75%] 1637s tests/test_scheduler.py::test_gather_on_worker_bad_sender_replicated[True] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 75%] 1637s tests/test_scheduler.py::test_gather_on_worker_key_not_on_sender <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 75%] 1637s tests/test_scheduler.py::test_gather_on_worker_key_not_on_sender_replicated[False] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 75%] 1637s tests/test_scheduler.py::test_gather_on_worker_key_not_on_sender_replicated[True] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 75%] 1637s tests/test_scheduler.py::test_gather_on_worker_duplicate_task <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 75%] 1638s tests/test_scheduler.py::test_rebalance_dead_recipient <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 75%] 1638s tests/test_scheduler.py::test_delete_worker_data <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 75%] 1638s tests/test_scheduler.py::test_delete_worker_data_double_delete <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 75%] 1638s tests/test_scheduler.py::test_delete_worker_data_bad_worker <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 75%] 1638s tests/test_scheduler.py::test_delete_worker_data_bad_task[False] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 75%] 1638s tests/test_scheduler.py::test_delete_worker_data_bad_task[True] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 75%] 1638s tests/test_scheduler.py::test_transition_counter <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 75%] 1638s tests/test_scheduler.py::test_transition_counter_max_scheduler <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 75%] 1638s tests/test_scheduler.py::test_transition_counter_max_worker <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 75%] 1640s tests/test_scheduler.py::test_disable_transition_counter_max <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 75%] 1641s tests/test_scheduler.py::test_worker_heartbeat_after_cancel <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 75%] 1641s tests/test_scheduler.py::test_set_restrictions <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 75%] 1642s tests/test_scheduler.py::test_avoid_paused_workers <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 75%] 1642s tests/test_scheduler.py::test_Scheduler__to_dict <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 75%] 1642s tests/test_scheduler.py::test_TaskState__to_dict <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 75%] 1642s tests/test_scheduler.py::test_get_cluster_state <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 75%] 1642s tests/test_scheduler.py::test_get_cluster_state_worker_error <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 75%] 1642s tests/test_scheduler.py::test_dump_cluster_state[msgpack] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 75%] 1642s tests/test_scheduler.py::test_dump_cluster_state[yaml] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 75%] 1643s tests/test_scheduler.py::test_repr <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 75%] 1643s tests/test_scheduler.py::test_ensure_events_dont_include_taskstate_objects <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 75%] 1643s tests/test_scheduler.py::test_worker_state_unique_regardless_of_address <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 76%] 1643s tests/test_scheduler.py::test_scheduler_close_fast_deprecated <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 76%] 1645s tests/test_scheduler.py::test_runspec_regression_sync <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 76%] 1645s tests/test_scheduler.py::test_KilledWorker_informative_message <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 76%] 1645s tests/test_scheduler.py::test_count_task_prefix <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 76%] 1645s tests/test_scheduler.py::test_transition_waiting_memory <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 76%] 1646s tests/test_scheduler.py::test_deadlock_resubmit_queued_tasks_fast[True] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 76%] 1646s tests/test_scheduler.py::test_deadlock_resubmit_queued_tasks_fast[False] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 76%] 1646s tests/test_scheduler.py::test_transition_failure_triggers_log_event <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 76%] 1646s tests/test_scheduler.py::test_deadlock_dependency_of_queued_released_when_worker_replaced[True] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 76%] 1647s tests/test_scheduler.py::test_deadlock_dependency_of_queued_released_when_worker_replaced[False] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 76%] 1647s tests/test_scheduler.py::test_deadlock_dependency_of_queued_released_when_worker_removed[True] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 76%] 1647s tests/test_scheduler.py::test_deadlock_dependency_of_queued_released_when_worker_removed[False] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 76%] 1647s tests/test_scheduler.py::test_submit_dependency_of_erred_task <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 76%] 1647s tests/test_scheduler.py::test_tell_workers_when_peers_have_left <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 76%] 1647s tests/test_scheduler.py::test_scatter_creates_ts <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 76%] 1648s tests/test_scheduler.py::test_refuse_to_schedule_huge_task[False] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 76%] 1648s tests/test_scheduler.py::test_refuse_to_schedule_huge_task[True] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 76%] 1648s tests/test_scheduler.py::test_html_repr <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 76%] 1648s tests/test_scheduler.py::test_resubmit_different_task_same_key_before_previous_is_done[same] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 76%] 1649s tests/test_scheduler.py::test_resubmit_different_task_same_key_before_previous_is_done[less] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 76%] 1649s tests/test_scheduler.py::test_resubmit_different_task_same_key_before_previous_is_done[more] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 76%] 1649s tests/test_scheduler.py::test_resubmit_different_task_same_key_after_previous_is_done[False-same] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 76%] 1649s tests/test_scheduler.py::test_resubmit_different_task_same_key_after_previous_is_done[False-less] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 76%] 1649s tests/test_scheduler.py::test_resubmit_different_task_same_key_after_previous_is_done[False-more] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 76%] 1649s tests/test_scheduler.py::test_resubmit_different_task_same_key_after_previous_is_done[True-same] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 76%] 1649s tests/test_scheduler.py::test_resubmit_different_task_same_key_after_previous_is_done[True-less] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 76%] 1650s tests/test_scheduler.py::test_resubmit_different_task_same_key_after_previous_is_done[True-more] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 76%] 1650s tests/test_scheduler.py::test_resubmit_different_task_same_key_many_clients <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 76%] 1650s tests/test_scheduler.py::test_resubmit_nondeterministic_task_same_deps[before0-123-True] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 76%] 1650s tests/test_scheduler.py::test_resubmit_nondeterministic_task_same_deps[123-after1-True] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 76%] 1650s tests/test_scheduler.py::test_resubmit_nondeterministic_task_same_deps[before2-after2-False] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 76%] 1650s tests/test_scheduler.py::test_resubmit_nondeterministic_task_different_deps[False] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 76%] 1650s tests/test_scheduler.py::test_resubmit_nondeterministic_task_different_deps[True] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 76%] 1650s tests/test_scheduler.py::test_resubmit_different_task_same_key_warns_only_once[10-2] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 76%] 1651s tests/test_scheduler.py::test_resubmit_different_task_same_key_warns_only_once[30-1] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 76%] 1651s tests/test_scheduler.py::test_fan_out_pattern_deadlock <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 76%] 1651s tests/test_scheduler.py::test_stimulus_from_erred_task <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 77%] 1653s tests/test_scheduler.py::test_concurrent_close_requests <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 77%] 1653s tests/test_scheduler.py::test_rootish_taskgroup_configuration <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 77%] 1653s tests/test_scheduler.py::test_alias_resolving_break_queuing <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 77%] 1653s tests/test_security.py::test_defaults <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_security.py PASSED [ 77%] 1653s tests/test_security.py::test_constructor_errors <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_security.py PASSED [ 77%] 1653s tests/test_security.py::test_attribute_error <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_security.py PASSED [ 77%] 1653s tests/test_security.py::test_from_config <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_security.py PASSED [ 77%] 1653s tests/test_security.py::test_min_max_version_from_config[None-None] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_security.py PASSED [ 77%] 1653s tests/test_security.py::test_min_max_version_from_config[None-1.2] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_security.py PASSED [ 77%] 1653s tests/test_security.py::test_min_max_version_from_config[None-1.3] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_security.py PASSED [ 77%] 1653s tests/test_security.py::test_min_max_version_from_config[1.2-None] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_security.py PASSED [ 77%] 1653s tests/test_security.py::test_min_max_version_from_config[1.2-1.2] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_security.py PASSED [ 77%] 1653s tests/test_security.py::test_min_max_version_from_config[1.2-1.3] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_security.py PASSED [ 77%] 1653s tests/test_security.py::test_min_max_version_from_config[1.3-None] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_security.py PASSED [ 77%] 1653s tests/test_security.py::test_min_max_version_from_config[1.3-1.2] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_security.py PASSED [ 77%] 1653s tests/test_security.py::test_min_max_version_from_config[1.3-1.3] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_security.py PASSED [ 77%] 1653s tests/test_security.py::test_min_max_version_config_errors[min-version] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_security.py PASSED [ 77%] 1653s tests/test_security.py::test_min_max_version_config_errors[max-version] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_security.py PASSED [ 77%] 1653s tests/test_security.py::test_invalid_min_version_from_config_errors <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_security.py PASSED [ 77%] 1653s tests/test_security.py::test_kwargs <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_security.py PASSED [ 77%] 1653s tests/test_security.py::test_min_max_version_kwarg_errors[tls_min_version] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_security.py PASSED [ 77%] 1653s tests/test_security.py::test_min_max_version_kwarg_errors[tls_max_version] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_security.py PASSED [ 77%] 1654s tests/test_security.py::test_repr_temp_keys <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_security.py PASSED [ 77%] 1654s tests/test_security.py::test_repr_local_keys <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_security.py PASSED [ 77%] 1654s tests/test_security.py::test_tls_config_for_role <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_security.py PASSED [ 77%] 1654s tests/test_security.py::test_connection_args <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_security.py PASSED [ 77%] 1654s tests/test_security.py::test_extra_conn_args_connection_args <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_security.py PASSED [ 77%] 1654s tests/test_security.py::test_listen_args <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_security.py PASSED [ 77%] 1654s tests/test_security.py::test_tls_listen_connect <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_security.py PASSED [ 77%] 1654s tests/test_security.py::test_require_encryption <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_security.py PASSED [ 77%] 1654s tests/test_security.py::test_temporary_credentials <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_security.py PASSED [ 77%] 1654s tests/test_security.py::test_extra_conn_args_in_temporary_credentials <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_security.py PASSED [ 77%] 1654s tests/test_security.py::test_tls_temporary_credentials_functional <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_security.py PASSED [ 77%] 1654s tests/test_semaphore.py::test_semaphore_trivial <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_semaphore.py PASSED [ 77%] 1654s tests/test_semaphore.py::test_serializable <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_semaphore.py PASSED [ 77%] 1654s tests/test_semaphore.py::test_release_simple <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_semaphore.py PASSED [ 78%] 1655s tests/test_semaphore.py::test_acquires_with_timeout <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_semaphore.py PASSED [ 78%] 1656s tests/test_semaphore.py::test_timeout_sync <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_semaphore.py PASSED [ 78%] 1657s tests/test_semaphore.py::test_release_semaphore_after_timeout <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_semaphore.py PASSED [ 78%] 1657s tests/test_semaphore.py::test_async_ctx <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_semaphore.py PASSED [ 78%] 1659s tests/test_semaphore.py::test_worker_dies <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_semaphore.py PASSED [ 78%] 1660s tests/test_semaphore.py::test_access_semaphore_by_name <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_semaphore.py PASSED [ 78%] 1660s tests/test_semaphore.py::test_close_async <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_semaphore.py PASSED [ 78%] 1660s tests/test_semaphore.py::test_release_once_too_many <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_semaphore.py PASSED [ 78%] 1660s tests/test_semaphore.py::test_release_once_too_many_resilience <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_semaphore.py PASSED [ 78%] 1660s tests/test_semaphore.py::test_retry_acquire <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_semaphore.py PASSED [ 78%] 1661s tests/test_semaphore.py::test_oversubscribing_leases <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_semaphore.py PASSED [ 78%] 1661s tests/test_semaphore.py::test_timeout_zero <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_semaphore.py PASSED [ 78%] 1661s tests/test_semaphore.py::test_getvalue <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_semaphore.py PASSED [ 78%] 1661s tests/test_semaphore.py::test_metrics <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_semaphore.py PASSED [ 78%] 1661s tests/test_semaphore.py::test_threadpoolworkers_pick_correct_ioloop <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_semaphore.py PASSED [ 78%] 1661s tests/test_semaphore.py::test_release_retry <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_semaphore.py PASSED [ 78%] 1662s tests/test_semaphore.py::test_release_failure <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_semaphore.py PASSED [ 78%] 1662s tests/test_semaphore.py::test_unpickle_without_client <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_semaphore.py PASSED [ 78%] 1662s tests/test_sizeof.py::test_safe_sizeof[obj0] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_sizeof.py PASSED [ 78%] 1662s tests/test_sizeof.py::test_safe_sizeof[obj1] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_sizeof.py PASSED [ 78%] 1662s tests/test_sizeof.py::test_safe_sizeof[obj2] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_sizeof.py PASSED [ 78%] 1662s tests/test_sizeof.py::test_safe_sizeof_logs_on_failure <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_sizeof.py PASSED [ 78%] 1662s tests/test_spans.py::test_spans <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_spans.py PASSED [ 78%] 1662s tests/test_spans.py::test_submit <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_spans.py PASSED [ 78%] 1662s tests/test_spans.py::test_multiple_tags <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_spans.py PASSED [ 78%] 1662s tests/test_spans.py::test_repeat_span <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_spans.py PASSED [ 78%] 1662s tests/test_spans.py::test_default_span <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_spans.py PASSED [ 78%] 1664s tests/test_spans.py::test_no_extension <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_spans.py PASSED [ 78%] 1665s tests/test_spans.py::test_task_groups[False] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_spans.py PASSED [ 78%] 1665s tests/test_spans.py::test_task_groups[True] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_spans.py PASSED [ 78%] 1665s tests/test_spans.py::test_before_first_task_finished <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_spans.py PASSED [ 78%] 1665s tests/test_spans.py::test_duplicate_task_group <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_spans.py PASSED [ 78%] 1665s tests/test_spans.py::test_mismatched_span[False] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_spans.py PASSED [ 78%] 1666s tests/test_spans.py::test_mismatched_span[True] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_spans.py PASSED [ 78%] 1666s tests/test_spans.py::test_no_tags <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_spans.py PASSED [ 78%] 1666s tests/test_spans.py::test_scatter_creates_ts <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_spans.py PASSED [ 79%] 1666s tests/test_spans.py::test_scatter_creates_tg <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_spans.py PASSED [ 79%] 1666s tests/test_spans.py::test_worker_metrics <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_spans.py PASSED [ 79%] 1666s tests/test_spans.py::test_merge_by_tags <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_spans.py PASSED [ 79%] 1667s tests/test_spans.py::test_merge_by_tags_metrics <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_spans.py PASSED [ 79%] 1667s tests/test_spans.py::test_code <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_spans.py PASSED [ 79%] 1667s tests/test_spans.py::test_no_code_by_default <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_spans.py PASSED [ 79%] 1667s tests/test_spans.py::test_merge_all <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_spans.py PASSED [ 79%] 1667s tests/test_spans.py::test_merge_nothing <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_spans.py PASSED [ 79%] 1668s tests/test_spans.py::test_active_cpu_seconds_trivial <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_spans.py PASSED [ 79%] 1668s tests/test_spans.py::test_active_cpu_seconds_not_done[False] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_spans.py PASSED [ 79%] 1668s tests/test_spans.py::test_active_cpu_seconds_not_done[True] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_spans.py PASSED [ 79%] 1668s tests/test_spans.py::test_active_cpu_seconds_change_nthreads <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_spans.py PASSED [ 79%] 1669s tests/test_spans.py::test_active_cpu_seconds_merged <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_spans.py PASSED [ 79%] 1669s tests/test_spans.py::test_spans_are_visible_from_tasks <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_spans.py PASSED [ 79%] 1669s tests/test_spans.py::test_span_on_persist <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_spans.py PASSED [ 79%] 1669s tests/test_spans.py::test_collections_metadata <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_spans.py XPASS [ 79%] 1669s tests/test_spec.py::test_address_default_none <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_spec.py PASSED [ 79%] 1669s tests/test_spec.py::test_child_address_persists <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_spec.py PASSED [ 79%] 1669s tests/test_spill.py::test_psize <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_spill.py PASSED [ 79%] 1669s tests/test_spill.py::test_spillbuffer <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_spill.py PASSED [ 79%] 1669s tests/test_spill.py::test_disk_size_calculation <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_spill.py PASSED [ 79%] 1669s tests/test_spill.py::test_spillbuffer_maxlim <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_spill.py PASSED [ 79%] 1669s tests/test_spill.py::test_spillbuffer_fail_to_serialize <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_spill.py PASSED [ 79%] 1669s tests/test_spill.py::test_spillbuffer_evict <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_spill.py PASSED [ 79%] 1669s tests/test_spill.py::test_no_pop <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_spill.py PASSED [ 79%] 1669s tests/test_spill.py::test_weakref_cache[60-SupportsWeakRef-True] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_spill.py PASSED [ 79%] 1669s tests/test_spill.py::test_weakref_cache[60-NoWeakRef-False] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_spill.py PASSED [ 79%] 1669s tests/test_spill.py::test_weakref_cache[110-SupportsWeakRef-True] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_spill.py PASSED [ 79%] 1669s tests/test_spill.py::test_weakref_cache[110-NoWeakRef-False] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_spill.py PASSED [ 79%] 1669s tests/test_spill.py::test_metrics <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_spill.py PASSED [ 79%] 1669s tests/test_spill.py::test_compression_settings[zlib-100-500] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_spill.py PASSED [ 79%] 1669s tests/test_spill.py::test_compression_settings[None-20000-20500] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_spill.py PASSED [ 79%] 1669s tests/test_spill.py::test_str_collision <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_spill.py PASSED [ 79%] 1670s tests/test_steal.py::test_work_stealing <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 79%] 1670s tests/test_steal.py::test_dont_steal_expensive_data_fast_computation <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 79%] 1671s tests/test_steal.py::test_steal_cheap_data_slow_computation <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 80%] 1672s tests/test_steal.py::test_steal_expensive_data_slow_computation <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 80%] 1674s tests/test_steal.py::test_worksteal_many_thieves <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 80%] 1674s tests/test_steal.py::test_stop_plugin <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 80%] 1675s tests/test_steal.py::test_stop_in_flight <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 80%] 1676s tests/test_steal.py::test_allow_tasks_stolen_before_first_completes <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 80%] 1677s tests/test_steal.py::test_eventually_steal_unknown_functions <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 80%] 1677s tests/test_steal.py::test_steal_related_tasks <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py SKIPPED [ 80%] 1677s tests/test_steal.py::test_dont_steal_fast_tasks_compute_time <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 80%] 1678s tests/test_steal.py::test_dont_steal_fast_tasks_blocklist <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 80%] 1681s tests/test_steal.py::test_new_worker_steals <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 80%] 1683s tests/test_steal.py::test_work_steal_allow_other_workers <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 80%] 1683s tests/test_steal.py::test_dont_steal_worker_restrictions <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 80%] 1683s tests/test_steal.py::test_steal_worker_restrictions <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 80%] 1683s tests/test_steal.py::test_dont_steal_host_restrictions <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 80%] 1684s tests/test_steal.py::test_steal_host_restrictions <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 80%] 1684s tests/test_steal.py::test_dont_steal_resource_restrictions <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 80%] 1684s tests/test_steal.py::test_steal_resource_restrictions <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 80%] 1685s tests/test_steal.py::test_steal_resource_restrictions_asym_diff <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 80%] 1686s tests/test_steal.py::test_balance_without_dependencies <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 80%] 1686s tests/test_steal.py::test_dont_steal_executing_tasks <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 80%] 1687s tests/test_steal.py::test_dont_steal_executing_tasks_2 <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 80%] 1688s tests/test_steal.py::test_dont_steal_few_saturated_tasks_many_workers <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 80%] 1688s tests/test_steal.py::test_steal_when_more_tasks <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 80%] 1689s tests/test_steal.py::test_steal_more_attractive_tasks <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 80%] 1689s tests/test_steal.py::test_balance[don't move unnecessarily] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 80%] 1689s tests/test_steal.py::test_balance[balance] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 80%] 1689s tests/test_steal.py::test_balance[balance even if results in even] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 80%] 1689s tests/test_steal.py::test_balance[don't over balance] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 80%] 1690s tests/test_steal.py::test_balance[move from larger] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 80%] 1690s tests/test_steal.py::test_balance[move to smaller] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 80%] 1690s tests/test_steal.py::test_balance[choose easier first] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 80%] 1690s tests/test_steal.py::test_balance[spread evenly] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 80%] 1690s tests/test_steal.py::test_balance[move easier] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 80%] 1691s tests/test_steal.py::test_balance[be willing to move costly items] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 80%] 1691s tests/test_steal.py::test_balance[but don't move too many] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 80%] 1691s tests/test_steal.py::test_balance[no one clearly saturated] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 80%] 1691s tests/test_steal.py::test_balance[balance multiple saturated workers] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 81%] 1694s tests/test_steal.py::test_restart <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 81%] 1695s tests/test_steal.py::test_paused_workers_must_not_steal <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 81%] 1695s tests/test_steal.py::test_dont_steal_already_released <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 81%] 1696s tests/test_steal.py::test_dont_steal_long_running_tasks <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 81%] 1697s tests/test_steal.py::test_cleanup_repeated_tasks <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 81%] 1698s tests/test_steal.py::test_lose_task <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 81%] 1698s tests/test_steal.py::test_parse_stealing_interval[None-100] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 81%] 1698s tests/test_steal.py::test_parse_stealing_interval[500ms-500] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 81%] 1698s tests/test_steal.py::test_parse_stealing_interval[2-2] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 81%] 1703s tests/test_steal.py::test_balance_with_longer_task <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 81%] 1704s tests/test_steal.py::test_blocklist_shuffle_split <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 81%] 1704s tests/test_steal.py::test_steal_concurrent_simple <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 81%] 1705s tests/test_steal.py::test_steal_reschedule_reset_in_flight_occupancy <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 81%] 1706s tests/test_steal.py::test_get_story <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 81%] 1706s tests/test_steal.py::test_steal_worker_dies_same_ip <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 81%] 1706s tests/test_steal.py::test_reschedule_concurrent_requests_deadlock <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 81%] 1706s tests/test_steal.py::test_correct_bad_time_estimate <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py SKIPPED [ 81%] 1708s tests/test_steal.py::test_steal_stimulus_id_unique <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 81%] 1708s tests/test_steal.py::test_steal_worker_state[executing] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 81%] 1708s tests/test_steal.py::test_steal_worker_state[long-running] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 81%] 1710s tests/test_steal.py::test_steal_very_fast_tasks <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 81%] 1710s tests/test_steal.py::test_balance_expensive_tasks[not enough work to steal] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 81%] 1711s tests/test_steal.py::test_balance_expensive_tasks[enough work to steal] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 81%] 1711s tests/test_steal.py::test_balance_expensive_tasks[not enough work for increased cost] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 81%] 1711s tests/test_steal.py::test_balance_uneven_without_replica <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 81%] 1712s tests/test_steal.py::test_balance_eventually_steals_large_dependency_without_replica <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 81%] 1712s tests/test_steal.py::test_balance_even_with_replica <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 81%] 1713s tests/test_steal.py::test_balance_to_replica <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 81%] 1714s tests/test_steal.py::test_balance_multiple_to_replica <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 81%] 1715s tests/test_steal.py::test_balance_to_larger_dependency <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 81%] 1717s tests/test_steal.py::test_balance_prefers_busier_with_dependency <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 81%] 1719s tests/test_steal.py::test_trivial_workload_should_not_cause_work_stealing <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 81%] 1719s tests/test_stories.py::test_scheduler_story_stimulus_success <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_stories.py PASSED [ 81%] 1719s tests/test_stories.py::test_scheduler_story_stimulus_retry <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_stories.py PASSED [ 81%] 1719s tests/test_stories.py::test_client_story <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_stories.py PASSED [ 81%] 1719s tests/test_stories.py::test_client_story_failed_worker[ignore] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_stories.py PASSED [ 82%] 1719s tests/test_stories.py::test_client_story_failed_worker[raise] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_stories.py PASSED [ 82%] 1719s tests/test_stories.py::test_worker_story_with_deps <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_stories.py PASSED [ 82%] 1720s tests/test_stress.py::test_stress_1 <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_stress.py PASSED [ 82%] 1724s tests/test_stress.py::test_stress_gc[slowinc-100] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_stress.py PASSED [ 82%] 1732s tests/test_stress.py::test_stress_gc[inc-1000] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_stress.py PASSED [ 82%] 1736s tests/test_stress.py::test_cancel_stress <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_stress.py PASSED [ 82%] 1741s tests/test_stress.py::test_cancel_stress_sync <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_stress.py PASSED [ 82%] 1752s tests/test_stress.py::test_stress_creation_and_deletion <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_stress.py PASSED [ 82%] 1754s tests/test_stress.py::test_stress_scatter_death <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_stress.py PASSED [ 82%] 1754s tests/test_stress.py::test_stress_steal <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_stress.py SKIPPED [ 82%] 1765s tests/test_stress.py::test_close_connections <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_stress.py PASSED [ 82%] 1766s tests/test_stress.py::test_no_delay_during_large_transfer <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_stress.py SKIPPED [ 82%] 1782s tests/test_stress.py::test_chaos_rechunk <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_stress.py PASSED [ 82%] 1782s tests/test_system.py::test_memory_limit <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_system.py PASSED [ 82%] 1782s tests/test_system.py::test_hard_memory_limit_cgroups <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_system.py PASSED [ 82%] 1782s tests/test_system.py::test_soft_memory_limit_cgroups <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_system.py PASSED [ 82%] 1782s tests/test_system.py::test_hard_memory_limit_cgroups2 <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_system.py PASSED [ 82%] 1782s tests/test_system.py::test_soft_memory_limit_cgroups2 <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_system.py PASSED [ 82%] 1782s tests/test_system.py::test_softest_memory_limit_cgroups2 <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_system.py PASSED [ 82%] 1782s tests/test_system.py::test_rlimit <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_system.py PASSED [ 82%] 1782s tests/test_system_monitor.py::test_SystemMonitor <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_system_monitor.py PASSED [ 82%] 1782s tests/test_system_monitor.py::test_maxlen_zero <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_system_monitor.py PASSED [ 82%] 1782s tests/test_system_monitor.py::test_count <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_system_monitor.py PASSED [ 82%] 1782s tests/test_system_monitor.py::test_range_query <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_system_monitor.py PASSED [ 82%] 1782s tests/test_system_monitor.py::test_disk_config <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_system_monitor.py PASSED [ 82%] 1782s tests/test_system_monitor.py::test_host_cpu <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_system_monitor.py PASSED [ 82%] 1782s tests/test_system_monitor.py::test_gil_contention <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_system_monitor.py SKIPPED [ 82%] 1782s tests/test_threadpoolexecutor.py::test_tpe <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_threadpoolexecutor.py PASSED [ 82%] 1782s tests/test_threadpoolexecutor.py::test_shutdown_timeout <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_threadpoolexecutor.py PASSED [ 82%] 1783s tests/test_threadpoolexecutor.py::test_shutdown_timeout_raises <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_threadpoolexecutor.py PASSED [ 82%] 1783s tests/test_threadpoolexecutor.py::test_shutdown_wait <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_threadpoolexecutor.py PASSED [ 82%] 1784s tests/test_threadpoolexecutor.py::test_secede_rejoin_busy <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_threadpoolexecutor.py PASSED [ 82%] 1784s tests/test_threadpoolexecutor.py::test_secede_rejoin_quiet <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_threadpoolexecutor.py PASSED [ 82%] 1784s tests/test_threadpoolexecutor.py::test_rejoin_idempotent <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_threadpoolexecutor.py PASSED [ 82%] 1784s tests/test_threadpoolexecutor.py::test_thread_name <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_threadpoolexecutor.py PASSED [ 82%] 1784s tests/test_tls_functional.py::test_basic <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_tls_functional.py PASSED [ 83%] 1784s tests/test_tls_functional.py::test_Queue <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_tls_functional.py PASSED [ 83%] 1785s tests/test_tls_functional.py::test_client_submit <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_tls_functional.py PASSED [ 83%] 1785s tests/test_tls_functional.py::test_gather <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_tls_functional.py PASSED [ 83%] 1785s tests/test_tls_functional.py::test_scatter <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_tls_functional.py PASSED [ 83%] 1787s tests/test_tls_functional.py::test_nanny <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_tls_functional.py PASSED [ 83%] 1787s tests/test_tls_functional.py::test_rebalance <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_tls_functional.py PASSED [ 83%] 1789s tests/test_tls_functional.py::test_work_stealing <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_tls_functional.py PASSED [ 83%] 1789s tests/test_tls_functional.py::test_worker_client <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_tls_functional.py PASSED [ 83%] 1789s tests/test_tls_functional.py::test_worker_client_gather <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_tls_functional.py PASSED [ 83%] 1789s tests/test_tls_functional.py::test_worker_client_executor <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_tls_functional.py PASSED [ 83%] 1850s tests/test_tls_functional.py::test_retire_workers <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_tls_functional.py FAILED [ 83%] 1850s tests/test_tls_functional.py::test_security_dict_input_no_security <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_tls_functional.py PASSED [ 83%] 1850s tests/test_tls_functional.py::test_security_dict_input <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_tls_functional.py PASSED [ 83%] 1850s tests/test_utils.py::test_All <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 83%] 1850s tests/test_utils.py::test_sync <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 83%] 1850s tests/test_utils.py::test_sync_error <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 83%] 1850s tests/test_utils.py::test_sync_timeout <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 83%] 1850s tests/test_utils.py::test_sync_closed_loop <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 83%] 1850s tests/test_utils.py::test_sync_contextvars <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 83%] 1850s tests/test_utils.py::test_is_kernel <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 83%] 1850s tests/test_utils.py::test_ensure_ip <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 83%] 1850s tests/test_utils.py::test_get_ip_interface <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 83%] 1850s tests/test_utils.py::test_get_mp_context <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 83%] 1850s tests/test_utils.py::test_truncate_exception <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 83%] 1850s tests/test_utils.py::test_get_traceback <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 83%] 1850s tests/test_utils.py::test_read_block <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 83%] 1850s tests/test_utils.py::test_seek_delimiter_endline <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 83%] 1850s tests/test_utils.py::test_ensure_memoryview[] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 83%] 1850s tests/test_utils.py::test_ensure_memoryview[data1] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 83%] 1850s tests/test_utils.py::test_ensure_memoryview[1] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 83%] 1850s tests/test_utils.py::test_ensure_memoryview[data3] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 83%] 1850s tests/test_utils.py::test_ensure_memoryview[data4] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 83%] 1850s tests/test_utils.py::test_ensure_memoryview[data5] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 83%] 1850s tests/test_utils.py::test_ensure_memoryview[data6] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 83%] 1850s tests/test_utils.py::test_ensure_memoryview[data7] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 83%] 1850s tests/test_utils.py::test_ensure_memoryview[data8] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 84%] 1850s tests/test_utils.py::test_ensure_memoryview[data9] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 84%] 1850s tests/test_utils.py::test_ensure_memoryview[data10] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 84%] 1850s tests/test_utils.py::test_ensure_memoryview[data11] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 84%] 1850s tests/test_utils.py::test_ensure_memoryview[data12] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 84%] 1850s tests/test_utils.py::test_ensure_memoryview[data13] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 84%] 1850s tests/test_utils.py::test_ensure_memoryview[data14] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 84%] 1850s tests/test_utils.py::test_ensure_memoryview_ndarray[i8-12-shape0-strides0] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 84%] 1850s tests/test_utils.py::test_ensure_memoryview_ndarray[i8-12-shape1-strides1] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 84%] 1850s tests/test_utils.py::test_ensure_memoryview_ndarray[i8-12-shape2-strides2] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 84%] 1850s tests/test_utils.py::test_ensure_memoryview_ndarray[i8-12-shape3-strides3] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 84%] 1850s tests/test_utils.py::test_ensure_memoryview_ndarray[i8-12-shape4-strides4] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 84%] 1850s tests/test_utils.py::test_ensure_memoryview_pyarrow_buffer <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py SKIPPED [ 84%] 1850s tests/test_utils.py::test_nbytes <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 84%] 1850s tests/test_utils.py::test_open_port <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 84%] 1850s tests/test_utils.py::test_set_thread_state <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 84%] 1850s tests/test_utils.py::test_loop_runner <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 84%] 1850s tests/test_utils.py::test_two_loop_runners <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 84%] 1850s tests/test_utils.py::test_loop_runner_gen <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 84%] 1850s tests/test_utils.py::test_loop_runner_exception_in_start <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 84%] 1850s tests/test_utils.py::test_loop_runner_exception_in_teardown <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 84%] 1850s tests/test_utils.py::test_all_quiet_exceptions <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 84%] 1850s tests/test_utils.py::test_warn_on_duration <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 84%] 1850s tests/test_utils.py::test_logs <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 84%] 1850s tests/test_utils.py::test_is_valid_xml <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 84%] 1850s tests/test_utils.py::test_format_dashboard_link <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 84%] 1850s tests/test_utils.py::test_parse_ports <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 84%] 1850s tests/test_utils.py::test_run_in_executor_with_context <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 84%] 1850s tests/test_utils.py::test_run_in_executor_with_context_preserves_contextvars <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 84%] 1850s tests/test_utils.py::test_offload <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 84%] 1850s tests/test_utils.py::test_offload_preserves_contextvars <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 84%] 1850s tests/test_utils.py::test_no_default_deprecated <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 84%] 1850s tests/test_utils.py::test_iscoroutinefunction_unhashable_input <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 84%] 1850s tests/test_utils.py::test_iscoroutinefunction_nested_partial <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 84%] 1850s tests/test_utils.py::test_recursive_to_dict <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 84%] 1850s tests/test_utils.py::test_recursive_to_dict_no_nest <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 84%] 1850s tests/test_utils.py::test_log_errors <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 84%] 1850s tests/test_utils.py::test_log_errors_unroll_stack[0-test_utils] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 85%] 1850s tests/test_utils.py::test_log_errors_unroll_stack[1-a.b.c] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 85%] 1851s tests/test_utils.py::test_load_json_robust_timeout <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 85%] 1851s tests/test_utils.py::test_rate_limiter_filter <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 85%] 1851s tests/test_utils.py::test_tuple_comparable_lt[obj10-obj20-False] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 85%] 1851s tests/test_utils.py::test_tuple_comparable_lt[obj11-obj21-True] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 85%] 1851s tests/test_utils.py::test_tuple_comparable_lt[1-1-False] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 85%] 1851s tests/test_utils.py::test_tuple_comparable_lt[1-2-True] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 85%] 1851s tests/test_utils.py::test_tuple_comparable_lt[None-0-False] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 85%] 1851s tests/test_utils.py::test_tuple_comparable_lt[None-obj25-True] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 85%] 1851s tests/test_utils.py::test_tuple_comparable_eq[obj10-obj20-True] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 85%] 1851s tests/test_utils.py::test_tuple_comparable_eq[obj11-obj21-False] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 85%] 1851s tests/test_utils.py::test_tuple_comparable_eq[1-1-True] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 85%] 1851s tests/test_utils.py::test_tuple_comparable_eq[1-2-False] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 85%] 1851s tests/test_utils.py::test_tuple_comparable_eq[None-0-True] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 85%] 1851s tests/test_utils.py::test_tuple_comparable_eq[None-obj25-False] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 85%] 1851s tests/test_utils.py::test_tuple_comparable_error <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 85%] 1851s tests/test_utils_comm.py::test_pack_data <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_comm.py PASSED [ 85%] 1851s tests/test_utils_comm.py::test_subs_multiple <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_comm.py PASSED [ 85%] 1851s tests/test_utils_comm.py::test_gather_from_workers_missing_replicas <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_comm.py PASSED [ 85%] 1851s tests/test_utils_comm.py::test_gather_from_workers_permissive <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_comm.py PASSED [ 85%] 1851s tests/test_utils_comm.py::test_gather_from_workers_permissive_flaky <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_comm.py PASSED [ 85%] 1852s tests/test_utils_comm.py::test_gather_from_workers_busy <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_comm.py PASSED [ 85%] 1852s tests/test_utils_comm.py::test_gather_from_workers_serialization_error[pickle] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_comm.py PASSED [ 85%] 1852s tests/test_utils_comm.py::test_gather_from_workers_serialization_error[unpickle] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_comm.py PASSED [ 85%] 1852s tests/test_utils_comm.py::test_retry_no_exception <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_comm.py PASSED [ 85%] 1852s tests/test_utils_comm.py::test_retry0_raises_immediately <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_comm.py PASSED [ 85%] 1852s tests/test_utils_comm.py::test_retry_does_retry_and_sleep <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_comm.py PASSED [ 85%] 1852s tests/test_utils_comm.py::test_unpack_remotedata <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_comm.py PASSED [ 85%] 1857s tests/test_utils_test.py::test_bare_cluster <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 85%] 1857s tests/test_utils_test.py::test_gen_cluster <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 85%] 1857s tests/test_utils_test.py::test_gen_cluster_pytest_fixture <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 85%] 1857s tests/test_utils_test.py::test_gen_cluster_parametrized[True] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 85%] 1857s tests/test_utils_test.py::test_gen_cluster_multi_parametrized[a-True] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 85%] 1857s tests/test_utils_test.py::test_gen_cluster_multi_parametrized[b-True] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 85%] 1857s tests/test_utils_test.py::test_gen_cluster_parametrized_variadic_workers[True] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 85%] 1859s tests/test_utils_test.py::test_gen_cluster_set_config_nanny <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 86%] 1859s tests/test_utils_test.py::test_gen_cluster_cleans_up_client <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py SKIPPED [ 86%] 1859s tests/test_utils_test.py::test_gen_cluster_without_client <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 86%] 1859s tests/test_utils_test.py::test_gen_cluster_tls <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 86%] 1859s tests/test_utils_test.py::test_gen_cluster_validate <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 86%] 1859s tests/test_utils_test.py::test_gen_cluster_validate_override <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 86%] 1860s tests/test_utils_test.py::test_gen_test <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py XFAILn) [ 86%] 1860s tests/test_utils_test.py::test_gen_test_legacy_implicit <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py XFAIL [ 86%] 1860s tests/test_utils_test.py::test_gen_test_legacy_explicit <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py XFAIL [ 86%] 1860s tests/test_utils_test.py::test_gen_test_parametrized[True] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 86%] 1860s tests/test_utils_test.py::test_gen_test_double_parametrized[False-True] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 86%] 1860s tests/test_utils_test.py::test_gen_test_pytest_fixture <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 86%] 1860s tests/test_utils_test.py::test_gen_test_config <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 86%] 1860s tests/test_utils_test.py::test_gen_test_config_default <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 86%] 1860s tests/test_utils_test.py::test_new_config <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 86%] 1860s tests/test_utils_test.py::test_lingering_client <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 86%] 1862s tests/test_utils_test.py::test_lingering_client_2 <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 86%] 1864s tests/test_utils_test.py::test_tls_cluster <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 86%] 1864s tests/test_utils_test.py::test_tls_scheduler <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 86%] 1864s tests/test_utils_test.py::test__UnhashableCallable <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 86%] 1864s tests/test_utils_test.py::test_locked_comm_drop_in_replacement <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 86%] 1864s tests/test_utils_test.py::test_locked_comm_intercept_read <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 86%] 1864s tests/test_utils_test.py::test_locked_comm_intercept_write <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 86%] 1864s tests/test_utils_test.py::test_assert_story <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 86%] 1864s tests/test_utils_test.py::test_assert_story_malformed_story[Missing payload, stimulus_id, ts] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 86%] 1864s tests/test_utils_test.py::test_assert_story_malformed_story[Missing (stimulus_id, ts)] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 86%] 1864s tests/test_utils_test.py::test_assert_story_malformed_story[Missing ts] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 86%] 1864s tests/test_utils_test.py::test_assert_story_malformed_story[ts is not a float] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 86%] 1864s tests/test_utils_test.py::test_assert_story_malformed_story[ts is in the future] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 86%] 1864s tests/test_utils_test.py::test_assert_story_malformed_story[ts is too old] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 86%] 1864s tests/test_utils_test.py::test_assert_story_malformed_story[stimulus_id is not a str] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 86%] 1864s tests/test_utils_test.py::test_assert_story_malformed_story[stimulus_id is an empty str] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 86%] 1864s tests/test_utils_test.py::test_assert_story_malformed_story[no payload] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 86%] 1864s tests/test_utils_test.py::test_assert_story_malformed_story[timestamps out of order] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 86%] 1864s tests/test_utils_test.py::test_assert_story_identity[True] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 86%] 1864s tests/test_utils_test.py::test_assert_story_identity[False] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 86%] 1865s tests/test_utils_test.py::test_check_process_leak <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 87%] 1867s tests/test_utils_test.py::test_check_process_leak_slow_cleanup <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 87%] 1868s tests/test_utils_test.py::test_check_process_leak_pre_cleanup[False] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 87%] 1870s tests/test_utils_test.py::test_check_process_leak_pre_cleanup[True] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 87%] 1871s tests/test_utils_test.py::test_check_process_leak_post_cleanup[False] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 87%] 1872s tests/test_utils_test.py::test_check_process_leak_post_cleanup[True] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 87%] 1874s tests/test_utils_test.py::test_start_failure_worker[True] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 87%] 1876s tests/test_utils_test.py::test_start_failure_worker[False] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 87%] 1877s tests/test_utils_test.py::test_start_failure_scheduler <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 87%] 1877s tests/test_utils_test.py::test_invalid_transitions <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 87%] 1877s tests/test_utils_test.py::test_invalid_worker_state <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 87%] 1877s tests/test_utils_test.py::test_raises_with_cause <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 87%] 1882s tests/test_utils_test.py::test_check_thread_leak <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 87%] 1882s tests/test_utils_test.py::test_fail_hard[True] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 87%] 1882s tests/test_utils_test.py::test_fail_hard[False] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 87%] 1882s tests/test_utils_test.py::test_popen_write_during_terminate_deadlock <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 87%] 1892s tests/test_utils_test.py::test_popen_timeout <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 87%] 1892s tests/test_utils_test.py::test_popen_always_prints_output <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 87%] 1892s tests/test_utils_test.py::test_freeze_batched_send <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 87%] 1893s tests/test_utils_test.py::test_wait_for_state <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 87%] 1893s tests/test_utils_test.py::test_wait_for_stimulus <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 87%] 1893s tests/test_utils_test.py::test_ws_with_running_task[executing] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 87%] 1893s tests/test_utils_test.py::test_ws_with_running_task[long-running] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 87%] 1893s tests/test_utils_test.py::test_sizeof <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 87%] 1893s tests/test_utils_test.py::test_sizeof_error[12345.0-TypeError-Expected integer] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 87%] 1893s tests/test_utils_test.py::test_sizeof_error[-1-ValueError-larger than] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 87%] 1893s tests/test_utils_test.py::test_sizeof_error[0-ValueError-larger than] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 87%] 1893s tests/test_utils_test.py::test_sizeof_error[10-ValueError-larger than] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 87%] 1893s tests/test_utils_test.py::test_ensure_no_new_clients <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 87%] 1893s tests/test_utils_test.py::test_captured_logger <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 87%] 1893s tests/test_utils_test.py::test_captured_context_meter <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 87%] 1893s tests/test_variable.py::test_variable <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_variable.py PASSED [ 87%] 1893s tests/test_variable.py::test_delete_unset_variable <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_variable.py PASSED [ 87%] 1893s tests/test_variable.py::test_queue_with_data <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_variable.py PASSED [ 87%] 1895s tests/test_variable.py::test_sync <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_variable.py PASSED [ 87%] 1896s tests/test_variable.py::test_hold_futures <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_variable.py PASSED [ 87%] 1896s tests/test_variable.py::test_timeout <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_variable.py PASSED [ 88%] 1898s tests/test_variable.py::test_timeout_sync <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_variable.py PASSED [ 88%] 1899s tests/test_variable.py::test_cleanup <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_variable.py PASSED [ 88%] 1901s tests/test_variable.py::test_pickleable <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_variable.py PASSED [ 88%] 1901s tests/test_variable.py::test_timeout_get <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_variable.py PASSED [ 88%] 1905s tests/test_variable.py::test_race <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_variable.py PASSED [ 88%] 1905s tests/test_variable.py::test_Future_knows_status_immediately <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_variable.py PASSED [ 88%] 1905s tests/test_variable.py::test_erred_future <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_variable.py PASSED [ 88%] 1907s tests/test_variable.py::test_future_erred_sync <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_variable.py PASSED [ 88%] 1908s tests/test_variable.py::test_variables_do_not_leak_client <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_variable.py PASSED [ 88%] 1908s tests/test_variable.py::test_unpickle_without_client <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_variable.py PASSED [ 88%] 1908s tests/test_variable.py::test_set_cancelled_future <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_variable.py PASSED [ 88%] 1908s tests/test_versions.py::test_versions_match <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_versions.py PASSED [ 88%] 1908s tests/test_versions.py::test_version_mismatch[source-MISMATCHED] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_versions.py PASSED [ 88%] 1908s tests/test_versions.py::test_version_mismatch[source-MISSING] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_versions.py PASSED [ 88%] 1908s tests/test_versions.py::test_version_mismatch[source-KEY_ERROR] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_versions.py PASSED [ 88%] 1908s tests/test_versions.py::test_version_mismatch[source-NONE] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_versions.py PASSED [ 88%] 1908s tests/test_versions.py::test_version_mismatch[scheduler-MISMATCHED] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_versions.py PASSED [ 88%] 1908s tests/test_versions.py::test_version_mismatch[scheduler-MISSING] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_versions.py PASSED [ 88%] 1908s tests/test_versions.py::test_version_mismatch[scheduler-KEY_ERROR] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_versions.py PASSED [ 88%] 1908s tests/test_versions.py::test_version_mismatch[scheduler-NONE] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_versions.py PASSED [ 88%] 1908s tests/test_versions.py::test_version_mismatch[worker-1-MISMATCHED] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_versions.py PASSED [ 88%] 1908s tests/test_versions.py::test_version_mismatch[worker-1-MISSING] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_versions.py PASSED [ 88%] 1908s tests/test_versions.py::test_version_mismatch[worker-1-KEY_ERROR] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_versions.py PASSED [ 88%] 1908s tests/test_versions.py::test_version_mismatch[worker-1-NONE] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_versions.py PASSED [ 88%] 1908s tests/test_versions.py::test_scheduler_mismatched_irrelevant_package <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_versions.py PASSED [ 88%] 1908s tests/test_versions.py::test_scheduler_additional_irrelevant_package <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_versions.py PASSED [ 88%] 1908s tests/test_versions.py::test_python_mismatch[source] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_versions.py PASSED [ 88%] 1908s tests/test_versions.py::test_python_mismatch[scheduler] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_versions.py PASSED [ 88%] 1908s tests/test_versions.py::test_python_mismatch[worker-1] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_versions.py PASSED [ 88%] 1908s tests/test_versions.py::test_version_warning_in_cluster <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_versions.py PASSED [ 88%] 1908s tests/test_versions.py::test_python_version <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_versions.py PASSED [ 88%] 1908s tests/test_versions.py::test_version_custom_pkgs <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_versions.py PASSED [ 88%] 1908s tests/test_worker.py::test_worker_nthreads <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 88%] 1908s tests/test_worker.py::test_str <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 88%] 1908s tests/test_worker.py::test_identity <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 88%] 1908s tests/test_worker.py::test_worker_bad_args <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 88%] 1911s tests/test_worker.py::test_upload_file <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 89%] 1911s tests/test_worker.py::test_upload_file_pyc <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py SKIPPED [ 89%] 1911s tests/test_worker.py::test_upload_egg <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 89%] 1911s tests/test_worker.py::test_upload_pyz <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 89%] 1911s tests/test_worker.py::test_upload_large_file <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py SKIPPED [ 89%] 1911s tests/test_worker.py::test_broadcast <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 89%] 1911s tests/test_worker.py::test_worker_with_port_zero <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 89%] 1911s tests/test_worker.py::test_worker_port_range <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 89%] 1914s tests/test_worker.py::test_worker_waits_for_scheduler <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 89%] 1914s tests/test_worker.py::test_worker_task_data <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 89%] 1914s tests/test_worker.py::test_error_message <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 89%] 1915s tests/test_worker.py::test_chained_error_message <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 89%] 1916s tests/test_worker.py::test_base_exception_in_task[BaseException-True] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 89%] 1917s tests/test_worker.py::test_base_exception_in_task[BaseException-False] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 89%] 1922s tests/test_worker.py::test_base_exception_in_task[SystemExit-True] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 89%] 1927s tests/test_worker.py::test_base_exception_in_task[SystemExit-False] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 89%] 1932s tests/test_worker.py::test_base_exception_in_task[KeyboardInterrupt-True] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 89%] 1937s tests/test_worker.py::test_base_exception_in_task[KeyboardInterrupt-False] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 89%] 1938s tests/test_worker.py::test_base_exception_in_task[CancelledError-True] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 89%] 1940s tests/test_worker.py::test_base_exception_in_task[CancelledError-False] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 89%] 1940s tests/test_worker.py::test_plugin_exception <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 89%] 1940s tests/test_worker.py::test_plugin_multiple_exceptions <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 89%] 1940s tests/test_worker.py::test_plugin_internal_exception <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 89%] 1940s tests/test_worker.py::test_gather <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 89%] 1940s tests/test_worker.py::test_gather_missing_keys <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 89%] 1940s tests/test_worker.py::test_gather_missing_workers <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 89%] 1941s tests/test_worker.py::test_gather_missing_workers_replicated[False] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 89%] 1942s tests/test_worker.py::test_gather_missing_workers_replicated[True0] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 89%] 1942s tests/test_worker.py::test_gather_missing_workers_replicated[True1] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 89%] 1942s tests/test_worker.py::test_gather_missing_workers_replicated[True2] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 89%] 1943s tests/test_worker.py::test_gather_missing_workers_replicated[True3] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 89%] 1943s tests/test_worker.py::test_io_loop <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 89%] 1943s tests/test_worker.py::test_io_loop_alternate_loop <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 89%] 1943s tests/test_worker.py::test_access_key <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 89%] 1943s tests/test_worker.py::test_run_dask_worker <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 89%] 1943s tests/test_worker.py::test_run_dask_worker_kwonlyarg <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 89%] 1944s tests/test_worker.py::test_run_coroutine_dask_worker <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 90%] 1944s tests/test_worker.py::test_Executor <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 90%] 1944s tests/test_worker.py::test_close_on_disconnect <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 90%] 1944s tests/test_worker.py::test_memory_limit_auto <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 90%] 1944s tests/test_worker.py::test_inter_worker_communication <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 90%] 1944s tests/test_worker.py::test_clean <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 90%] 1944s tests/test_worker.py::test_message_breakup <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 90%] 1945s tests/test_worker.py::test_types <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 90%] 1945s tests/test_worker.py::test_system_monitor <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 90%] 1945s tests/test_worker.py::test_restrictions <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 90%] 1946s tests/test_worker.py::test_clean_nbytes <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 90%] 1947s tests/test_worker.py::test_gather_many_small[True] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 90%] 1948s tests/test_worker.py::test_gather_many_small[False] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 90%] 1948s tests/test_worker.py::test_multiple_transfers <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 90%] 1948s tests/test_worker.py::test_share_communication <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py XFAIL [ 90%] 1948s tests/test_worker.py::test_dont_overlap_communications_to_same_worker <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py XFAIL [ 90%] 1949s tests/test_worker.py::test_log_exception_on_failed_task <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 90%] 1949s tests/test_worker.py::test_clean_up_dependencies <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 90%] 1949s tests/test_worker.py::test_hold_onto_dependents <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 90%] 1949s tests/test_worker.py::test_worker_death_timeout <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py XPASS [ 90%] 1949s tests/test_worker.py::test_stop_doing_unnecessary_work <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 90%] 1950s tests/test_worker.py::test_priorities <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 90%] 1951s tests/test_worker.py::test_heartbeats <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 90%] 1951s tests/test_worker.py::test_worker_dir[Worker] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 90%] 1951s tests/test_worker.py::test_worker_dir[Nanny] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 90%] 1953s tests/test_worker.py::test_default_worker_dir <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 90%] 1953s tests/test_worker.py::test_dataframe_attribute_error <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 90%] 1953s tests/test_worker.py::test_pid <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 90%] 1954s tests/test_worker.py::test_get_client <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 90%] 1956s tests/test_worker.py::test_get_client_sync <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 90%] 1956s tests/test_worker.py::test_get_client_coroutine <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 90%] 1958s tests/test_worker.py::test_get_client_coroutine_sync <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py XFAIL/distributed/pull/7339) [ 90%] 1958s tests/test_worker.py::test_global_workers <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 90%] 1958s tests/test_worker.py::test_worker_fds <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 90%] 1958s tests/test_worker.py::test_service_hosts_match_worker <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 90%] 1958s tests/test_worker.py::test_start_services <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 90%] 1958s tests/test_worker.py::test_scheduler_file <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 91%] 1960s tests/test_worker.py::test_scheduler_delay <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 91%] 1961s tests/test_worker.py::test_statistical_profiling <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 91%] 1961s tests/test_worker.py::test_statistical_profiling_2 <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 91%] 1962s tests/test_worker.py::test_statistical_profiling_cycle <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 91%] 1962s tests/test_worker.py::test_get_current_task <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 91%] 1962s tests/test_worker.py::test_deque_handler <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 91%] 1962s tests/test_worker.py::test_scheduler_address_config <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 91%] 1963s tests/test_worker.py::test_wait_for_outgoing <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py XFAIL [ 91%] 1963s tests/test_worker.py::test_prefer_gather_from_local_address <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 91%] 1964s tests/test_worker.py::test_avoid_oversubscription <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 91%] 1964s tests/test_worker.py::test_custom_metrics <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 91%] 1965s tests/test_worker.py::test_register_worker_callbacks <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 91%] 1965s tests/test_worker.py::test_register_worker_callbacks_err <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 91%] 1965s tests/test_worker.py::test_local_directory <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 91%] 1965s tests/test_worker.py::test_local_directory_make_new_directory <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 91%] 1966s tests/test_worker.py::test_host_address <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 91%] 1966s tests/test_worker.py::test_interface_async[Worker] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 91%] 1968s tests/test_worker.py::test_interface_async[Nanny] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 91%] 1968s tests/test_worker.py::test_protocol_from_scheduler_address[Worker] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py SKIPPED [ 91%] 1968s tests/test_worker.py::test_protocol_from_scheduler_address[Nanny] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py SKIPPED [ 91%] 1968s tests/test_worker.py::test_host_uses_scheduler_protocol <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 91%] 1968s tests/test_worker.py::test_worker_listens_on_same_interface_by_default[Worker] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 91%] 1969s tests/test_worker.py::test_worker_listens_on_same_interface_by_default[Nanny] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 91%] 1970s tests/test_worker.py::test_close_gracefully <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 91%] 1972s tests/test_worker.py::test_close_gracefully_no_suspicious_tasks <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 91%] 1972s tests/test_worker.py::test_close_while_executing[False] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 91%] 1974s tests/test_worker.py::test_close_while_executing[True] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 91%] 1975s tests/test_worker.py::test_close_async_task_handles_cancellation <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 91%] 1979s tests/test_worker.py::test_lifetime <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 91%] 1979s tests/test_worker.py::test_lifetime_stagger <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 91%] 1979s tests/test_worker.py::test_bad_metrics <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 91%] 1979s tests/test_worker.py::test_bad_startup <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 91%] 1979s tests/test_worker.py::test_update_latency <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 91%] 1983s tests/test_worker.py::test_workerstate_executing <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 91%] 1983s tests/test_worker.py::test_shutdown_on_scheduler_comm_closed <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 91%] 1983s tests/test_worker.py::test_heartbeat_comm_closed <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 92%] 1983s tests/test_worker.py::test_heartbeat_missing <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 92%] 1983s tests/test_worker.py::test_heartbeat_missing_real_cluster <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 92%] 1987s tests/test_worker.py::test_heartbeat_missing_doesnt_restart <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 92%] 1987s tests/test_worker.py::test_bad_local_directory <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 92%] 1987s tests/test_worker.py::test_taskstate_metadata <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 92%] 1987s tests/test_worker.py::test_executor_offload <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 92%] 1987s tests/test_worker.py::test_story <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 92%] 1987s tests/test_worker.py::test_stimulus_story <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 92%] 1990s tests/test_worker.py::test_worker_descopes_data <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 92%] 1991s tests/test_worker.py::test_gather_dep_one_worker_always_busy <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 92%] 1991s tests/test_worker.py::test_gather_dep_local_workers_first <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 92%] 1992s tests/test_worker.py::test_gather_dep_from_remote_workers_if_all_local_workers_are_busy <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 92%] 1992s tests/test_worker.py::test_worker_client_uses_default_no_close <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 92%] 1992s tests/test_worker.py::test_worker_client_closes_if_created_on_worker_one_worker <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 92%] 1992s tests/test_worker.py::test_worker_client_closes_if_created_on_worker_last_worker_alive <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 92%] 1992s tests/test_worker.py::test_multiple_executors <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 92%] 1993s tests/test_worker.py::test_bad_executor_annotation <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 92%] 1994s tests/test_worker.py::test_process_executor <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 92%] 1995s tests/test_worker.py::test_process_executor_raise_exception <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 92%] 1996s tests/test_worker.py::test_worker_state_error_release_error_last <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 92%] 1996s tests/test_worker.py::test_worker_state_error_release_error_first <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 92%] 1996s tests/test_worker.py::test_worker_state_error_release_error_int <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 92%] 1996s tests/test_worker.py::test_worker_state_error_long_chain <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 92%] 1997s tests/test_worker.py::test_hold_on_to_replicas <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 92%] 1997s tests/test_worker.py::test_forget_dependents_after_release <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 92%] 1997s tests/test_worker.py::test_acquire_replicas <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 92%] 1997s tests/test_worker.py::test_acquire_replicas_same_channel <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 92%] 1998s tests/test_worker.py::test_acquire_replicas_many <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 92%] 1998s tests/test_worker.py::test_acquire_replicas_already_in_flight <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 92%] 1999s tests/test_worker.py::test_forget_acquire_replicas <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 92%] 1999s tests/test_worker.py::test_remove_replicas_simple <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 92%] 2000s tests/test_worker.py::test_who_has_consistent_remove_replicas <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 92%] 2000s tests/test_worker.py::test_acquire_replicas_with_no_priority <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 92%] 2000s tests/test_worker.py::test_acquire_replicas_large_data <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 92%] 2000s tests/test_worker.py::test_missing_released_zombie_tasks <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 92%] 2001s tests/test_worker.py::test_missing_released_zombie_tasks_2 <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 92%] 2001s tests/test_worker.py::test_worker_status_sync <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 93%] 2001s tests/test_worker.py::test_log_remove_worker <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 93%] 2001s tests/test_worker.py::test_task_flight_compute_oserror <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 93%] 2002s tests/test_worker.py::test_gather_dep_cancelled_rescheduled <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 93%] 2002s tests/test_worker.py::test_gather_dep_do_not_handle_response_of_not_requested_tasks <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 93%] 2002s tests/test_worker.py::test_gather_dep_no_longer_in_flight_tasks <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 93%] 2004s tests/test_worker.py::test_get_data_cancelled_error <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 93%] 2004s tests/test_worker.py::test_Worker__to_dict <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 93%] 2004s tests/test_worker.py::test_extension_methods <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 93%] 2004s tests/test_worker.py::test_benchmark_hardware <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 93%] 2014s tests/test_worker.py::test_tick_interval <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 93%] 2016s tests/test_worker.py::test_broken_comm <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 93%] 2016s tests/test_worker.py::test_do_not_block_event_loop_during_shutdown <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 93%] 2016s tests/test_worker.py::test_reconnect_argument_deprecated <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 93%] 2016s tests/test_worker.py::test_worker_running_before_running_plugins <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 93%] 2016s tests/test_worker.py::test_execute_preamble_abort_retirement <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 93%] 2016s tests/test_worker.py::test_deprecation_of_renamed_worker_attributes <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 93%] 2018s tests/test_worker.py::test_forward_output <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 93%] 2018s tests/test_worker.py::test_offload_getdata <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 93%] 2019s tests/test_worker.py::test_startstops <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 93%] 2019s tests/test_worker.py::test_suppress_keyerror_for_cancelled_tasks[cancelled] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 93%] 2019s tests/test_worker.py::test_suppress_keyerror_for_cancelled_tasks[resumed] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 93%] 2019s tests/test_worker.py::test_suppress_compute_failure_for_cancelled_tasks <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 93%] 2019s tests/test_worker_client.py::test_submit_from_worker <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_client.py PASSED [ 93%] 2021s tests/test_worker_client.py::test_submit_from_worker_async <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_client.py PASSED [ 93%] 2021s tests/test_worker_client.py::test_scatter_from_worker <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_client.py PASSED [ 93%] 2021s tests/test_worker_client.py::test_scatter_singleton <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_client.py PASSED [ 93%] 2021s tests/test_worker_client.py::test_gather_multi_machine <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_client.py PASSED [ 93%] 2021s tests/test_worker_client.py::test_same_loop <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_client.py PASSED [ 93%] 2024s tests/test_worker_client.py::test_sync <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_client.py PASSED [ 93%] 2024s tests/test_worker_client.py::test_async <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_client.py PASSED [ 93%] 2025s tests/test_worker_client.py::test_separate_thread_false <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_client.py PASSED [ 93%] 2025s tests/test_worker_client.py::test_client_executor <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_client.py PASSED [ 93%] 2025s tests/test_worker_client.py::test_dont_override_default_get <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_client.py PASSED [ 93%] 2025s tests/test_worker_client.py::test_local_client_warning <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_client.py PASSED [ 93%] 2025s tests/test_worker_client.py::test_closing_worker_doesnt_close_client <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_client.py PASSED [ 93%] 2028s tests/test_worker_client.py::test_timeout <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_client.py PASSED [ 94%] 2028s tests/test_worker_client.py::test_secede_without_stealing_issue_1262 <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_client.py PASSED [ 94%] 2028s tests/test_worker_client.py::test_compute_within_worker_client <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_client.py PASSED [ 94%] 2028s tests/test_worker_client.py::test_worker_client_rejoins <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_client.py PASSED [ 94%] 2028s tests/test_worker_client.py::test_submit_different_names <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_client.py XPASS [ 94%] 2029s tests/test_worker_client.py::test_secede_does_not_claim_worker <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_client.py PASSED [ 94%] 2030s tests/test_worker_client.py::test_log_event <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_client.py PASSED [ 94%] 2030s tests/test_worker_client.py::test_log_event_implicit <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_client.py PASSED [ 94%] 2030s tests/test_worker_memory.py::test_parse_memory_limit_zero <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 94%] 2030s tests/test_worker_memory.py::test_resource_limit <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 94%] 2030s tests/test_worker_memory.py::test_parse_memory_limit_worker <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 94%] 2030s tests/test_worker_memory.py::test_parse_memory_limit_worker_relative <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 94%] 2031s tests/test_worker_memory.py::test_parse_memory_limit_nanny <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 94%] 2032s tests/test_worker_memory.py::test_dict_data_if_no_spill_to_disk <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 94%] 2032s tests/test_worker_memory.py::test_worker_data_callable_local_directory <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 94%] 2032s tests/test_worker_memory.py::test_worker_data_callable_local_directory_kwargs <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 94%] 2032s tests/test_worker_memory.py::test_worker_data_callable_kwargs <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 94%] 2032s tests/test_worker_memory.py::test_workerstate_fail_to_pickle_execute_1[executing] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 94%] 2032s tests/test_worker_memory.py::test_workerstate_fail_to_pickle_execute_1[long-running] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 94%] 2032s tests/test_worker_memory.py::test_workerstate_fail_to_pickle_flight <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 94%] 2032s tests/test_worker_memory.py::test_fail_to_pickle_execute_2 <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 94%] 2032s tests/test_worker_memory.py::test_fail_to_pickle_spill <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 94%] 2032s tests/test_worker_memory.py::test_spill_target_threshold <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 94%] 2032s tests/test_worker_memory.py::test_spill_constrained <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 94%] 2032s tests/test_worker_memory.py::test_spill_spill_threshold <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 94%] 2033s tests/test_worker_memory.py::test_spill_hysteresis[False-10000000000-1] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 94%] 2033s tests/test_worker_memory.py::test_spill_hysteresis[0.7-0-1] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 94%] 2033s tests/test_worker_memory.py::test_spill_hysteresis[0.4-0-7] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 94%] 2033s tests/test_worker_memory.py::test_pause_executor_manual <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 94%] 2036s tests/test_worker_memory.py::test_pause_executor_with_memory_monitor <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 94%] 2036s tests/test_worker_memory.py::test_pause_prevents_deps_fetch <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 94%] 2036s tests/test_worker_memory.py::test_avoid_memory_monitor_if_zero_limit_worker <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 94%] 2038s tests/test_worker_memory.py::test_avoid_memory_monitor_if_zero_limit_nanny <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 94%] 2038s tests/test_worker_memory.py::test_override_data_worker <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 94%] 2040s tests/test_worker_memory.py::test_override_data_nanny <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 94%] 2042s tests/test_worker_memory.py::test_override_data_vs_memory_monitor <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 94%] 2042s tests/test_worker_memory.py::test_manual_evict_proto <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 95%] 2046s tests/test_worker_memory.py::test_nanny_terminate <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 95%] 2050s tests/test_worker_memory.py::test_disk_cleanup_on_terminate[False] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 95%] 2055s tests/test_worker_memory.py::test_disk_cleanup_on_terminate[True] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 95%] 2057s tests/test_worker_memory.py::test_pause_while_spilling <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 95%] 2060s tests/test_worker_memory.py::test_release_evloop_while_spilling <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 95%] 2061s tests/test_worker_memory.py::test_deprecated_attributes[Worker-memory_limit-123000000000.0] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 95%] 2061s tests/test_worker_memory.py::test_deprecated_attributes[Worker-memory_target_fraction-0.789] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 95%] 2061s tests/test_worker_memory.py::test_deprecated_attributes[Worker-memory_spill_fraction-0.789] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 95%] 2061s tests/test_worker_memory.py::test_deprecated_attributes[Worker-memory_pause_fraction-0.789] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 95%] 2062s tests/test_worker_memory.py::test_deprecated_attributes[Nanny-memory_limit-123000000000.0] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 95%] 2064s tests/test_worker_memory.py::test_deprecated_attributes[Nanny-memory_terminate_fraction-0.789] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 95%] 2064s tests/test_worker_memory.py::test_deprecated_memory_monitor_method_worker <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 95%] 2065s tests/test_worker_memory.py::test_deprecated_memory_monitor_method_nanny <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 95%] 2065s tests/test_worker_memory.py::test_deprecated_params[memory_target_fraction] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 95%] 2065s tests/test_worker_memory.py::test_deprecated_params[memory_spill_fraction] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 95%] 2065s tests/test_worker_memory.py::test_deprecated_params[memory_pause_fraction] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 95%] 2068s tests/test_worker_memory.py::test_pause_while_idle <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 95%] 2070s tests/test_worker_memory.py::test_pause_while_saturated <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 95%] 2070s tests/test_worker_memory.py::test_worker_log_memory_limit_too_high <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 95%] 2070s tests/test_worker_memory.py::test_high_unmanaged_memory_warning <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 95%] 2070s tests/test_worker_memory.py::test_delete_spilled_keys <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 95%] 2071s tests/test_worker_metrics.py::test_task_lifecycle <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_metrics.py PASSED [ 95%] 2071s tests/test_worker_metrics.py::test_async_task <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_metrics.py PASSED [ 95%] 2072s tests/test_worker_metrics.py::test_custom_executor <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_metrics.py PASSED [ 95%] 2073s tests/test_worker_metrics.py::test_offload <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_metrics.py PASSED [ 95%] 2073s tests/test_worker_metrics.py::test_execute_failed <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_metrics.py PASSED [ 95%] 2073s tests/test_worker_metrics.py::test_cancelled_execute <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_metrics.py PASSED [ 95%] 2073s tests/test_worker_metrics.py::test_cancelled_flight <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_metrics.py PASSED [ 95%] 2074s tests/test_worker_metrics.py::test_gather_dep_busy <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_metrics.py PASSED [ 95%] 2075s tests/test_worker_metrics.py::test_gather_dep_no_task <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_metrics.py PASSED [ 95%] 2075s tests/test_worker_metrics.py::test_gather_dep_failed <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_metrics.py PASSED [ 95%] 2076s tests/test_worker_metrics.py::test_gather_dep_network_error <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_metrics.py PASSED [ 95%] 2076s tests/test_worker_metrics.py::test_memory_monitor <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_metrics.py PASSED [ 95%] 2076s tests/test_worker_metrics.py::test_user_metrics_sync <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_metrics.py PASSED [ 95%] 2076s tests/test_worker_metrics.py::test_user_metrics_async <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_metrics.py PASSED [ 95%] 2076s tests/test_worker_metrics.py::test_user_metrics_fail <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_metrics.py PASSED [ 96%] 2077s tests/test_worker_metrics.py::test_user_metrics_weird <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_metrics.py PASSED [ 96%] 2079s tests/test_worker_metrics.py::test_do_not_leak_metrics <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_metrics.py PASSED [ 96%] 2080s tests/test_worker_metrics.py::test_reschedule <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_metrics.py PASSED [ 96%] 2080s tests/test_worker_metrics.py::test_send_metrics_to_scheduler <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_metrics.py PASSED [ 96%] 2081s tests/test_worker_metrics.py::test_no_spans_extension <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_metrics.py PASSED [ 96%] 2081s tests/test_worker_metrics.py::test_new_metrics_during_heartbeat <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_metrics.py PASSED [ 96%] 2082s tests/test_worker_metrics.py::test_delayed_ledger_is_not_reentrant <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_metrics.py PASSED [ 96%] 2082s tests/test_worker_metrics.py::test_int_metrics <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_metrics.py PASSED [ 96%] 2082s tests/test_worker_state_machine.py::test_instruction_match <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 96%] 2084s tests/test_worker_state_machine.py::test_TaskState_tracking <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 96%] 2084s tests/test_worker_state_machine.py::test_TaskState_get_nbytes <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 96%] 2084s tests/test_worker_state_machine.py::test_TaskState_eq <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 96%] 2084s tests/test_worker_state_machine.py::test_TaskState__to_dict <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 96%] 2084s tests/test_worker_state_machine.py::test_TaskState_repr <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 96%] 2084s tests/test_worker_state_machine.py::test_WorkerState__to_dict <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 96%] 2084s tests/test_worker_state_machine.py::test_WorkerState_pickle <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 96%] 2084s tests/test_worker_state_machine.py::test_pickle_exceptions[False-InvalidTransition-kwargs0] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 96%] 2084s tests/test_worker_state_machine.py::test_pickle_exceptions[False-TransitionCounterMaxExceeded-kwargs1] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 96%] 2084s tests/test_worker_state_machine.py::test_pickle_exceptions[False-InvalidTaskState-kwargs2] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 96%] 2084s tests/test_worker_state_machine.py::test_pickle_exceptions[True-InvalidTransition-kwargs0] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 96%] 2084s tests/test_worker_state_machine.py::test_pickle_exceptions[True-TransitionCounterMaxExceeded-kwargs1] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 96%] 2084s tests/test_worker_state_machine.py::test_pickle_exceptions[True-InvalidTaskState-kwargs2] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 96%] 2084s tests/test_worker_state_machine.py::test_slots[TaskState] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 96%] 2084s tests/test_worker_state_machine.py::test_slots[Instruction] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 96%] 2084s tests/test_worker_state_machine.py::test_slots[GatherDep] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 96%] 2084s tests/test_worker_state_machine.py::test_slots[Execute] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 96%] 2084s tests/test_worker_state_machine.py::test_slots[RetryBusyWorkerLater] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 96%] 2084s tests/test_worker_state_machine.py::test_slots[SendMessageToScheduler] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 96%] 2084s tests/test_worker_state_machine.py::test_slots[TaskFinishedMsg] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 96%] 2084s tests/test_worker_state_machine.py::test_slots[TaskErredMsg] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 96%] 2084s tests/test_worker_state_machine.py::test_slots[ReleaseWorkerDataMsg] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 96%] 2084s tests/test_worker_state_machine.py::test_slots[RescheduleMsg] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 96%] 2084s tests/test_worker_state_machine.py::test_slots[LongRunningMsg] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 96%] 2084s tests/test_worker_state_machine.py::test_slots[AddKeysMsg] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 96%] 2084s tests/test_worker_state_machine.py::test_slots[RequestRefreshWhoHasMsg] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 96%] 2084s tests/test_worker_state_machine.py::test_slots[StealResponseMsg] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 96%] 2084s tests/test_worker_state_machine.py::test_slots[StateMachineEvent] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 97%] 2084s tests/test_worker_state_machine.py::test_slots[PauseEvent] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 97%] 2084s tests/test_worker_state_machine.py::test_slots[UnpauseEvent] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 97%] 2084s tests/test_worker_state_machine.py::test_slots[RetryBusyWorkerEvent] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 97%] 2084s tests/test_worker_state_machine.py::test_slots[GatherDepDoneEvent] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 97%] 2084s tests/test_worker_state_machine.py::test_slots[GatherDepSuccessEvent] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 97%] 2084s tests/test_worker_state_machine.py::test_slots[GatherDepBusyEvent] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 97%] 2084s tests/test_worker_state_machine.py::test_slots[GatherDepNetworkFailureEvent] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 97%] 2084s tests/test_worker_state_machine.py::test_slots[GatherDepFailureEvent] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 97%] 2084s tests/test_worker_state_machine.py::test_slots[RemoveWorkerEvent] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 97%] 2084s tests/test_worker_state_machine.py::test_slots[ComputeTaskEvent] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 97%] 2084s tests/test_worker_state_machine.py::test_slots[ExecuteDoneEvent] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 97%] 2084s tests/test_worker_state_machine.py::test_slots[ExecuteSuccessEvent] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 97%] 2084s tests/test_worker_state_machine.py::test_slots[ExecuteFailureEvent] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 97%] 2084s tests/test_worker_state_machine.py::test_slots[RescheduleEvent] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 97%] 2084s tests/test_worker_state_machine.py::test_slots[CancelComputeEvent] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 97%] 2084s tests/test_worker_state_machine.py::test_slots[FindMissingEvent] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 97%] 2084s tests/test_worker_state_machine.py::test_slots[RefreshWhoHasEvent] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 97%] 2084s tests/test_worker_state_machine.py::test_slots[AcquireReplicasEvent] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 97%] 2084s tests/test_worker_state_machine.py::test_slots[RemoveReplicasEvent] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 97%] 2084s tests/test_worker_state_machine.py::test_slots[FreeKeysEvent] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 97%] 2084s tests/test_worker_state_machine.py::test_slots[StealRequestEvent] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 97%] 2084s tests/test_worker_state_machine.py::test_slots[UpdateDataEvent] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 97%] 2084s tests/test_worker_state_machine.py::test_slots[SecedeEvent] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 97%] 2084s tests/test_worker_state_machine.py::test_sendmsg_to_dict <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 97%] 2084s tests/test_worker_state_machine.py::test_merge_recs_instructions <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 97%] 2084s tests/test_worker_state_machine.py::test_event_to_dict_with_annotations <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 97%] 2084s tests/test_worker_state_machine.py::test_event_to_dict_without_annotations <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 97%] 2084s tests/test_worker_state_machine.py::test_computetask_to_dict <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 97%] 2084s tests/test_worker_state_machine.py::test_computetask_dummy <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 97%] 2084s tests/test_worker_state_machine.py::test_updatedata_to_dict <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 97%] 2084s tests/test_worker_state_machine.py::test_executesuccess_to_dict <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 97%] 2084s tests/test_worker_state_machine.py::test_executesuccess_dummy <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 97%] 2084s tests/test_worker_state_machine.py::test_executefailure_to_dict <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 97%] 2084s tests/test_worker_state_machine.py::test_executefailure_dummy <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 97%] 2085s tests/test_worker_state_machine.py::test_fetch_to_compute <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 97%] 2085s tests/test_worker_state_machine.py::test_fetch_via_amm_to_compute <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 98%] 2085s tests/test_worker_state_machine.py::test_lose_replica_during_fetch[False] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 98%] 2085s tests/test_worker_state_machine.py::test_lose_replica_during_fetch[True] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 98%] 2085s tests/test_worker_state_machine.py::test_fetch_to_missing_on_busy <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 98%] 2085s tests/test_worker_state_machine.py::test_new_replica_while_all_workers_in_flight <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 98%] 2085s tests/test_worker_state_machine.py::test_cancelled_while_in_flight <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 98%] 2086s tests/test_worker_state_machine.py::test_in_memory_while_in_flight <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 98%] 2086s tests/test_worker_state_machine.py::test_forget_data_needed <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 98%] 2086s tests/test_worker_state_machine.py::test_missing_handle_compute_dependency <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 98%] 2086s tests/test_worker_state_machine.py::test_missing_to_waiting <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 98%] 2086s tests/test_worker_state_machine.py::test_fetch_to_missing_on_refresh_who_has <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 98%] 2087s tests/test_worker_state_machine.py::test_fetch_to_missing_on_network_failure <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 98%] 2087s tests/test_worker_state_machine.py::test_deprecated_worker_attributes <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 98%] 2087s tests/test_worker_state_machine.py::test_aggregate_gather_deps[10000000-3-1] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 98%] 2087s tests/test_worker_state_machine.py::test_aggregate_gather_deps[10000000-3-2] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 98%] 2087s tests/test_worker_state_machine.py::test_aggregate_gather_deps[20000000-2-1] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 98%] 2087s tests/test_worker_state_machine.py::test_aggregate_gather_deps[20000000-2-2] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 98%] 2087s tests/test_worker_state_machine.py::test_aggregate_gather_deps[30000000-1-1] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 98%] 2087s tests/test_worker_state_machine.py::test_aggregate_gather_deps[30000000-1-2] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 98%] 2087s tests/test_worker_state_machine.py::test_aggregate_gather_deps[60000000-1-1] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 98%] 2087s tests/test_worker_state_machine.py::test_aggregate_gather_deps[60000000-1-2] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 98%] 2087s tests/test_worker_state_machine.py::test_gather_priority <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 98%] 2087s tests/test_worker_state_machine.py::test_task_acquires_resources[executing] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 98%] 2087s tests/test_worker_state_machine.py::test_task_acquires_resources[long-running] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 98%] 2087s tests/test_worker_state_machine.py::test_task_releases_resources[executing-ExecuteSuccessEvent] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 98%] 2087s tests/test_worker_state_machine.py::test_task_releases_resources[executing-ExecuteFailureEvent] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 98%] 2087s tests/test_worker_state_machine.py::test_task_releases_resources[executing-RescheduleEvent] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 98%] 2087s tests/test_worker_state_machine.py::test_task_releases_resources[long-running-ExecuteSuccessEvent] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 98%] 2087s tests/test_worker_state_machine.py::test_task_releases_resources[long-running-ExecuteFailureEvent] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 98%] 2087s tests/test_worker_state_machine.py::test_task_releases_resources[long-running-RescheduleEvent] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 98%] 2087s tests/test_worker_state_machine.py::test_task_with_dependencies_acquires_resources <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 98%] 2087s tests/test_worker_state_machine.py::test_resumed_task_releases_resources[executing-ExecuteSuccessEvent] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 98%] 2087s tests/test_worker_state_machine.py::test_resumed_task_releases_resources[executing-ExecuteFailureEvent] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 98%] 2087s tests/test_worker_state_machine.py::test_resumed_task_releases_resources[executing-RescheduleEvent] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 98%] 2087s tests/test_worker_state_machine.py::test_resumed_task_releases_resources[long-running-ExecuteSuccessEvent] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 98%] 2087s tests/test_worker_state_machine.py::test_resumed_task_releases_resources[long-running-ExecuteFailureEvent] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 98%] 2087s tests/test_worker_state_machine.py::test_resumed_task_releases_resources[long-running-RescheduleEvent] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 99%] 2087s tests/test_worker_state_machine.py::test_clean_log <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 99%] 2087s tests/test_worker_state_machine.py::test_running_task_in_all_running_tasks[executing] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 99%] 2087s tests/test_worker_state_machine.py::test_running_task_in_all_running_tasks[long-running] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 99%] 2087s tests/test_worker_state_machine.py::test_done_task_not_in_all_running_tasks[executing-ExecuteSuccessEvent] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 99%] 2087s tests/test_worker_state_machine.py::test_done_task_not_in_all_running_tasks[executing-ExecuteFailureEvent] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 99%] 2087s tests/test_worker_state_machine.py::test_done_task_not_in_all_running_tasks[executing-RescheduleEvent] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 99%] 2087s tests/test_worker_state_machine.py::test_done_task_not_in_all_running_tasks[long-running-ExecuteSuccessEvent] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 99%] 2087s tests/test_worker_state_machine.py::test_done_task_not_in_all_running_tasks[long-running-ExecuteFailureEvent] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 99%] 2087s tests/test_worker_state_machine.py::test_done_task_not_in_all_running_tasks[long-running-RescheduleEvent] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 99%] 2087s tests/test_worker_state_machine.py::test_done_resumed_task_not_in_all_running_tasks[executing-ExecuteSuccessEvent] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 99%] 2087s tests/test_worker_state_machine.py::test_done_resumed_task_not_in_all_running_tasks[executing-ExecuteFailureEvent] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 99%] 2087s tests/test_worker_state_machine.py::test_done_resumed_task_not_in_all_running_tasks[executing-RescheduleEvent] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 99%] 2087s tests/test_worker_state_machine.py::test_done_resumed_task_not_in_all_running_tasks[long-running-ExecuteSuccessEvent] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 99%] 2087s tests/test_worker_state_machine.py::test_done_resumed_task_not_in_all_running_tasks[long-running-ExecuteFailureEvent] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 99%] 2087s tests/test_worker_state_machine.py::test_done_resumed_task_not_in_all_running_tasks[long-running-RescheduleEvent] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 99%] 2087s tests/test_worker_state_machine.py::test_gather_dep_failure <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 99%] 2087s tests/test_worker_state_machine.py::test_recompute_erred_task <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 99%] 2087s tests/test_worker_state_machine.py::test_transfer_incoming_metrics <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 99%] 2087s tests/test_worker_state_machine.py::test_throttling_does_not_affect_first_transfer <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 99%] 2087s tests/test_worker_state_machine.py::test_message_target_does_not_affect_first_transfer_on_different_worker <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 99%] 2087s tests/test_worker_state_machine.py::test_throttle_incoming_transfers_on_count_limit <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 99%] 2087s tests/test_worker_state_machine.py::test_throttling_incoming_transfer_on_transfer_bytes_same_worker <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 99%] 2087s tests/test_worker_state_machine.py::test_throttling_incoming_transfer_on_transfer_bytes_different_workers <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 99%] 2087s tests/test_worker_state_machine.py::test_do_not_throttle_connections_while_below_threshold <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 99%] 2087s tests/test_worker_state_machine.py::test_throttle_on_transfer_bytes_regardless_of_threshold <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 99%] 2087s tests/test_worker_state_machine.py::test_worker_nbytes[executing] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 99%] 2087s tests/test_worker_state_machine.py::test_worker_nbytes[long-running] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 99%] 2087s tests/test_worker_state_machine.py::test_fetch_count <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 99%] 2087s tests/test_worker_state_machine.py::test_task_counter <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 99%] 2087s tests/test_worker_state_machine.py::test_remove_worker_while_in_flight[fail] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 99%] 2087s tests/test_worker_state_machine.py::test_remove_worker_while_in_flight[success] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 99%] 2087s tests/test_worker_state_machine.py::test_remove_worker_while_in_flight[no-key] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 99%] 2087s tests/test_worker_state_machine.py::test_remove_worker_while_in_flight[busy] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 99%] 2087s tests/test_worker_state_machine.py::test_remove_worker_while_in_flight_unused_peer <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 99%] 2087s tests/test_worker_state_machine.py::test_remove_worker_while_in_fetch <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 99%] 2087s tests/test_worker_state_machine.py::test_remove_worker_unknown <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [100%] 2087s 2087s =================================== FAILURES =================================== 2087s _____________________________ test_retire_workers ______________________________ 2087s 2087s fut = , timeout = 0 2087s 2087s async def wait_for(fut: Awaitable[T], timeout: float) -> T: 2087s async with asyncio.timeout(timeout): 2087s > return await fut 2087s 2087s /usr/lib/python3/dist-packages/distributed/utils.py:1914: 2087s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2087s /usr/lib/python3/dist-packages/distributed/nanny.py:358: in start_unsafe 2087s comm = await self.rpc.connect(saddr) 2087s /usr/lib/python3/dist-packages/distributed/core.py:1485: in connect 2087s return await self._connect(addr=addr, timeout=timeout) 2087s /usr/lib/python3/dist-packages/distributed/core.py:1429: in _connect 2087s comm = await connect( 2087s /usr/lib/python3/dist-packages/distributed/comm/core.py:342: in connect 2087s comm = await wait_for( 2087s /usr/lib/python3/dist-packages/distributed/utils.py:1914: in wait_for 2087s return await fut 2087s /usr/lib/python3/dist-packages/distributed/comm/tcp.py:546: in connect 2087s stream = await self.client.connect( 2087s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2087s 2087s self = 2087s host = '127.0.0.1', port = 35797, af = 2087s ssl_options = 2087s max_buffer_size = 4163035136.0, source_ip = None, source_port = None 2087s timeout = None 2087s 2087s async def connect( 2087s self, 2087s host: str, 2087s port: int, 2087s af: socket.AddressFamily = socket.AF_UNSPEC, 2087s ssl_options: Optional[Union[Dict[str, Any], ssl.SSLContext]] = None, 2087s max_buffer_size: Optional[int] = None, 2087s source_ip: Optional[str] = None, 2087s source_port: Optional[int] = None, 2087s timeout: Optional[Union[float, datetime.timedelta]] = None, 2087s ) -> IOStream: 2087s """Connect to the given host and port. 2087s 2087s Asynchronously returns an `.IOStream` (or `.SSLIOStream` if 2087s ``ssl_options`` is not None). 2087s 2087s Using the ``source_ip`` kwarg, one can specify the source 2087s IP address to use when establishing the connection. 2087s In case the user needs to resolve and 2087s use a specific interface, it has to be handled outside 2087s of Tornado as this depends very much on the platform. 2087s 2087s Raises `TimeoutError` if the input future does not complete before 2087s ``timeout``, which may be specified in any form allowed by 2087s `.IOLoop.add_timeout` (i.e. a `datetime.timedelta` or an absolute time 2087s relative to `.IOLoop.time`) 2087s 2087s Similarly, when the user requires a certain source port, it can 2087s be specified using the ``source_port`` arg. 2087s 2087s .. versionchanged:: 4.5 2087s Added the ``source_ip`` and ``source_port`` arguments. 2087s 2087s .. versionchanged:: 5.0 2087s Added the ``timeout`` argument. 2087s """ 2087s if timeout is not None: 2087s if isinstance(timeout, numbers.Real): 2087s timeout = IOLoop.current().time() + timeout 2087s elif isinstance(timeout, datetime.timedelta): 2087s timeout = IOLoop.current().time() + timeout.total_seconds() 2087s else: 2087s raise TypeError("Unsupported timeout %r" % timeout) 2087s if timeout is not None: 2087s addrinfo = await gen.with_timeout( 2087s timeout, self.resolver.resolve(host, port, af) 2087s ) 2087s else: 2087s addrinfo = await self.resolver.resolve(host, port, af) 2087s connector = _Connector( 2087s addrinfo, 2087s functools.partial( 2087s self._create_stream, 2087s max_buffer_size, 2087s source_ip=source_ip, 2087s source_port=source_port, 2087s ), 2087s ) 2087s > af, addr, stream = await connector.start(connect_timeout=timeout) 2087s E asyncio.exceptions.CancelledError 2087s 2087s /usr/lib/python3/dist-packages/tornado/tcpclient.py:279: CancelledError 2087s 2087s The above exception was the direct cause of the following exception: 2087s 2087s self = 2087s 2087s @final 2087s async def start(self): 2087s async with self._startup_lock: 2087s if self.status == Status.failed: 2087s assert self.__startup_exc is not None 2087s raise self.__startup_exc 2087s elif self.status != Status.init: 2087s return self 2087s timeout = getattr(self, "death_timeout", None) 2087s 2087s async def _close_on_failure(exc: Exception) -> None: 2087s await self.close(reason=f"failure-to-start-{str(type(exc))}") 2087s self.status = Status.failed 2087s self.__startup_exc = exc 2087s 2087s try: 2087s > await wait_for(self.start_unsafe(), timeout=timeout) 2087s 2087s /usr/lib/python3/dist-packages/distributed/core.py:528: 2087s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2087s /usr/lib/python3/dist-packages/distributed/utils.py:1913: in wait_for 2087s async with asyncio.timeout(timeout): 2087s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2087s 2087s self = 2087s exc_type = 2087s exc_val = CancelledError(), exc_tb = 2087s 2087s async def __aexit__( 2087s self, 2087s exc_type: Optional[Type[BaseException]], 2087s exc_val: Optional[BaseException], 2087s exc_tb: Optional[TracebackType], 2087s ) -> Optional[bool]: 2087s assert self._state in (_State.ENTERED, _State.EXPIRING) 2087s 2087s if self._timeout_handler is not None: 2087s self._timeout_handler.cancel() 2087s self._timeout_handler = None 2087s 2087s if self._state is _State.EXPIRING: 2087s self._state = _State.EXPIRED 2087s 2087s if self._task.uncancel() <= self._cancelling and exc_type is exceptions.CancelledError: 2087s # Since there are no new cancel requests, we're 2087s # handling this. 2087s > raise TimeoutError from exc_val 2087s E TimeoutError 2087s 2087s /usr/lib/python3.12/asyncio/timeouts.py:115: TimeoutError 2087s 2087s The above exception was the direct cause of the following exception: 2087s 2087s @contextlib.asynccontextmanager 2087s async def _cluster_factory(): 2087s workers = [] 2087s s = None 2087s try: 2087s for _ in range(60): 2087s try: 2087s > s, ws = await start_cluster( 2087s nthreads, 2087s scheduler, 2087s security=security, 2087s Worker=Worker, 2087s scheduler_kwargs=scheduler_kwargs, 2087s worker_kwargs=merge( 2087s {"death_timeout": min(15, int(deadline.remaining))}, 2087s worker_kwargs, 2087s ), 2087s ) 2087s 2087s /usr/lib/python3/dist-packages/distributed/utils_test.py:974: 2087s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2087s /usr/lib/python3/dist-packages/distributed/utils_test.py:791: in start_cluster 2087s await asyncio.gather(*workers) 2087s /usr/lib/python3.12/asyncio/tasks.py:684: in _wrap_awaitable 2087s return await awaitable 2087s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2087s 2087s self = 2087s 2087s @final 2087s async def start(self): 2087s async with self._startup_lock: 2087s if self.status == Status.failed: 2087s assert self.__startup_exc is not None 2087s raise self.__startup_exc 2087s elif self.status != Status.init: 2087s return self 2087s timeout = getattr(self, "death_timeout", None) 2087s 2087s async def _close_on_failure(exc: Exception) -> None: 2087s await self.close(reason=f"failure-to-start-{str(type(exc))}") 2087s self.status = Status.failed 2087s self.__startup_exc = exc 2087s 2087s try: 2087s await wait_for(self.start_unsafe(), timeout=timeout) 2087s except asyncio.TimeoutError as exc: 2087s await _close_on_failure(exc) 2087s > raise asyncio.TimeoutError( 2087s f"{type(self).__name__} start timed out after {timeout}s." 2087s ) from exc 2087s E TimeoutError: Nanny start timed out after 0s. 2087s 2087s /usr/lib/python3/dist-packages/distributed/core.py:531: TimeoutError 2087s 2087s During handling of the above exception, another exception occurred: 2087s 2087s fut = ._..test_func..async_fn at 0x74ede70f1a80> 2087s timeout = 60 2087s 2087s async def wait_for(fut: Awaitable[T], timeout: float) -> T: 2087s async with asyncio.timeout(timeout): 2087s > return await fut 2087s 2087s /usr/lib/python3/dist-packages/distributed/utils.py:1914: 2087s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2087s /usr/lib/python3/dist-packages/distributed/utils_test.py:1007: in async_fn 2087s _cluster_factory() as (s, workers), 2087s /usr/lib/python3.12/contextlib.py:210: in __aenter__ 2087s return await anext(self.gen) 2087s /usr/lib/python3/dist-packages/distributed/utils_test.py:991: in _cluster_factory 2087s await asyncio.sleep(1) 2087s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2087s 2087s delay = 1, result = None 2087s 2087s async def sleep(delay, result=None): 2087s """Coroutine that completes after a given time (in seconds).""" 2087s if delay <= 0: 2087s await __sleep0() 2087s return result 2087s 2087s loop = events.get_running_loop() 2087s future = loop.create_future() 2087s h = loop.call_later(delay, 2087s futures._set_result_unless_cancelled, 2087s future, result) 2087s try: 2087s > return await future 2087s E asyncio.exceptions.CancelledError 2087s 2087s /usr/lib/python3.12/asyncio/tasks.py:665: CancelledError 2087s 2087s The above exception was the direct cause of the following exception: 2087s 2087s args = (), kwds = {} 2087s 2087s @wraps(func) 2087s def inner(*args, **kwds): 2087s with self._recreate_cm(): 2087s > return func(*args, **kwds) 2087s 2087s /usr/lib/python3.12/contextlib.py:81: 2087s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2087s /usr/lib/python3.12/contextlib.py:81: in inner 2087s return func(*args, **kwds) 2087s /usr/lib/python3/dist-packages/distributed/utils_test.py:1090: in test_func 2087s return _run_and_close_tornado(async_fn_outer) 2087s /usr/lib/python3/dist-packages/distributed/utils_test.py:380: in _run_and_close_tornado 2087s return asyncio_run(inner_fn(), loop_factory=get_loop_factory()) 2087s /usr/lib/python3.12/asyncio/runners.py:195: in run 2087s return runner.run(main) 2087s /usr/lib/python3.12/asyncio/runners.py:118: in run 2087s return self._loop.run_until_complete(task) 2087s /usr/lib/python3.12/asyncio/base_events.py:691: in run_until_complete 2087s return future.result() 2087s /usr/lib/python3/dist-packages/distributed/utils_test.py:377: in inner_fn 2087s return await async_fn(*args, **kwargs) 2087s /usr/lib/python3/dist-packages/distributed/utils_test.py:1087: in async_fn_outer 2087s return await utils_wait_for(async_fn(), timeout=timeout * 2) 2087s /usr/lib/python3/dist-packages/distributed/utils.py:1913: in wait_for 2087s async with asyncio.timeout(timeout): 2087s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 2087s 2087s self = 2087s exc_type = 2087s exc_val = CancelledError(), exc_tb = 2087s 2087s async def __aexit__( 2087s self, 2087s exc_type: Optional[Type[BaseException]], 2087s exc_val: Optional[BaseException], 2087s exc_tb: Optional[TracebackType], 2087s ) -> Optional[bool]: 2087s assert self._state in (_State.ENTERED, _State.EXPIRING) 2087s 2087s if self._timeout_handler is not None: 2087s self._timeout_handler.cancel() 2087s self._timeout_handler = None 2087s 2087s if self._state is _State.EXPIRING: 2087s self._state = _State.EXPIRED 2087s 2087s if self._task.uncancel() <= self._cancelling and exc_type is exceptions.CancelledError: 2087s # Since there are no new cancel requests, we're 2087s # handling this. 2087s > raise TimeoutError from exc_val 2087s E TimeoutError 2087s 2087s /usr/lib/python3.12/asyncio/timeouts.py:115: TimeoutError 2087s ----------------------------- Captured stderr call ----------------------------- 2087s 2025-02-20 23:56:32,719 - distributed.scheduler - INFO - State start 2087s 2025-02-20 23:56:32,725 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:34413 2087s 2025-02-20 23:56:32,728 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:35243/status 2087s 2025-02-20 23:56:32,729 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2087s 2025-02-20 23:56:32,746 - distributed.nanny - INFO - Start Nanny at: 'tls://127.0.0.1:36021' 2087s 2025-02-20 23:56:32,748 - distributed.nanny - INFO - Start Nanny at: 'tls://127.0.0.1:34491' 2087s 2025-02-20 23:56:33,577 - distributed.worker.memory - WARNING - Ignoring provided memory limit 8326070272 due to system memory limit of 7.75 GiB 2087s 2025-02-20 23:56:33,593 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41795 2087s 2025-02-20 23:56:33,593 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41795 2087s 2025-02-20 23:56:33,593 - distributed.worker - INFO - Worker name: 1 2087s 2025-02-20 23:56:33,594 - distributed.worker - INFO - dashboard at: 127.0.0.1:42399 2087s 2025-02-20 23:56:33,594 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34413 2087s 2025-02-20 23:56:33,594 - distributed.worker - INFO - ------------------------------------------------- 2087s 2025-02-20 23:56:33,594 - distributed.worker - INFO - Threads: 2 2087s 2025-02-20 23:56:33,594 - distributed.worker - INFO - Memory: 7.75 GiB 2087s 2025-02-20 23:56:33,594 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-7u2yxm4w 2087s 2025-02-20 23:56:33,594 - distributed.worker - INFO - ------------------------------------------------- 2087s 2025-02-20 23:56:33,618 - distributed.worker.memory - WARNING - Ignoring provided memory limit 8326070272 due to system memory limit of 7.75 GiB 2087s 2025-02-20 23:56:33,633 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36241 2087s 2025-02-20 23:56:33,634 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36241 2087s 2025-02-20 23:56:33,634 - distributed.worker - INFO - Worker name: 0 2087s 2025-02-20 23:56:33,634 - distributed.worker - INFO - dashboard at: 127.0.0.1:38499 2087s 2025-02-20 23:56:33,634 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34413 2087s 2025-02-20 23:56:33,634 - distributed.worker - INFO - ------------------------------------------------- 2087s 2025-02-20 23:56:33,634 - distributed.worker - INFO - Threads: 1 2087s 2025-02-20 23:56:33,634 - distributed.worker - INFO - Memory: 7.75 GiB 2087s 2025-02-20 23:56:33,634 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-k16zuo04 2087s 2025-02-20 23:56:33,634 - distributed.worker - INFO - ------------------------------------------------- 2087s 2025-02-20 23:56:33,866 - distributed.scheduler - INFO - Register worker addr: tls://127.0.0.1:41795 name: 1 2087s 2025-02-20 23:56:33,870 - distributed.worker - INFO - Starting Worker plugin shuffle 2087s 2025-02-20 23:56:33,871 - distributed.worker - INFO - Registered to: tls://127.0.0.1:34413 2087s 2025-02-20 23:56:33,871 - distributed.worker - INFO - ------------------------------------------------- 2087s 2025-02-20 23:56:33,871 - distributed.core - INFO - Starting established connection to tls://127.0.0.1:34413 2087s 2025-02-20 23:56:33,870 - distributed.scheduler - INFO - Starting worker compute stream, tls://127.0.0.1:41795 2087s 2025-02-20 23:56:33,872 - distributed.core - INFO - Starting established connection to tls://127.0.0.1:38052 2087s 2025-02-20 23:56:33,930 - distributed.scheduler - INFO - Register worker addr: tls://127.0.0.1:36241 name: 0 2087s 2025-02-20 23:56:33,934 - distributed.worker - INFO - Starting Worker plugin shuffle 2087s 2025-02-20 23:56:33,934 - distributed.worker - INFO - Registered to: tls://127.0.0.1:34413 2087s 2025-02-20 23:56:33,934 - distributed.worker - INFO - ------------------------------------------------- 2087s 2025-02-20 23:56:33,933 - distributed.scheduler - INFO - Starting worker compute stream, tls://127.0.0.1:36241 2087s 2025-02-20 23:56:33,935 - distributed.core - INFO - Starting established connection to tls://127.0.0.1:38066 2087s 2025-02-20 23:56:33,935 - distributed.core - INFO - Starting established connection to tls://127.0.0.1:34413 2087s 2025-02-20 23:56:33,935 - distributed.core - INFO - Connection to tls://127.0.0.1:38066 has been closed. 2087s 2025-02-20 23:56:33,935 - distributed.core - INFO - Connection to tls://127.0.0.1:34413 has been closed. 2087s 2025-02-20 23:56:33,935 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36241. Reason: worker-handle-scheduler-connection-broken 2087s 2025-02-20 23:56:33,935 - distributed.scheduler - INFO - Remove worker addr: tls://127.0.0.1:36241 name: 0 (stimulus_id='handle-worker-cleanup-1740095793.935507') 2087s 2025-02-20 23:56:33,959 - distributed.nanny - INFO - Closing Nanny gracefully at 'tls://127.0.0.1:36021'. Reason: worker-handle-scheduler-connection-broken 2087s 2025-02-20 23:56:33,959 - distributed.worker - INFO - Removing Worker plugin shuffle 2087s 2025-02-20 23:56:33,960 - distributed.nanny - INFO - Worker closed 2087s 2025-02-20 23:56:35,962 - distributed.nanny - ERROR - Worker process died unexpectedly 2087s 2025-02-20 23:56:36,118 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:36021'. Reason: nanny-close-gracefully 2087s 2025-02-20 23:56:36,118 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:36021' closed. 2087s 2025-02-20 23:57:03,968 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:34491'. Reason: nanny-close 2087s 2025-02-20 23:57:03,969 - distributed.nanny - INFO - Nanny asking worker to close. Reason: nanny-close 2087s 2025-02-20 23:57:03,970 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41795. Reason: nanny-close 2087s 2025-02-20 23:57:03,970 - distributed.worker - INFO - Removing Worker plugin shuffle 2087s 2025-02-20 23:57:03,972 - distributed.core - INFO - Received 'close-stream' from tls://127.0.0.1:38052; closing. 2087s 2025-02-20 23:57:03,972 - distributed.core - INFO - Connection to tls://127.0.0.1:34413 has been closed. 2087s 2025-02-20 23:57:03,973 - distributed.nanny - INFO - Worker closed 2087s 2025-02-20 23:57:03,972 - distributed.scheduler - INFO - Remove worker addr: tls://127.0.0.1:41795 name: 1 (stimulus_id='handle-worker-cleanup-1740095823.9725966') 2087s 2025-02-20 23:57:03,976 - distributed.scheduler - INFO - Lost all workers 2087s 2025-02-20 23:57:04,132 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:34491' closed. 2087s 2025-02-20 23:57:04,133 - distributed.scheduler - INFO - Closing scheduler. Reason: unknown 2087s 2025-02-20 23:57:04,136 - distributed.scheduler - INFO - Scheduler closing all comms 2087s 2025-02-20 23:57:04,139 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Cluster creation timeout; retrying 2087s Traceback (most recent call last): 2087s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 974, in _cluster_factory 2087s s, ws = await start_cluster( 2087s ^^^^^^^^^^^^^^^^^^^^ 2087s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 806, in start_cluster 2087s raise TimeoutError("Cluster creation timeout") 2087s TimeoutError: Cluster creation timeout 2087s 2025-02-20 23:57:05,142 - distributed.scheduler - INFO - State start 2087s 2025-02-20 23:57:05,148 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:33069 2087s 2025-02-20 23:57:05,150 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:39127/status 2087s 2025-02-20 23:57:05,152 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2087s 2025-02-20 23:57:05,159 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:36567'. Reason: failure-to-start- 2087s 2025-02-20 23:57:05,159 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:36567' closed. 2087s 2025-02-20 23:57:05,159 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:41519'. Reason: failure-to-start- 2087s 2025-02-20 23:57:05,159 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:41519' closed. 2087s 2025-02-20 23:57:05,160 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33069': TLS handshake failed with remote 'tls://127.0.0.1:43498': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1011) 2087s 2025-02-20 23:57:05,160 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33069': TLS handshake failed with remote 'tls://127.0.0.1:43504': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1011) 2087s 2025-02-20 23:57:05,160 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 2087s Traceback (most recent call last): 2087s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 2087s return await fut 2087s ^^^^^^^^^ 2087s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 2087s comm = await self.rpc.connect(saddr) 2087s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2087s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1485, in connect 2087s return await self._connect(addr=addr, timeout=timeout) 2087s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2087s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1429, in _connect 2087s comm = await connect( 2087s ^^^^^^^^^^^^^^ 2087s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2087s comm = await wait_for( 2087s ^^^^^^^^^^^^^^^ 2087s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 2087s return await fut 2087s ^^^^^^^^^ 2087s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2087s stream = await self.client.connect( 2087s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2087s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2087s af, addr, stream = await connector.start(connect_timeout=timeout) 2087s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2087s asyncio.exceptions.CancelledError 2087s 2087s The above exception was the direct cause of the following exception: 2087s 2087s Traceback (most recent call last): 2087s File "/usr/lib/python3/dist-packages/distributed/core.py", line 528, in start 2087s await wait_for(self.start_unsafe(), timeout=timeout) 2087s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1913, in wait_for 2087s async with asyncio.timeout(timeout): 2087s ^^^^^^^^^^^^^^^^^^^^^^^^ 2087s File "/usr/lib/python3.12/asyncio/timeouts.py", line 115, in __aexit__ 2087s raise TimeoutError from exc_val 2087s TimeoutError 2087s 2087s The above exception was the direct cause of the following exception: 2087s 2087s Traceback (most recent call last): 2087s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 974, in _cluster_factory 2087s s, ws = await start_cluster( 2087s ^^^^^^^^^^^^^^^^^^^^ 2087s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 791, in start_cluster 2087s await asyncio.gather(*workers) 2087s File "/usr/lib/python3.12/asyncio/tasks.py", line 684, in _wrap_awaitable 2087s return await awaitable 2087s ^^^^^^^^^^^^^^^ 2087s File "/usr/lib/python3/dist-packages/distributed/core.py", line 531, in start 2087s raise asyncio.TimeoutError( 2087s TimeoutError: Nanny start timed out after 0s. 2087s 2025-02-20 23:57:06,163 - distributed.scheduler - INFO - State start 2087s 2025-02-20 23:57:06,169 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:39961 2087s 2025-02-20 23:57:06,172 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:32989/status 2087s 2025-02-20 23:57:06,173 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2087s 2025-02-20 23:57:06,180 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:45597'. Reason: failure-to-start- 2087s 2025-02-20 23:57:06,181 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:45597' closed. 2087s 2025-02-20 23:57:06,181 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:38443'. Reason: failure-to-start- 2087s 2025-02-20 23:57:06,181 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:38443' closed. 2087s 2025-02-20 23:57:06,181 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39961': TLS handshake failed with remote 'tls://127.0.0.1:42104': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1011) 2087s 2025-02-20 23:57:06,181 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39961': TLS handshake failed with remote 'tls://127.0.0.1:42106': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1011) 2087s 2025-02-20 23:57:06,181 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 2087s Traceback (most recent call last): 2087s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 2087s return await fut 2087s ^^^^^^^^^ 2087s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 2087s comm = await self.rpc.connect(saddr) 2087s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2087s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1485, in connect 2087s return await self._connect(addr=addr, timeout=timeout) 2087s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2087s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1429, in _connect 2087s comm = await connect( 2087s ^^^^^^^^^^^^^^ 2087s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2087s comm = await wait_for( 2087s ^^^^^^^^^^^^^^^ 2087s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 2087s return await fut 2087s ^^^^^^^^^ 2087s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2087s stream = await self.client.connect( 2087s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2087s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2087s af, addr, stream = await connector.start(connect_timeout=timeout) 2087s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2087s asyncio.exceptions.CancelledError 2087s 2087s The above exception was the direct cause of the following exception: 2087s 2087s Traceback (most recent call last): 2087s File "/usr/lib/python3/dist-packages/distributed/core.py", line 528, in start 2087s await wait_for(self.start_unsafe(), timeout=timeout) 2087s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1913, in wait_for 2087s async with asyncio.timeout(timeout): 2087s ^^^^^^^^^^^^^^^^^^^^^^^^ 2087s File "/usr/lib/python3.12/asyncio/timeouts.py", line 115, in __aexit__ 2087s raise TimeoutError from exc_val 2087s TimeoutError 2087s 2087s The above exception was the direct cause of the following exception: 2087s 2087s Traceback (most recent call last): 2087s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 974, in _cluster_factory 2087s s, ws = await start_cluster( 2087s ^^^^^^^^^^^^^^^^^^^^ 2087s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 791, in start_cluster 2087s await asyncio.gather(*workers) 2087s File "/usr/lib/python3.12/asyncio/tasks.py", line 684, in _wrap_awaitable 2087s return await awaitable 2087s ^^^^^^^^^^^^^^^ 2087s File "/usr/lib/python3/dist-packages/distributed/core.py", line 531, in start 2087s raise asyncio.TimeoutError( 2087s TimeoutError: Nanny start timed out after 0s. 2087s 2025-02-20 23:57:07,185 - distributed.scheduler - INFO - State start 2087s 2025-02-20 23:57:07,191 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:34923 2087s 2025-02-20 23:57:07,194 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:37653/status 2087s 2025-02-20 23:57:07,195 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2087s 2025-02-20 23:57:07,202 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:42561'. Reason: failure-to-start- 2087s 2025-02-20 23:57:07,202 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:42561' closed. 2087s 2025-02-20 23:57:07,203 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:44483'. Reason: failure-to-start- 2087s 2025-02-20 23:57:07,203 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:44483' closed. 2087s 2025-02-20 23:57:07,203 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34923': TLS handshake failed with remote 'tls://127.0.0.1:59704': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1011) 2087s 2025-02-20 23:57:07,203 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34923': TLS handshake failed with remote 'tls://127.0.0.1:59714': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1011) 2087s 2025-02-20 23:57:07,203 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 2087s Traceback (most recent call last): 2087s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 2087s return await fut 2087s ^^^^^^^^^ 2087s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 2087s comm = await self.rpc.connect(saddr) 2087s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2087s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1485, in connect 2087s return await self._connect(addr=addr, timeout=timeout) 2087s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2087s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1429, in _connect 2087s comm = await connect( 2087s ^^^^^^^^^^^^^^ 2087s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2087s comm = await wait_for( 2087s ^^^^^^^^^^^^^^^ 2087s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 2087s return await fut 2087s ^^^^^^^^^ 2087s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2087s stream = await self.client.connect( 2087s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2087s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2087s af, addr, stream = await connector.start(connect_timeout=timeout) 2087s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2087s asyncio.exceptions.CancelledError 2087s 2087s The above exception was the direct cause of the following exception: 2087s 2087s Traceback (most recent call last): 2087s File "/usr/lib/python3/dist-packages/distributed/core.py", line 528, in start 2087s await wait_for(self.start_unsafe(), timeout=timeout) 2087s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1913, in wait_for 2087s async with asyncio.timeout(timeout): 2087s ^^^^^^^^^^^^^^^^^^^^^^^^ 2087s File "/usr/lib/python3.12/asyncio/timeouts.py", line 115, in __aexit__ 2087s raise TimeoutError from exc_val 2087s TimeoutError 2087s 2087s The above exception was the direct cause of the following exception: 2087s 2087s Traceback (most recent call last): 2087s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 974, in _cluster_factory 2087s s, ws = await start_cluster( 2087s ^^^^^^^^^^^^^^^^^^^^ 2087s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 791, in start_cluster 2087s await asyncio.gather(*workers) 2087s File "/usr/lib/python3.12/asyncio/tasks.py", line 684, in _wrap_awaitable 2087s return await awaitable 2087s ^^^^^^^^^^^^^^^ 2087s File "/usr/lib/python3/dist-packages/distributed/core.py", line 531, in start 2087s raise asyncio.TimeoutError( 2087s TimeoutError: Nanny start timed out after 0s. 2087s 2025-02-20 23:57:08,206 - distributed.scheduler - INFO - State start 2087s 2025-02-20 23:57:08,212 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:36363 2087s 2025-02-20 23:57:08,213 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:45687/status 2087s 2025-02-20 23:57:08,215 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2087s 2025-02-20 23:57:08,221 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:37135'. Reason: failure-to-start- 2087s 2025-02-20 23:57:08,221 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:37135' closed. 2087s 2025-02-20 23:57:08,222 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:46169'. Reason: failure-to-start- 2087s 2025-02-20 23:57:08,222 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:46169' closed. 2087s 2025-02-20 23:57:08,222 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36363': TLS handshake failed with remote 'tls://127.0.0.1:33670': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1011) 2087s 2025-02-20 23:57:08,222 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36363': TLS handshake failed with remote 'tls://127.0.0.1:33674': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1011) 2087s 2025-02-20 23:57:08,222 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 2087s Traceback (most recent call last): 2087s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 2087s return await fut 2087s ^^^^^^^^^ 2087s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 2087s comm = await self.rpc.connect(saddr) 2087s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2087s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1485, in connect 2087s return await self._connect(addr=addr, timeout=timeout) 2087s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2087s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1429, in _connect 2087s comm = await connect( 2087s ^^^^^^^^^^^^^^ 2087s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2087s comm = await wait_for( 2087s ^^^^^^^^^^^^^^^ 2087s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 2087s return await fut 2087s ^^^^^^^^^ 2087s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2087s stream = await self.client.connect( 2087s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2087s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2087s af, addr, stream = await connector.start(connect_timeout=timeout) 2087s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2087s asyncio.exceptions.CancelledError 2087s 2087s The above exception was the direct cause of the following exception: 2087s 2087s Traceback (most recent call last): 2087s File "/usr/lib/python3/dist-packages/distributed/core.py", line 528, in start 2087s await wait_for(self.start_unsafe(), timeout=timeout) 2087s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1913, in wait_for 2087s async with asyncio.timeout(timeout): 2087s ^^^^^^^^^^^^^^^^^^^^^^^^ 2087s File "/usr/lib/python3.12/asyncio/timeouts.py", line 115, in __aexit__ 2087s raise TimeoutError from exc_val 2087s TimeoutError 2087s 2087s The above exception was the direct cause of the following exception: 2087s 2087s Traceback (most recent call last): 2087s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 974, in _cluster_factory 2087s s, ws = await start_cluster( 2087s ^^^^^^^^^^^^^^^^^^^^ 2087s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 791, in start_cluster 2087s await asyncio.gather(*workers) 2087s File "/usr/lib/python3.12/asyncio/tasks.py", line 684, in _wrap_awaitable 2087s return await awaitable 2087s ^^^^^^^^^^^^^^^ 2087s File "/usr/lib/python3/dist-packages/distributed/core.py", line 531, in start 2087s raise asyncio.TimeoutError( 2087s TimeoutError: Nanny start timed out after 0s. 2087s 2025-02-20 23:57:09,226 - distributed.scheduler - INFO - State start 2087s 2025-02-20 23:57:09,233 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:41631 2087s 2025-02-20 23:57:09,236 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:43269/status 2087s 2025-02-20 23:57:09,237 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2087s 2025-02-20 23:57:09,245 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:33423'. Reason: failure-to-start- 2087s 2025-02-20 23:57:09,245 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:33423' closed. 2087s 2025-02-20 23:57:09,246 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:36085'. Reason: failure-to-start- 2087s 2025-02-20 23:57:09,246 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:36085' closed. 2087s 2025-02-20 23:57:09,246 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41631': TLS handshake failed with remote 'tls://127.0.0.1:39506': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1011) 2087s 2025-02-20 23:57:09,247 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41631': TLS handshake failed with remote 'tls://127.0.0.1:39510': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1011) 2087s 2025-02-20 23:57:09,247 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 2087s Traceback (most recent call last): 2087s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 2087s return await fut 2087s ^^^^^^^^^ 2087s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 2087s comm = await self.rpc.connect(saddr) 2087s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2087s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1485, in connect 2087s return await self._connect(addr=addr, timeout=timeout) 2087s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2087s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1429, in _connect 2087s comm = await connect( 2087s ^^^^^^^^^^^^^^ 2087s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2087s comm = await wait_for( 2087s ^^^^^^^^^^^^^^^ 2087s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 2087s return await fut 2087s ^^^^^^^^^ 2087s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2087s stream = await self.client.connect( 2087s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2087s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2087s af, addr, stream = await connector.start(connect_timeout=timeout) 2087s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2087s asyncio.exceptions.CancelledError 2087s 2087s The above exception was the direct cause of the following exception: 2087s 2087s Traceback (most recent call last): 2087s File "/usr/lib/python3/dist-packages/distributed/core.py", line 528, in start 2087s await wait_for(self.start_unsafe(), timeout=timeout) 2087s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1913, in wait_for 2087s async with asyncio.timeout(timeout): 2087s ^^^^^^^^^^^^^^^^^^^^^^^^ 2087s File "/usr/lib/python3.12/asyncio/timeouts.py", line 115, in __aexit__ 2087s raise TimeoutError from exc_val 2087s TimeoutError 2087s 2087s The above exception was the direct cause of the following exception: 2087s 2087s Traceback (most recent call last): 2087s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 974, in _cluster_factory 2087s s, ws = await start_cluster( 2087s ^^^^^^^^^^^^^^^^^^^^ 2087s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 791, in start_cluster 2087s await asyncio.gather(*workers) 2087s File "/usr/lib/python3.12/asyncio/tasks.py", line 684, in _wrap_awaitable 2087s return await awaitable 2087s ^^^^^^^^^^^^^^^ 2087s File "/usr/lib/python3/dist-packages/distributed/core.py", line 531, in start 2087s raise asyncio.TimeoutError( 2087s TimeoutError: Nanny start timed out after 0s. 2087s 2025-02-20 23:57:10,251 - distributed.scheduler - INFO - State start 2087s 2025-02-20 23:57:10,257 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:35461 2087s 2025-02-20 23:57:10,260 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:39545/status 2087s 2025-02-20 23:57:10,261 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2087s 2025-02-20 23:57:10,268 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:41009'. Reason: failure-to-start- 2087s 2025-02-20 23:57:10,269 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:41009' closed. 2087s 2025-02-20 23:57:10,269 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:38853'. Reason: failure-to-start- 2087s 2025-02-20 23:57:10,269 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:38853' closed. 2087s 2025-02-20 23:57:10,270 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35461': TLS handshake failed with remote 'tls://127.0.0.1:48366': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1011) 2087s 2025-02-20 23:57:10,270 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35461': TLS handshake failed with remote 'tls://127.0.0.1:48372': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1011) 2087s 2025-02-20 23:57:10,270 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 2087s Traceback (most recent call last): 2087s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 2087s return await fut 2087s ^^^^^^^^^ 2087s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 2087s comm = await self.rpc.connect(saddr) 2087s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2087s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1485, in connect 2087s return await self._connect(addr=addr, timeout=timeout) 2087s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2087s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1429, in _connect 2087s comm = await connect( 2087s ^^^^^^^^^^^^^^ 2087s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2087s comm = await wait_for( 2087s ^^^^^^^^^^^^^^^ 2087s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 2087s return await fut 2087s ^^^^^^^^^ 2087s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2087s stream = await self.client.connect( 2087s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2087s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2087s af, addr, stream = await connector.start(connect_timeout=timeout) 2087s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2087s asyncio.exceptions.CancelledError 2087s 2087s The above exception was the direct cause of the following exception: 2087s 2087s Traceback (most recent call last): 2087s File "/usr/lib/python3/dist-packages/distributed/core.py", line 528, in start 2087s await wait_for(self.start_unsafe(), timeout=timeout) 2087s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1913, in wait_for 2087s async with asyncio.timeout(timeout): 2087s ^^^^^^^^^^^^^^^^^^^^^^^^ 2087s File "/usr/lib/python3.12/asyncio/timeouts.py", line 115, in __aexit__ 2087s raise TimeoutError from exc_val 2087s TimeoutError 2087s 2087s The above exception was the direct cause of the following exception: 2087s 2087s Traceback (most recent call last): 2087s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 974, in _cluster_factory 2087s s, ws = await start_cluster( 2087s ^^^^^^^^^^^^^^^^^^^^ 2087s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 791, in start_cluster 2087s await asyncio.gather(*workers) 2087s File "/usr/lib/python3.12/asyncio/tasks.py", line 684, in _wrap_awaitable 2087s return await awaitable 2087s ^^^^^^^^^^^^^^^ 2087s File "/usr/lib/python3/dist-packages/distributed/core.py", line 531, in start 2087s raise asyncio.TimeoutError( 2087s TimeoutError: Nanny start timed out after 0s. 2087s 2025-02-20 23:57:11,273 - distributed.scheduler - INFO - State start 2087s 2025-02-20 23:57:11,279 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:33553 2087s 2025-02-20 23:57:11,281 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:39385/status 2087s 2025-02-20 23:57:11,282 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2087s 2025-02-20 23:57:11,289 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:46581'. Reason: failure-to-start- 2087s 2025-02-20 23:57:11,289 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:46581' closed. 2087s 2025-02-20 23:57:11,289 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:35621'. Reason: failure-to-start- 2087s 2025-02-20 23:57:11,290 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:35621' closed. 2087s 2025-02-20 23:57:11,290 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33553': TLS handshake failed with remote 'tls://127.0.0.1:57728': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1011) 2087s 2025-02-20 23:57:11,290 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33553': TLS handshake failed with remote 'tls://127.0.0.1:57744': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1011) 2087s 2025-02-20 23:57:11,290 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 2087s Traceback (most recent call last): 2087s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 2087s return await fut 2087s ^^^^^^^^^ 2087s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 2087s comm = await self.rpc.connect(saddr) 2087s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2087s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1485, in connect 2087s return await self._connect(addr=addr, timeout=timeout) 2087s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2087s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1429, in _connect 2087s comm = await connect( 2087s ^^^^^^^^^^^^^^ 2087s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2087s comm = await wait_for( 2087s ^^^^^^^^^^^^^^^ 2087s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 2087s return await fut 2087s ^^^^^^^^^ 2087s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2087s stream = await self.client.connect( 2087s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2087s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2087s af, addr, stream = await connector.start(connect_timeout=timeout) 2087s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2087s asyncio.exceptions.CancelledError 2087s 2087s The above exception was the direct cause of the following exception: 2087s 2087s Traceback (most recent call last): 2087s File "/usr/lib/python3/dist-packages/distributed/core.py", line 528, in start 2087s await wait_for(self.start_unsafe(), timeout=timeout) 2087s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1913, in wait_for 2087s async with asyncio.timeout(timeout): 2087s ^^^^^^^^^^^^^^^^^^^^^^^^ 2087s File "/usr/lib/python3.12/asyncio/timeouts.py", line 115, in __aexit__ 2087s raise TimeoutError from exc_val 2087s TimeoutError 2087s 2087s The above exception was the direct cause of the following exception: 2087s 2087s Traceback (most recent call last): 2087s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 974, in _cluster_factory 2087s s, ws = await start_cluster( 2087s ^^^^^^^^^^^^^^^^^^^^ 2087s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 791, in start_cluster 2087s await asyncio.gather(*workers) 2087s File "/usr/lib/python3.12/asyncio/tasks.py", line 684, in _wrap_awaitable 2087s return await awaitable 2087s ^^^^^^^^^^^^^^^ 2087s File "/usr/lib/python3/dist-packages/distributed/core.py", line 531, in start 2087s raise asyncio.TimeoutError( 2087s TimeoutError: Nanny start timed out after 0s. 2087s 2025-02-20 23:57:12,294 - distributed.scheduler - INFO - State start 2087s 2025-02-20 23:57:12,299 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:34079 2087s 2025-02-20 23:57:12,301 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:33985/status 2087s 2025-02-20 23:57:12,303 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2087s 2025-02-20 23:57:12,310 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:42505'. Reason: failure-to-start- 2087s 2025-02-20 23:57:12,310 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:42505' closed. 2087s 2025-02-20 23:57:12,310 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:45789'. Reason: failure-to-start- 2087s 2025-02-20 23:57:12,310 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:45789' closed. 2087s 2025-02-20 23:57:12,311 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34079': TLS handshake failed with remote 'tls://127.0.0.1:54454': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1011) 2087s 2025-02-20 23:57:12,311 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34079': TLS handshake failed with remote 'tls://127.0.0.1:54466': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1011) 2087s 2025-02-20 23:57:12,311 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 2087s Traceback (most recent call last): 2087s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 2087s return await fut 2087s ^^^^^^^^^ 2087s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 2087s comm = await self.rpc.connect(saddr) 2087s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2087s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1485, in connect 2087s return await self._connect(addr=addr, timeout=timeout) 2087s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2087s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1429, in _connect 2087s comm = await connect( 2087s ^^^^^^^^^^^^^^ 2087s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2087s comm = await wait_for( 2087s ^^^^^^^^^^^^^^^ 2087s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 2087s return await fut 2087s ^^^^^^^^^ 2087s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2087s stream = await self.client.connect( 2087s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2087s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2087s af, addr, stream = await connector.start(connect_timeout=timeout) 2087s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2087s asyncio.exceptions.CancelledError 2087s 2087s The above exception was the direct cause of the following exception: 2087s 2087s Traceback (most recent call last): 2087s File "/usr/lib/python3/dist-packages/distributed/core.py", line 528, in start 2087s await wait_for(self.start_unsafe(), timeout=timeout) 2087s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1913, in wait_for 2087s async with asyncio.timeout(timeout): 2087s ^^^^^^^^^^^^^^^^^^^^^^^^ 2087s File "/usr/lib/python3.12/asyncio/timeouts.py", line 115, in __aexit__ 2087s raise TimeoutError from exc_val 2087s TimeoutError 2087s 2087s The above exception was the direct cause of the following exception: 2087s 2087s Traceback (most recent call last): 2087s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 974, in _cluster_factory 2087s s, ws = await start_cluster( 2087s ^^^^^^^^^^^^^^^^^^^^ 2087s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 791, in start_cluster 2087s await asyncio.gather(*workers) 2087s File "/usr/lib/python3.12/asyncio/tasks.py", line 684, in _wrap_awaitable 2087s return await awaitable 2087s ^^^^^^^^^^^^^^^ 2087s File "/usr/lib/python3/dist-packages/distributed/core.py", line 531, in start 2087s raise asyncio.TimeoutError( 2087s TimeoutError: Nanny start timed out after 0s. 2087s 2025-02-20 23:57:13,315 - distributed.scheduler - INFO - State start 2087s 2025-02-20 23:57:13,322 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:34181 2087s 2025-02-20 23:57:13,326 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:38185/status 2087s 2025-02-20 23:57:13,327 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2087s 2025-02-20 23:57:13,336 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:46689'. Reason: failure-to-start- 2087s 2025-02-20 23:57:13,337 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:46689' closed. 2087s 2025-02-20 23:57:13,337 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:43187'. Reason: failure-to-start- 2087s 2025-02-20 23:57:13,337 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:43187' closed. 2087s 2025-02-20 23:57:13,338 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34181': TLS handshake failed with remote 'tls://127.0.0.1:54664': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1011) 2087s 2025-02-20 23:57:13,338 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34181': TLS handshake failed with remote 'tls://127.0.0.1:54670': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1011) 2087s 2025-02-20 23:57:13,338 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 2087s Traceback (most recent call last): 2087s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 2087s return await fut 2087s ^^^^^^^^^ 2087s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 2087s comm = await self.rpc.connect(saddr) 2087s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2087s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1485, in connect 2087s return await self._connect(addr=addr, timeout=timeout) 2087s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2087s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1429, in _connect 2087s comm = await connect( 2087s ^^^^^^^^^^^^^^ 2087s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2087s comm = await wait_for( 2087s ^^^^^^^^^^^^^^^ 2087s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 2087s return await fut 2087s ^^^^^^^^^ 2087s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2087s stream = await self.client.connect( 2087s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2087s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2087s af, addr, stream = await connector.start(connect_timeout=timeout) 2087s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2087s asyncio.exceptions.CancelledError 2087s 2087s The above exception was the direct cause of the following exception: 2087s 2087s Traceback (most recent call last): 2087s File "/usr/lib/python3/dist-packages/distributed/core.py", line 528, in start 2087s await wait_for(self.start_unsafe(), timeout=timeout) 2087s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1913, in wait_for 2087s async with asyncio.timeout(timeout): 2087s ^^^^^^^^^^^^^^^^^^^^^^^^ 2087s File "/usr/lib/python3.12/asyncio/timeouts.py", line 115, in __aexit__ 2087s raise TimeoutError from exc_val 2087s TimeoutError 2087s 2087s The above exception was the direct cause of the following exception: 2087s 2087s Traceback (most recent call last): 2087s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 974, in _cluster_factory 2087s s, ws = await start_cluster( 2087s ^^^^^^^^^^^^^^^^^^^^ 2087s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 791, in start_cluster 2087s await asyncio.gather(*workers) 2087s File "/usr/lib/python3.12/asyncio/tasks.py", line 684, in _wrap_awaitable 2087s return await awaitable 2087s ^^^^^^^^^^^^^^^ 2087s File "/usr/lib/python3/dist-packages/distributed/core.py", line 531, in start 2087s raise asyncio.TimeoutError( 2087s TimeoutError: Nanny start timed out after 0s. 2087s 2025-02-20 23:57:14,342 - distributed.scheduler - INFO - State start 2087s 2025-02-20 23:57:14,350 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44503 2087s 2025-02-20 23:57:14,353 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:45073/status 2087s 2025-02-20 23:57:14,355 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2087s 2025-02-20 23:57:14,363 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:34587'. Reason: failure-to-start- 2087s 2025-02-20 23:57:14,364 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:34587' closed. 2087s 2025-02-20 23:57:14,364 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:40715'. Reason: failure-to-start- 2087s 2025-02-20 23:57:14,364 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:40715' closed. 2087s 2025-02-20 23:57:14,365 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44503': TLS handshake failed with remote 'tls://127.0.0.1:58198': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1011) 2087s 2025-02-20 23:57:14,365 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44503': TLS handshake failed with remote 'tls://127.0.0.1:58208': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1011) 2087s 2025-02-20 23:57:14,365 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 2087s Traceback (most recent call last): 2087s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 2087s return await fut 2087s ^^^^^^^^^ 2087s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 2087s comm = await self.rpc.connect(saddr) 2087s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2087s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1485, in connect 2087s return await self._connect(addr=addr, timeout=timeout) 2087s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2087s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1429, in _connect 2087s comm = await connect( 2087s ^^^^^^^^^^^^^^ 2087s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2087s comm = await wait_for( 2087s ^^^^^^^^^^^^^^^ 2087s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 2087s return await fut 2087s ^^^^^^^^^ 2087s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2087s stream = await self.client.connect( 2087s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2087s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2087s af, addr, stream = await connector.start(connect_timeout=timeout) 2087s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2087s asyncio.exceptions.CancelledError 2087s 2087s The above exception was the direct cause of the following exception: 2087s 2087s Traceback (most recent call last): 2087s File "/usr/lib/python3/dist-packages/distributed/core.py", line 528, in start 2087s await wait_for(self.start_unsafe(), timeout=timeout) 2087s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1913, in wait_for 2087s async with asyncio.timeout(timeout): 2087s ^^^^^^^^^^^^^^^^^^^^^^^^ 2087s File "/usr/lib/python3.12/asyncio/timeouts.py", line 115, in __aexit__ 2087s raise TimeoutError from exc_val 2087s TimeoutError 2087s 2087s The above exception was the direct cause of the following exception: 2087s 2087s Traceback (most recent call last): 2087s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 974, in _cluster_factory 2087s s, ws = await start_cluster( 2087s ^^^^^^^^^^^^^^^^^^^^ 2087s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 791, in start_cluster 2087s await asyncio.gather(*workers) 2087s File "/usr/lib/python3.12/asyncio/tasks.py", line 684, in _wrap_awaitable 2087s return await awaitable 2087s ^^^^^^^^^^^^^^^ 2087s File "/usr/lib/python3/dist-packages/distributed/core.py", line 531, in start 2087s raise asyncio.TimeoutError( 2087s TimeoutError: Nanny start timed out after 0s. 2087s 2025-02-20 23:57:15,369 - distributed.scheduler - INFO - State start 2087s 2025-02-20 23:57:15,376 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:34917 2087s 2025-02-20 23:57:15,379 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:39797/status 2087s 2025-02-20 23:57:15,381 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2087s 2025-02-20 23:57:15,390 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:35115'. Reason: failure-to-start- 2087s 2025-02-20 23:57:15,390 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:35115' closed. 2087s 2025-02-20 23:57:15,391 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:33579'. Reason: failure-to-start- 2087s 2025-02-20 23:57:15,391 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:33579' closed. 2087s 2025-02-20 23:57:15,391 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34917': TLS handshake failed with remote 'tls://127.0.0.1:34596': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1011) 2087s 2025-02-20 23:57:15,391 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34917': TLS handshake failed with remote 'tls://127.0.0.1:34612': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1011) 2087s 2025-02-20 23:57:15,391 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 2087s Traceback (most recent call last): 2087s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 2087s return await fut 2087s ^^^^^^^^^ 2087s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 2087s comm = await self.rpc.connect(saddr) 2087s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2087s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1485, in connect 2087s return await self._connect(addr=addr, timeout=timeout) 2087s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2087s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1429, in _connect 2087s comm = await connect( 2087s ^^^^^^^^^^^^^^ 2087s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2087s comm = await wait_for( 2087s ^^^^^^^^^^^^^^^ 2087s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 2087s return await fut 2087s ^^^^^^^^^ 2087s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2087s stream = await self.client.connect( 2087s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2087s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2087s af, addr, stream = await connector.start(connect_timeout=timeout) 2087s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2087s asyncio.exceptions.CancelledError 2087s 2087s The above exception was the direct cause of the following exception: 2087s 2087s Traceback (most recent call last): 2087s File "/usr/lib/python3/dist-packages/distributed/core.py", line 528, in start 2087s await wait_for(self.start_unsafe(), timeout=timeout) 2087s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1913, in wait_for 2087s async with asyncio.timeout(timeout): 2087s ^^^^^^^^^^^^^^^^^^^^^^^^ 2087s File "/usr/lib/python3.12/asyncio/timeouts.py", line 115, in __aexit__ 2087s raise TimeoutError from exc_val 2087s TimeoutError 2087s 2087s The above exception was the direct cause of the following exception: 2087s 2087s Traceback (most recent call last): 2087s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 974, in _cluster_factory 2087s s, ws = await start_cluster( 2087s ^^^^^^^^^^^^^^^^^^^^ 2087s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 791, in start_cluster 2087s await asyncio.gather(*workers) 2087s File "/usr/lib/python3.12/asyncio/tasks.py", line 684, in _wrap_awaitable 2087s return await awaitable 2087s ^^^^^^^^^^^^^^^ 2087s File "/usr/lib/python3/dist-packages/distributed/core.py", line 531, in start 2087s raise asyncio.TimeoutError( 2087s TimeoutError: Nanny start timed out after 0s. 2087s 2025-02-20 23:57:16,394 - distributed.scheduler - INFO - State start 2087s 2025-02-20 23:57:16,401 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:40517 2087s 2025-02-20 23:57:16,404 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:34221/status 2087s 2025-02-20 23:57:16,407 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2087s 2025-02-20 23:57:16,415 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:33315'. Reason: failure-to-start- 2087s 2025-02-20 23:57:16,415 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:33315' closed. 2087s 2025-02-20 23:57:16,415 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:45069'. Reason: failure-to-start- 2087s 2025-02-20 23:57:16,416 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:45069' closed. 2087s 2025-02-20 23:57:16,416 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40517': TLS handshake failed with remote 'tls://127.0.0.1:58186': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1011) 2087s 2025-02-20 23:57:16,416 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40517': TLS handshake failed with remote 'tls://127.0.0.1:58198': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1011) 2087s 2025-02-20 23:57:16,416 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 2087s Traceback (most recent call last): 2087s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 2087s return await fut 2087s ^^^^^^^^^ 2087s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 2087s comm = await self.rpc.connect(saddr) 2087s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2087s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1485, in connect 2087s return await self._connect(addr=addr, timeout=timeout) 2087s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2087s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1429, in _connect 2087s comm = await connect( 2087s ^^^^^^^^^^^^^^ 2087s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2087s comm = await wait_for( 2087s ^^^^^^^^^^^^^^^ 2087s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 2087s return await fut 2087s ^^^^^^^^^ 2087s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2087s stream = await self.client.connect( 2087s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2087s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2087s af, addr, stream = await connector.start(connect_timeout=timeout) 2087s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2087s asyncio.exceptions.CancelledError 2087s 2087s The above exception was the direct cause of the following exception: 2087s 2087s Traceback (most recent call last): 2087s File "/usr/lib/python3/dist-packages/distributed/core.py", line 528, in start 2087s await wait_for(self.start_unsafe(), timeout=timeout) 2087s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1913, in wait_for 2087s async with asyncio.timeout(timeout): 2087s ^^^^^^^^^^^^^^^^^^^^^^^^ 2087s File "/usr/lib/python3.12/asyncio/timeouts.py", line 115, in __aexit__ 2087s raise TimeoutError from exc_val 2087s TimeoutError 2087s 2087s The above exception was the direct cause of the following exception: 2087s 2087s Traceback (most recent call last): 2087s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 974, in _cluster_factory 2087s s, ws = await start_cluster( 2087s ^^^^^^^^^^^^^^^^^^^^ 2087s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 791, in start_cluster 2087s await asyncio.gather(*workers) 2087s File "/usr/lib/python3.12/asyncio/tasks.py", line 684, in _wrap_awaitable 2087s return await awaitable 2087s ^^^^^^^^^^^^^^^ 2087s File "/usr/lib/python3/dist-packages/distributed/core.py", line 531, in start 2087s raise asyncio.TimeoutError( 2087s TimeoutError: Nanny start timed out after 0s. 2087s 2025-02-20 23:57:17,420 - distributed.scheduler - INFO - State start 2087s 2025-02-20 23:57:17,428 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:41585 2087s 2025-02-20 23:57:17,431 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:39285/status 2087s 2025-02-20 23:57:17,434 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2087s 2025-02-20 23:57:17,443 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:39087'. Reason: failure-to-start- 2087s 2025-02-20 23:57:17,443 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:39087' closed. 2087s 2025-02-20 23:57:17,444 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:41399'. Reason: failure-to-start- 2087s 2025-02-20 23:57:17,444 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:41399' closed. 2087s 2025-02-20 23:57:17,444 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41585': TLS handshake failed with remote 'tls://127.0.0.1:40070': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1011) 2087s 2025-02-20 23:57:17,444 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41585': TLS handshake failed with remote 'tls://127.0.0.1:40082': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1011) 2087s 2025-02-20 23:57:17,444 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 2087s Traceback (most recent call last): 2087s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 2087s return await fut 2087s ^^^^^^^^^ 2087s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 2087s comm = await self.rpc.connect(saddr) 2087s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2087s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1485, in connect 2087s return await self._connect(addr=addr, timeout=timeout) 2087s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2087s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1429, in _connect 2087s comm = await connect( 2087s ^^^^^^^^^^^^^^ 2087s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2087s comm = await wait_for( 2087s ^^^^^^^^^^^^^^^ 2087s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 2087s return await fut 2087s ^^^^^^^^^ 2087s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2087s stream = await self.client.connect( 2087s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2087s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2087s af, addr, stream = await connector.start(connect_timeout=timeout) 2087s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2087s asyncio.exceptions.CancelledError 2087s 2087s The above exception was the direct cause of the following exception: 2087s 2087s Traceback (most recent call last): 2087s File "/usr/lib/python3/dist-packages/distributed/core.py", line 528, in start 2087s await wait_for(self.start_unsafe(), timeout=timeout) 2087s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1913, in wait_for 2087s async with asyncio.timeout(timeout): 2087s ^^^^^^^^^^^^^^^^^^^^^^^^ 2087s File "/usr/lib/python3.12/asyncio/timeouts.py", line 115, in __aexit__ 2087s raise TimeoutError from exc_val 2087s TimeoutError 2087s 2087s The above exception was the direct cause of the following exception: 2087s 2087s Traceback (most recent call last): 2087s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 974, in _cluster_factory 2087s s, ws = await start_cluster( 2087s ^^^^^^^^^^^^^^^^^^^^ 2087s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 791, in start_cluster 2087s await asyncio.gather(*workers) 2087s File "/usr/lib/python3.12/asyncio/tasks.py", line 684, in _wrap_awaitable 2087s return await awaitable 2087s ^^^^^^^^^^^^^^^ 2087s File "/usr/lib/python3/dist-packages/distributed/core.py", line 531, in start 2087s raise asyncio.TimeoutError( 2087s TimeoutError: Nanny start timed out after 0s. 2087s 2025-02-20 23:57:18,449 - distributed.scheduler - INFO - State start 2087s 2025-02-20 23:57:18,456 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:42621 2087s 2025-02-20 23:57:18,459 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:38865/status 2087s 2025-02-20 23:57:18,460 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2087s 2025-02-20 23:57:18,468 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:37269'. Reason: failure-to-start- 2087s 2025-02-20 23:57:18,468 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:37269' closed. 2087s 2025-02-20 23:57:18,469 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:33749'. Reason: failure-to-start- 2087s 2025-02-20 23:57:18,469 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:33749' closed. 2087s 2025-02-20 23:57:18,469 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42621': TLS handshake failed with remote 'tls://127.0.0.1:56458': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1011) 2087s 2025-02-20 23:57:18,469 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42621': TLS handshake failed with remote 'tls://127.0.0.1:56472': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1011) 2087s 2025-02-20 23:57:18,470 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 2087s Traceback (most recent call last): 2087s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 2087s return await fut 2087s ^^^^^^^^^ 2087s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 2087s comm = await self.rpc.connect(saddr) 2087s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2087s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1485, in connect 2087s return await self._connect(addr=addr, timeout=timeout) 2087s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2087s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1429, in _connect 2087s comm = await connect( 2087s ^^^^^^^^^^^^^^ 2087s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2087s comm = await wait_for( 2087s ^^^^^^^^^^^^^^^ 2087s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 2087s return await fut 2087s ^^^^^^^^^ 2087s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2087s stream = await self.client.connect( 2087s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2087s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2087s af, addr, stream = await connector.start(connect_timeout=timeout) 2087s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2087s asyncio.exceptions.CancelledError 2087s 2087s The above exception was the direct cause of the following exception: 2087s 2087s Traceback (most recent call last): 2087s File "/usr/lib/python3/dist-packages/distributed/core.py", line 528, in start 2087s await wait_for(self.start_unsafe(), timeout=timeout) 2087s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1913, in wait_for 2087s async with asyncio.timeout(timeout): 2087s ^^^^^^^^^^^^^^^^^^^^^^^^ 2087s File "/usr/lib/python3.12/asyncio/timeouts.py", line 115, in __aexit__ 2087s raise TimeoutError from exc_val 2087s TimeoutError 2087s 2087s The above exception was the direct cause of the following exception: 2087s 2087s Traceback (most recent call last): 2087s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 974, in _cluster_factory 2087s s, ws = await start_cluster( 2087s ^^^^^^^^^^^^^^^^^^^^ 2087s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 791, in start_cluster 2087s await asyncio.gather(*workers) 2087s File "/usr/lib/python3.12/asyncio/tasks.py", line 684, in _wrap_awaitable 2087s return await awaitable 2087s ^^^^^^^^^^^^^^^ 2087s File "/usr/lib/python3/dist-packages/distributed/core.py", line 531, in start 2087s raise asyncio.TimeoutError( 2087s TimeoutError: Nanny start timed out after 0s. 2087s 2025-02-20 23:57:19,473 - distributed.scheduler - INFO - State start 2087s 2025-02-20 23:57:19,478 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37629 2087s 2025-02-20 23:57:19,481 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:35697/status 2087s 2025-02-20 23:57:19,483 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2087s 2025-02-20 23:57:19,490 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:44205'. Reason: failure-to-start- 2087s 2025-02-20 23:57:19,490 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:44205' closed. 2087s 2025-02-20 23:57:19,490 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:44885'. Reason: failure-to-start- 2087s 2025-02-20 23:57:19,491 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:44885' closed. 2087s 2025-02-20 23:57:19,491 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37629': TLS handshake failed with remote 'tls://127.0.0.1:53754': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1011) 2087s 2025-02-20 23:57:19,491 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37629': TLS handshake failed with remote 'tls://127.0.0.1:53764': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1011) 2087s 2025-02-20 23:57:19,491 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 2087s Traceback (most recent call last): 2087s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 2087s return await fut 2087s ^^^^^^^^^ 2087s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 2087s comm = await self.rpc.connect(saddr) 2087s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2087s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1485, in connect 2087s return await self._connect(addr=addr, timeout=timeout) 2087s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2087s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1429, in _connect 2087s comm = await connect( 2087s ^^^^^^^^^^^^^^ 2087s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2087s comm = await wait_for( 2087s ^^^^^^^^^^^^^^^ 2087s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 2087s return await fut 2087s ^^^^^^^^^ 2087s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2087s stream = await self.client.connect( 2087s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2087s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2087s af, addr, stream = await connector.start(connect_timeout=timeout) 2087s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2087s asyncio.exceptions.CancelledError 2087s 2087s The above exception was the direct cause of the following exception: 2087s 2087s Traceback (most recent call last): 2087s File "/usr/lib/python3/dist-packages/distributed/core.py", line 528, in start 2087s await wait_for(self.start_unsafe(), timeout=timeout) 2087s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1913, in wait_for 2087s async with asyncio.timeout(timeout): 2087s ^^^^^^^^^^^^^^^^^^^^^^^^ 2087s File "/usr/lib/python3.12/asyncio/timeouts.py", line 115, in __aexit__ 2087s raise TimeoutError from exc_val 2087s TimeoutError 2087s 2087s The above exception was the direct cause of the following exception: 2087s 2087s Traceback (most recent call last): 2087s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 974, in _cluster_factory 2087s s, ws = await start_cluster( 2087s ^^^^^^^^^^^^^^^^^^^^ 2087s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 791, in start_cluster 2087s await asyncio.gather(*workers) 2087s File "/usr/lib/python3.12/asyncio/tasks.py", line 684, in _wrap_awaitable 2087s return await awaitable 2087s ^^^^^^^^^^^^^^^ 2087s File "/usr/lib/python3/dist-packages/distributed/core.py", line 531, in start 2087s raise asyncio.TimeoutError( 2087s TimeoutError: Nanny start timed out after 0s. 2087s 2025-02-20 23:57:20,494 - distributed.scheduler - INFO - State start 2087s 2025-02-20 23:57:20,500 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:43241 2087s 2025-02-20 23:57:20,503 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:45051/status 2087s 2025-02-20 23:57:20,505 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2087s 2025-02-20 23:57:20,512 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:38859'. Reason: failure-to-start- 2087s 2025-02-20 23:57:20,513 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:38859' closed. 2087s 2025-02-20 23:57:20,513 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:43287'. Reason: failure-to-start- 2087s 2025-02-20 23:57:20,513 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:43287' closed. 2087s 2025-02-20 23:57:20,514 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43241': TLS handshake failed with remote 'tls://127.0.0.1:37802': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1011) 2087s 2025-02-20 23:57:20,514 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43241': TLS handshake failed with remote 'tls://127.0.0.1:37818': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1011) 2087s 2025-02-20 23:57:20,514 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 2087s Traceback (most recent call last): 2087s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 2087s return await fut 2087s ^^^^^^^^^ 2087s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 2087s comm = await self.rpc.connect(saddr) 2087s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2087s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1485, in connect 2087s return await self._connect(addr=addr, timeout=timeout) 2087s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2087s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1429, in _connect 2087s comm = await connect( 2087s ^^^^^^^^^^^^^^ 2087s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2087s comm = await wait_for( 2087s ^^^^^^^^^^^^^^^ 2087s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 2087s return await fut 2087s ^^^^^^^^^ 2087s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2087s stream = await self.client.connect( 2087s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2087s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2087s af, addr, stream = await connector.start(connect_timeout=timeout) 2087s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2087s asyncio.exceptions.CancelledError 2087s 2087s The above exception was the direct cause of the following exception: 2087s 2087s Traceback (most recent call last): 2087s File "/usr/lib/python3/dist-packages/distributed/core.py", line 528, in start 2087s await wait_for(self.start_unsafe(), timeout=timeout) 2087s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1913, in wait_for 2087s async with asyncio.timeout(timeout): 2087s ^^^^^^^^^^^^^^^^^^^^^^^^ 2087s File "/usr/lib/python3.12/asyncio/timeouts.py", line 115, in __aexit__ 2087s raise TimeoutError from exc_val 2087s TimeoutError 2087s 2087s The above exception was the direct cause of the following exception: 2087s 2087s Traceback (most recent call last): 2087s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 974, in _cluster_factory 2087s s, ws = await start_cluster( 2087s ^^^^^^^^^^^^^^^^^^^^ 2087s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 791, in start_cluster 2087s await asyncio.gather(*workers) 2087s File "/usr/lib/python3.12/asyncio/tasks.py", line 684, in _wrap_awaitable 2087s return await awaitable 2087s ^^^^^^^^^^^^^^^ 2087s File "/usr/lib/python3/dist-packages/distributed/core.py", line 531, in start 2087s raise asyncio.TimeoutError( 2087s TimeoutError: Nanny start timed out after 0s. 2087s 2025-02-20 23:57:21,516 - distributed.scheduler - INFO - State start 2087s 2025-02-20 23:57:21,523 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:41675 2087s 2025-02-20 23:57:21,525 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:42831/status 2087s 2025-02-20 23:57:21,527 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2087s 2025-02-20 23:57:21,535 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:46831'. Reason: failure-to-start- 2087s 2025-02-20 23:57:21,535 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:46831' closed. 2087s 2025-02-20 23:57:21,536 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:44027'. Reason: failure-to-start- 2087s 2025-02-20 23:57:21,536 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:44027' closed. 2087s 2025-02-20 23:57:21,536 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41675': TLS handshake failed with remote 'tls://127.0.0.1:33754': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1011) 2087s 2025-02-20 23:57:21,536 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41675': TLS handshake failed with remote 'tls://127.0.0.1:33764': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1011) 2087s 2025-02-20 23:57:21,537 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 2087s Traceback (most recent call last): 2087s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 2087s return await fut 2087s ^^^^^^^^^ 2087s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 2087s comm = await self.rpc.connect(saddr) 2087s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2087s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1485, in connect 2087s return await self._connect(addr=addr, timeout=timeout) 2087s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2087s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1429, in _connect 2087s comm = await connect( 2087s ^^^^^^^^^^^^^^ 2087s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2087s comm = await wait_for( 2087s ^^^^^^^^^^^^^^^ 2087s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 2087s return await fut 2087s ^^^^^^^^^ 2087s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2087s stream = await self.client.connect( 2087s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2087s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2087s af, addr, stream = await connector.start(connect_timeout=timeout) 2087s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2087s asyncio.exceptions.CancelledError 2087s 2087s The above exception was the direct cause of the following exception: 2087s 2087s Traceback (most recent call last): 2087s File "/usr/lib/python3/dist-packages/distributed/core.py", line 528, in start 2087s await wait_for(self.start_unsafe(), timeout=timeout) 2087s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1913, in wait_for 2087s async with asyncio.timeout(timeout): 2087s ^^^^^^^^^^^^^^^^^^^^^^^^ 2087s File "/usr/lib/python3.12/asyncio/timeouts.py", line 115, in __aexit__ 2087s raise TimeoutError from exc_val 2087s TimeoutError 2087s 2087s The above exception was the direct cause of the following exception: 2087s 2087s Traceback (most recent call last): 2087s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 974, in _cluster_factory 2087s s, ws = await start_cluster( 2087s ^^^^^^^^^^^^^^^^^^^^ 2087s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 791, in start_cluster 2087s await asyncio.gather(*workers) 2087s File "/usr/lib/python3.12/asyncio/tasks.py", line 684, in _wrap_awaitable 2087s return await awaitable 2087s ^^^^^^^^^^^^^^^ 2087s File "/usr/lib/python3/dist-packages/distributed/core.py", line 531, in start 2087s raise asyncio.TimeoutError( 2087s TimeoutError: Nanny start timed out after 0s. 2087s 2025-02-20 23:57:22,541 - distributed.scheduler - INFO - State start 2087s 2025-02-20 23:57:22,550 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:39947 2087s 2025-02-20 23:57:22,554 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:45559/status 2087s 2025-02-20 23:57:22,556 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2087s 2025-02-20 23:57:22,641 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:45905'. Reason: failure-to-start- 2087s 2025-02-20 23:57:22,642 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:45905' closed. 2087s 2025-02-20 23:57:22,642 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:33169'. Reason: failure-to-start- 2087s 2025-02-20 23:57:22,642 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:33169' closed. 2087s 2025-02-20 23:57:22,643 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39947': TLS handshake failed with remote 'tls://127.0.0.1:41596': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1011) 2087s 2025-02-20 23:57:22,643 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39947': TLS handshake failed with remote 'tls://127.0.0.1:41610': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1011) 2087s 2025-02-20 23:57:22,643 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 2087s Traceback (most recent call last): 2087s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 2087s return await fut 2087s ^^^^^^^^^ 2087s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 2087s comm = await self.rpc.connect(saddr) 2087s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2087s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1485, in connect 2087s return await self._connect(addr=addr, timeout=timeout) 2087s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2087s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1429, in _connect 2087s comm = await connect( 2087s ^^^^^^^^^^^^^^ 2087s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2087s comm = await wait_for( 2087s ^^^^^^^^^^^^^^^ 2087s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 2087s return await fut 2087s ^^^^^^^^^ 2087s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2087s stream = await self.client.connect( 2087s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2087s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2087s af, addr, stream = await connector.start(connect_timeout=timeout) 2087s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2087s asyncio.exceptions.CancelledError 2087s 2087s The above exception was the direct cause of the following exception: 2087s 2087s Traceback (most recent call last): 2087s File "/usr/lib/python3/dist-packages/distributed/core.py", line 528, in start 2087s await wait_for(self.start_unsafe(), timeout=timeout) 2087s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1913, in wait_for 2087s async with asyncio.timeout(timeout): 2087s ^^^^^^^^^^^^^^^^^^^^^^^^ 2087s File "/usr/lib/python3.12/asyncio/timeouts.py", line 115, in __aexit__ 2087s raise TimeoutError from exc_val 2087s TimeoutError 2087s 2087s The above exception was the direct cause of the following exception: 2087s 2087s Traceback (most recent call last): 2087s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 974, in _cluster_factory 2087s s, ws = await start_cluster( 2087s ^^^^^^^^^^^^^^^^^^^^ 2087s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 791, in start_cluster 2087s await asyncio.gather(*workers) 2087s File "/usr/lib/python3.12/asyncio/tasks.py", line 684, in _wrap_awaitable 2087s return await awaitable 2087s ^^^^^^^^^^^^^^^ 2087s File "/usr/lib/python3/dist-packages/distributed/core.py", line 531, in start 2087s raise asyncio.TimeoutError( 2087s TimeoutError: Nanny start timed out after 0s. 2087s 2025-02-20 23:57:23,646 - distributed.scheduler - INFO - State start 2087s 2025-02-20 23:57:23,653 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:34661 2087s 2025-02-20 23:57:23,656 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:40873/status 2087s 2025-02-20 23:57:23,658 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2087s 2025-02-20 23:57:23,667 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:40883'. Reason: failure-to-start- 2087s 2025-02-20 23:57:23,668 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:40883' closed. 2087s 2025-02-20 23:57:23,668 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:40017'. Reason: failure-to-start- 2087s 2025-02-20 23:57:23,668 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:40017' closed. 2087s 2025-02-20 23:57:23,669 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34661': TLS handshake failed with remote 'tls://127.0.0.1:48434': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1011) 2087s 2025-02-20 23:57:23,669 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34661': TLS handshake failed with remote 'tls://127.0.0.1:48442': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1011) 2087s 2025-02-20 23:57:23,669 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 2087s Traceback (most recent call last): 2087s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 2087s return await fut 2087s ^^^^^^^^^ 2087s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 2087s comm = await self.rpc.connect(saddr) 2087s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2087s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1485, in connect 2087s return await self._connect(addr=addr, timeout=timeout) 2087s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2087s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1429, in _connect 2087s comm = await connect( 2087s ^^^^^^^^^^^^^^ 2087s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2087s comm = await wait_for( 2087s ^^^^^^^^^^^^^^^ 2087s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 2087s return await fut 2087s ^^^^^^^^^ 2087s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2087s stream = await self.client.connect( 2087s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2087s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2087s af, addr, stream = await connector.start(connect_timeout=timeout) 2087s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2087s asyncio.exceptions.CancelledError 2087s 2087s The above exception was the direct cause of the following exception: 2087s 2087s Traceback (most recent call last): 2087s File "/usr/lib/python3/dist-packages/distributed/core.py", line 528, in start 2087s await wait_for(self.start_unsafe(), timeout=timeout) 2087s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1913, in wait_for 2087s async with asyncio.timeout(timeout): 2087s ^^^^^^^^^^^^^^^^^^^^^^^^ 2087s File "/usr/lib/python3.12/asyncio/timeouts.py", line 115, in __aexit__ 2087s raise TimeoutError from exc_val 2087s TimeoutError 2087s 2087s The above exception was the direct cause of the following exception: 2087s 2087s Traceback (most recent call last): 2087s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 974, in _cluster_factory 2087s s, ws = await start_cluster( 2087s ^^^^^^^^^^^^^^^^^^^^ 2087s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 791, in start_cluster 2087s await asyncio.gather(*workers) 2087s File "/usr/lib/python3.12/asyncio/tasks.py", line 684, in _wrap_awaitable 2087s return await awaitable 2087s ^^^^^^^^^^^^^^^ 2087s File "/usr/lib/python3/dist-packages/distributed/core.py", line 531, in start 2087s raise asyncio.TimeoutError( 2087s TimeoutError: Nanny start timed out after 0s. 2087s 2025-02-20 23:57:24,672 - distributed.scheduler - INFO - State start 2087s 2025-02-20 23:57:24,678 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:45775 2087s 2025-02-20 23:57:24,680 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:39305/status 2087s 2025-02-20 23:57:24,681 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2087s 2025-02-20 23:57:24,689 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:34505'. Reason: failure-to-start- 2087s 2025-02-20 23:57:24,689 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:34505' closed. 2087s 2025-02-20 23:57:24,689 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:33843'. Reason: failure-to-start- 2087s 2025-02-20 23:57:24,690 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:33843' closed. 2087s 2025-02-20 23:57:24,690 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45775': TLS handshake failed with remote 'tls://127.0.0.1:56666': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1011) 2087s 2025-02-20 23:57:24,690 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45775': TLS handshake failed with remote 'tls://127.0.0.1:56674': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1011) 2087s 2025-02-20 23:57:24,690 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 2087s Traceback (most recent call last): 2087s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 2087s return await fut 2087s ^^^^^^^^^ 2087s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 2087s comm = await self.rpc.connect(saddr) 2087s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2087s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1485, in connect 2087s return await self._connect(addr=addr, timeout=timeout) 2087s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2087s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1429, in _connect 2087s comm = await connect( 2087s ^^^^^^^^^^^^^^ 2087s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2087s comm = await wait_for( 2087s ^^^^^^^^^^^^^^^ 2087s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 2087s return await fut 2087s ^^^^^^^^^ 2087s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2087s stream = await self.client.connect( 2087s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2087s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2087s af, addr, stream = await connector.start(connect_timeout=timeout) 2087s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2087s asyncio.exceptions.CancelledError 2087s 2087s The above exception was the direct cause of the following exception: 2087s 2087s Traceback (most recent call last): 2087s File "/usr/lib/python3/dist-packages/distributed/core.py", line 528, in start 2087s await wait_for(self.start_unsafe(), timeout=timeout) 2087s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1913, in wait_for 2087s async with asyncio.timeout(timeout): 2087s ^^^^^^^^^^^^^^^^^^^^^^^^ 2087s File "/usr/lib/python3.12/asyncio/timeouts.py", line 115, in __aexit__ 2087s raise TimeoutError from exc_val 2087s TimeoutError 2087s 2087s The above exception was the direct cause of the following exception: 2087s 2087s Traceback (most recent call last): 2087s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 974, in _cluster_factory 2087s s, ws = await start_cluster( 2087s ^^^^^^^^^^^^^^^^^^^^ 2087s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 791, in start_cluster 2087s await asyncio.gather(*workers) 2087s File "/usr/lib/python3.12/asyncio/tasks.py", line 684, in _wrap_awaitable 2087s return await awaitable 2087s ^^^^^^^^^^^^^^^ 2087s File "/usr/lib/python3/dist-packages/distributed/core.py", line 531, in start 2087s raise asyncio.TimeoutError( 2087s TimeoutError: Nanny start timed out after 0s. 2087s 2025-02-20 23:57:25,693 - distributed.scheduler - INFO - State start 2087s 2025-02-20 23:57:25,699 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:43203 2087s 2025-02-20 23:57:25,702 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:40039/status 2087s 2025-02-20 23:57:25,703 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2087s 2025-02-20 23:57:25,711 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:34947'. Reason: failure-to-start- 2087s 2025-02-20 23:57:25,711 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:34947' closed. 2087s 2025-02-20 23:57:25,711 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:45047'. Reason: failure-to-start- 2087s 2025-02-20 23:57:25,712 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:45047' closed. 2087s 2025-02-20 23:57:25,712 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43203': TLS handshake failed with remote 'tls://127.0.0.1:51062': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1011) 2087s 2025-02-20 23:57:25,712 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43203': TLS handshake failed with remote 'tls://127.0.0.1:51072': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1011) 2087s 2025-02-20 23:57:25,712 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 2087s Traceback (most recent call last): 2087s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 2087s return await fut 2087s ^^^^^^^^^ 2087s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 2087s comm = await self.rpc.connect(saddr) 2087s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2087s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1485, in connect 2087s return await self._connect(addr=addr, timeout=timeout) 2087s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2087s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1429, in _connect 2087s comm = await connect( 2087s ^^^^^^^^^^^^^^ 2087s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2087s comm = await wait_for( 2087s ^^^^^^^^^^^^^^^ 2087s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 2087s return await fut 2087s ^^^^^^^^^ 2087s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2087s stream = await self.client.connect( 2087s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2087s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2087s af, addr, stream = await connector.start(connect_timeout=timeout) 2087s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2087s asyncio.exceptions.CancelledError 2087s 2087s The above exception was the direct cause of the following exception: 2087s 2087s Traceback (most recent call last): 2087s File "/usr/lib/python3/dist-packages/distributed/core.py", line 528, in start 2087s await wait_for(self.start_unsafe(), timeout=timeout) 2087s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1913, in wait_for 2087s async with asyncio.timeout(timeout): 2087s ^^^^^^^^^^^^^^^^^^^^^^^^ 2087s File "/usr/lib/python3.12/asyncio/timeouts.py", line 115, in __aexit__ 2087s raise TimeoutError from exc_val 2087s TimeoutError 2087s 2087s The above exception was the direct cause of the following exception: 2087s 2087s Traceback (most recent call last): 2087s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 974, in _cluster_factory 2087s s, ws = await start_cluster( 2087s ^^^^^^^^^^^^^^^^^^^^ 2087s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 791, in start_cluster 2087s await asyncio.gather(*workers) 2087s File "/usr/lib/python3.12/asyncio/tasks.py", line 684, in _wrap_awaitable 2087s return await awaitable 2087s ^^^^^^^^^^^^^^^ 2087s File "/usr/lib/python3/dist-packages/distributed/core.py", line 531, in start 2087s raise asyncio.TimeoutError( 2087s TimeoutError: Nanny start timed out after 0s. 2087s 2025-02-20 23:57:26,715 - distributed.scheduler - INFO - State start 2087s 2025-02-20 23:57:26,721 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:33481 2087s 2025-02-20 23:57:26,723 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:44743/status 2087s 2025-02-20 23:57:26,724 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2087s 2025-02-20 23:57:26,732 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:46871'. Reason: failure-to-start- 2087s 2025-02-20 23:57:26,732 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:46871' closed. 2087s 2025-02-20 23:57:26,732 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:42005'. Reason: failure-to-start- 2087s 2025-02-20 23:57:26,733 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:42005' closed. 2087s 2025-02-20 23:57:26,733 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33481': TLS handshake failed with remote 'tls://127.0.0.1:43206': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1011) 2087s 2025-02-20 23:57:26,733 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33481': TLS handshake failed with remote 'tls://127.0.0.1:43210': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1011) 2087s 2025-02-20 23:57:26,733 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 2087s Traceback (most recent call last): 2087s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 2087s return await fut 2087s ^^^^^^^^^ 2087s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 2087s comm = await self.rpc.connect(saddr) 2087s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2087s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1485, in connect 2087s return await self._connect(addr=addr, timeout=timeout) 2087s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2087s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1429, in _connect 2087s comm = await connect( 2087s ^^^^^^^^^^^^^^ 2087s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2087s comm = await wait_for( 2087s ^^^^^^^^^^^^^^^ 2087s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 2087s return await fut 2087s ^^^^^^^^^ 2087s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2087s stream = await self.client.connect( 2087s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2087s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2087s af, addr, stream = await connector.start(connect_timeout=timeout) 2087s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2087s asyncio.exceptions.CancelledError 2087s 2087s The above exception was the direct cause of the following exception: 2087s 2087s Traceback (most recent call last): 2087s File "/usr/lib/python3/dist-packages/distributed/core.py", line 528, in start 2087s await wait_for(self.start_unsafe(), timeout=timeout) 2087s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1913, in wait_for 2087s async with asyncio.timeout(timeout): 2087s ^^^^^^^^^^^^^^^^^^^^^^^^ 2087s File "/usr/lib/python3.12/asyncio/timeouts.py", line 115, in __aexit__ 2087s raise TimeoutError from exc_val 2087s TimeoutError 2087s 2087s The above exception was the direct cause of the following exception: 2087s 2087s Traceback (most recent call last): 2087s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 974, in _cluster_factory 2087s s, ws = await start_cluster( 2087s ^^^^^^^^^^^^^^^^^^^^ 2087s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 791, in start_cluster 2087s await asyncio.gather(*workers) 2087s File "/usr/lib/python3.12/asyncio/tasks.py", line 684, in _wrap_awaitable 2087s return await awaitable 2087s ^^^^^^^^^^^^^^^ 2087s File "/usr/lib/python3/dist-packages/distributed/core.py", line 531, in start 2087s raise asyncio.TimeoutError( 2087s TimeoutError: Nanny start timed out after 0s. 2087s 2025-02-20 23:57:27,737 - distributed.scheduler - INFO - State start 2087s 2025-02-20 23:57:27,745 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:39883 2087s 2025-02-20 23:57:27,748 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:40643/status 2087s 2025-02-20 23:57:27,750 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2087s 2025-02-20 23:57:27,761 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:44589'. Reason: failure-to-start- 2087s 2025-02-20 23:57:27,761 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:44589' closed. 2087s 2025-02-20 23:57:27,761 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:38331'. Reason: failure-to-start- 2087s 2025-02-20 23:57:27,762 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:38331' closed. 2087s 2025-02-20 23:57:27,762 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39883': TLS handshake failed with remote 'tls://127.0.0.1:39558': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1011) 2087s 2025-02-20 23:57:27,762 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39883': TLS handshake failed with remote 'tls://127.0.0.1:39562': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1011) 2087s 2025-02-20 23:57:27,762 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 2087s Traceback (most recent call last): 2087s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 2087s return await fut 2087s ^^^^^^^^^ 2087s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 2087s comm = await self.rpc.connect(saddr) 2087s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2087s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1485, in connect 2087s return await self._connect(addr=addr, timeout=timeout) 2087s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2087s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1429, in _connect 2087s comm = await connect( 2087s ^^^^^^^^^^^^^^ 2087s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2087s comm = await wait_for( 2087s ^^^^^^^^^^^^^^^ 2087s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 2087s return await fut 2087s ^^^^^^^^^ 2087s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2087s stream = await self.client.connect( 2087s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2087s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2087s af, addr, stream = await connector.start(connect_timeout=timeout) 2087s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2087s asyncio.exceptions.CancelledError 2087s 2087s The above exception was the direct cause of the following exception: 2087s 2087s Traceback (most recent call last): 2087s File "/usr/lib/python3/dist-packages/distributed/core.py", line 528, in start 2087s await wait_for(self.start_unsafe(), timeout=timeout) 2087s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1913, in wait_for 2087s async with asyncio.timeout(timeout): 2087s ^^^^^^^^^^^^^^^^^^^^^^^^ 2087s File "/usr/lib/python3.12/asyncio/timeouts.py", line 115, in __aexit__ 2087s raise TimeoutError from exc_val 2087s TimeoutError 2087s 2087s The above exception was the direct cause of the following exception: 2087s 2087s Traceback (most recent call last): 2087s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 974, in _cluster_factory 2087s s, ws = await start_cluster( 2087s ^^^^^^^^^^^^^^^^^^^^ 2087s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 791, in start_cluster 2087s await asyncio.gather(*workers) 2087s File "/usr/lib/python3.12/asyncio/tasks.py", line 684, in _wrap_awaitable 2087s return await awaitable 2087s ^^^^^^^^^^^^^^^ 2087s File "/usr/lib/python3/dist-packages/distributed/core.py", line 531, in start 2087s raise asyncio.TimeoutError( 2087s TimeoutError: Nanny start timed out after 0s. 2087s 2025-02-20 23:57:28,765 - distributed.scheduler - INFO - State start 2087s 2025-02-20 23:57:28,771 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:42961 2087s 2025-02-20 23:57:28,773 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:42939/status 2087s 2025-02-20 23:57:28,775 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2087s 2025-02-20 23:57:28,782 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:33017'. Reason: failure-to-start- 2087s 2025-02-20 23:57:28,782 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:33017' closed. 2087s 2025-02-20 23:57:28,783 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:35465'. Reason: failure-to-start- 2087s 2025-02-20 23:57:28,783 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:35465' closed. 2087s 2025-02-20 23:57:28,783 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42961': TLS handshake failed with remote 'tls://127.0.0.1:48514': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1011) 2087s 2025-02-20 23:57:28,783 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42961': TLS handshake failed with remote 'tls://127.0.0.1:48528': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1011) 2087s 2025-02-20 23:57:28,783 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 2087s Traceback (most recent call last): 2087s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 2087s return await fut 2087s ^^^^^^^^^ 2087s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 2087s comm = await self.rpc.connect(saddr) 2087s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2087s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1485, in connect 2087s return await self._connect(addr=addr, timeout=timeout) 2087s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2087s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1429, in _connect 2087s comm = await connect( 2087s ^^^^^^^^^^^^^^ 2087s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2087s comm = await wait_for( 2087s ^^^^^^^^^^^^^^^ 2087s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 2087s return await fut 2087s ^^^^^^^^^ 2087s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2087s stream = await self.client.connect( 2087s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2087s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2087s af, addr, stream = await connector.start(connect_timeout=timeout) 2087s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2087s asyncio.exceptions.CancelledError 2087s 2087s The above exception was the direct cause of the following exception: 2087s 2087s Traceback (most recent call last): 2087s File "/usr/lib/python3/dist-packages/distributed/core.py", line 528, in start 2087s await wait_for(self.start_unsafe(), timeout=timeout) 2087s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1913, in wait_for 2087s async with asyncio.timeout(timeout): 2087s ^^^^^^^^^^^^^^^^^^^^^^^^ 2087s File "/usr/lib/python3.12/asyncio/timeouts.py", line 115, in __aexit__ 2087s raise TimeoutError from exc_val 2087s TimeoutError 2087s 2087s The above exception was the direct cause of the following exception: 2087s 2087s Traceback (most recent call last): 2087s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 974, in _cluster_factory 2087s s, ws = await start_cluster( 2087s ^^^^^^^^^^^^^^^^^^^^ 2087s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 791, in start_cluster 2087s await asyncio.gather(*workers) 2087s File "/usr/lib/python3.12/asyncio/tasks.py", line 684, in _wrap_awaitable 2087s return await awaitable 2087s ^^^^^^^^^^^^^^^ 2087s File "/usr/lib/python3/dist-packages/distributed/core.py", line 531, in start 2087s raise asyncio.TimeoutError( 2087s TimeoutError: Nanny start timed out after 0s. 2087s 2025-02-20 23:57:29,787 - distributed.scheduler - INFO - State start 2087s 2025-02-20 23:57:29,793 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:45595 2087s 2025-02-20 23:57:29,796 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:39583/status 2087s 2025-02-20 23:57:29,798 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2087s 2025-02-20 23:57:29,807 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:37443'. Reason: failure-to-start- 2087s 2025-02-20 23:57:29,808 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:37443' closed. 2087s 2025-02-20 23:57:29,808 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:37017'. Reason: failure-to-start- 2087s 2025-02-20 23:57:29,808 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:37017' closed. 2087s 2025-02-20 23:57:29,808 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45595': TLS handshake failed with remote 'tls://127.0.0.1:52068': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1011) 2087s 2025-02-20 23:57:29,808 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45595': TLS handshake failed with remote 'tls://127.0.0.1:52076': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1011) 2087s 2025-02-20 23:57:29,809 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 2087s Traceback (most recent call last): 2087s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 2087s return await fut 2087s ^^^^^^^^^ 2087s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 2087s comm = await self.rpc.connect(saddr) 2087s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2087s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1485, in connect 2087s return await self._connect(addr=addr, timeout=timeout) 2087s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2087s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1429, in _connect 2087s comm = await connect( 2087s ^^^^^^^^^^^^^^ 2087s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2087s comm = await wait_for( 2087s ^^^^^^^^^^^^^^^ 2087s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 2087s return await fut 2087s ^^^^^^^^^ 2087s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2087s stream = await self.client.connect( 2087s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2087s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2087s af, addr, stream = await connector.start(connect_timeout=timeout) 2087s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2087s asyncio.exceptions.CancelledError 2087s 2087s The above exception was the direct cause of the following exception: 2087s 2087s Traceback (most recent call last): 2087s File "/usr/lib/python3/dist-packages/distributed/core.py", line 528, in start 2087s await wait_for(self.start_unsafe(), timeout=timeout) 2087s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1913, in wait_for 2087s async with asyncio.timeout(timeout): 2087s ^^^^^^^^^^^^^^^^^^^^^^^^ 2087s File "/usr/lib/python3.12/asyncio/timeouts.py", line 115, in __aexit__ 2087s raise TimeoutError from exc_val 2087s TimeoutError 2087s 2087s The above exception was the direct cause of the following exception: 2087s 2087s Traceback (most recent call last): 2087s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 974, in _cluster_factory 2087s s, ws = await start_cluster( 2087s ^^^^^^^^^^^^^^^^^^^^ 2087s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 791, in start_cluster 2087s await asyncio.gather(*workers) 2087s File "/usr/lib/python3.12/asyncio/tasks.py", line 684, in _wrap_awaitable 2087s return await awaitable 2087s ^^^^^^^^^^^^^^^ 2087s File "/usr/lib/python3/dist-packages/distributed/core.py", line 531, in start 2087s raise asyncio.TimeoutError( 2087s TimeoutError: Nanny start timed out after 0s. 2087s 2025-02-20 23:57:30,812 - distributed.scheduler - INFO - State start 2087s 2025-02-20 23:57:30,818 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37663 2087s 2025-02-20 23:57:30,820 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:34081/status 2087s 2025-02-20 23:57:30,822 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2087s 2025-02-20 23:57:30,829 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:36247'. Reason: failure-to-start- 2087s 2025-02-20 23:57:30,829 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:36247' closed. 2087s 2025-02-20 23:57:30,829 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:38285'. Reason: failure-to-start- 2087s 2025-02-20 23:57:30,829 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:38285' closed. 2087s 2025-02-20 23:57:30,830 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37663': TLS handshake failed with remote 'tls://127.0.0.1:38998': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1011) 2087s 2025-02-20 23:57:30,830 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37663': TLS handshake failed with remote 'tls://127.0.0.1:39014': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1011) 2087s 2025-02-20 23:57:30,830 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 2087s Traceback (most recent call last): 2087s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 2087s return await fut 2087s ^^^^^^^^^ 2087s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 2087s comm = await self.rpc.connect(saddr) 2087s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2087s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1485, in connect 2087s return await self._connect(addr=addr, timeout=timeout) 2087s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2087s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1429, in _connect 2087s comm = await connect( 2087s ^^^^^^^^^^^^^^ 2087s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2087s comm = await wait_for( 2087s ^^^^^^^^^^^^^^^ 2087s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 2087s return await fut 2087s ^^^^^^^^^ 2087s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2087s stream = await self.client.connect( 2087s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2087s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2087s af, addr, stream = await connector.start(connect_timeout=timeout) 2087s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2087s asyncio.exceptions.CancelledError 2087s 2087s The above exception was the direct cause of the following exception: 2087s 2087s Traceback (most recent call last): 2087s File "/usr/lib/python3/dist-packages/distributed/core.py", line 528, in start 2087s await wait_for(self.start_unsafe(), timeout=timeout) 2087s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1913, in wait_for 2087s async with asyncio.timeout(timeout): 2087s ^^^^^^^^^^^^^^^^^^^^^^^^ 2087s File "/usr/lib/python3.12/asyncio/timeouts.py", line 115, in __aexit__ 2087s raise TimeoutError from exc_val 2087s TimeoutError 2087s 2087s The above exception was the direct cause of the following exception: 2087s 2087s Traceback (most recent call last): 2087s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 974, in _cluster_factory 2087s s, ws = await start_cluster( 2087s ^^^^^^^^^^^^^^^^^^^^ 2087s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 791, in start_cluster 2087s await asyncio.gather(*workers) 2087s File "/usr/lib/python3.12/asyncio/tasks.py", line 684, in _wrap_awaitable 2087s return await awaitable 2087s ^^^^^^^^^^^^^^^ 2087s File "/usr/lib/python3/dist-packages/distributed/core.py", line 531, in start 2087s raise asyncio.TimeoutError( 2087s TimeoutError: Nanny start timed out after 0s. 2087s 2025-02-20 23:57:31,833 - distributed.scheduler - INFO - State start 2087s 2025-02-20 23:57:31,840 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:35797 2087s 2025-02-20 23:57:31,842 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:39693/status 2087s 2025-02-20 23:57:31,844 - distributed.scheduler - INFO - Registering Worker plugin shuffle 2087s 2025-02-20 23:57:31,851 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:32897'. Reason: failure-to-start- 2087s 2025-02-20 23:57:31,851 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:32897' closed. 2087s 2025-02-20 23:57:31,851 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:38745'. Reason: failure-to-start- 2087s 2025-02-20 23:57:31,851 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:38745' closed. 2087s 2025-02-20 23:57:31,852 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35797': TLS handshake failed with remote 'tls://127.0.0.1:43828': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1011) 2087s 2025-02-20 23:57:31,852 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35797': TLS handshake failed with remote 'tls://127.0.0.1:43844': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1011) 2087s 2025-02-20 23:57:31,852 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 2087s Traceback (most recent call last): 2087s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 2087s return await fut 2087s ^^^^^^^^^ 2087s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 2087s comm = await self.rpc.connect(saddr) 2087s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2087s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1485, in connect 2087s return await self._connect(addr=addr, timeout=timeout) 2087s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2087s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1429, in _connect 2087s comm = await connect( 2087s ^^^^^^^^^^^^^^ 2087s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 2087s comm = await wait_for( 2087s ^^^^^^^^^^^^^^^ 2087s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 2087s return await fut 2087s ^^^^^^^^^ 2087s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 2087s stream = await self.client.connect( 2087s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2087s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 2087s af, addr, stream = await connector.start(connect_timeout=timeout) 2087s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2087s asyncio.exceptions.CancelledError 2087s 2087s The above exception was the direct cause of the following exception: 2087s 2087s Traceback (most recent call last): 2087s File "/usr/lib/python3/dist-packages/distributed/core.py", line 528, in start 2087s await wait_for(self.start_unsafe(), timeout=timeout) 2087s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1913, in wait_for 2087s async with asyncio.timeout(timeout): 2087s ^^^^^^^^^^^^^^^^^^^^^^^^ 2087s File "/usr/lib/python3.12/asyncio/timeouts.py", line 115, in __aexit__ 2087s raise TimeoutError from exc_val 2087s TimeoutError 2087s 2087s The above exception was the direct cause of the following exception: 2087s 2087s Traceback (most recent call last): 2087s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 974, in _cluster_factory 2087s s, ws = await start_cluster( 2087s ^^^^^^^^^^^^^^^^^^^^ 2087s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 791, in start_cluster 2087s await asyncio.gather(*workers) 2087s File "/usr/lib/python3.12/asyncio/tasks.py", line 684, in _wrap_awaitable 2087s return await awaitable 2087s ^^^^^^^^^^^^^^^ 2087s File "/usr/lib/python3/dist-packages/distributed/core.py", line 531, in start 2087s raise asyncio.TimeoutError( 2087s TimeoutError: Nanny start timed out after 0s. 2087s ============================= slowest 20 durations ============================= 2087s 60.01s call tests/test_tls_functional.py::test_retire_workers 2087s 21.52s call tests/test_scheduler.py::test_restart_some_nannies_some_not 2087s 17.28s call tests/test_gc.py::test_gc_diagnosis_cpu_time 2087s 16.55s call tests/test_stress.py::test_chaos_rechunk 2087s 15.66s call tests/test_diskutils.py::test_workspace_concurrency 2087s 13.23s call tests/test_scheduler.py::test_file_descriptors 2087s 12.96s call tests/test_scheduler.py::test_memory 2087s 11.78s call tests/test_failed_workers.py::test_worker_ttl_restarts_worker[True] 2087s 11.73s call tests/test_stress.py::test_close_connections 2087s 11.16s call tests/test_scheduler.py::test_log_tasks_during_restart 2087s 10.98s call tests/test_stress.py::test_stress_creation_and_deletion 2087s 10.88s call tests/test_client.py::test_bad_tasks_fail 2087s 10.28s call tests/test_core.py::test_large_payload 2087s 10.03s call tests/test_utils_test.py::test_popen_timeout 2087s 9.88s call tests/test_worker.py::test_tick_interval 2087s 9.59s call tests/test_client.py::test_threadsafe_get 2087s 9.00s call tests/test_client.py::test_threadsafe_compute 2087s 8.07s call tests/test_failed_workers.py::test_broken_worker_during_computation 2087s 8.02s call tests/test_failed_workers.py::test_worker_ttl_restarts_worker[False] 2087s 7.55s call tests/test_stress.py::test_stress_gc[inc-1000] 2087s =========================== short test summary info ============================ 2087s SKIPPED [1] ../../../usr/lib/python3/dist-packages/distributed/comm/tests/test_ucx.py:15: could not import 'ucp': No module named 'ucp' 2087s SKIPPED [1] ../../../usr/lib/python3/dist-packages/distributed/comm/tests/test_ucx_config.py:23: could not import 'ucp': No module named 'ucp' 2087s SKIPPED [1] ../../../usr/lib/python3/dist-packages/distributed/dashboard/tests/test_components.py:5: could not import 'bokeh': No module named 'bokeh' 2087s SKIPPED [1] ../../../usr/lib/python3/dist-packages/distributed/dashboard/tests/test_scheduler_bokeh.py:11: could not import 'bokeh': No module named 'bokeh' 2087s SKIPPED [1] ../../../usr/lib/python3/dist-packages/distributed/dashboard/tests/test_worker_bokeh.py:10: could not import 'bokeh': No module named 'bokeh' 2087s SKIPPED [1] ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_ssh.py:5: could not import 'asyncssh': No module named 'asyncssh' 2087s SKIPPED [1] ../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_cudf_diagnostics.py:20: could not import 'cudf': No module named 'cudf' 2087s SKIPPED [1] ../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_memray.py:5: could not import 'memray': No module named 'memray' 2087s SKIPPED [1] ../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_nvml.py:11: could not import 'pynvml': No module named 'pynvml' 2087s SKIPPED [1] ../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_progress_stream.py:5: could not import 'bokeh': No module named 'bokeh' 2087s SKIPPED [1] ../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_progress_widgets.py:14: could not import 'ipywidgets': No module named 'ipywidgets' 2087s SKIPPED [1] ../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_rmm_diagnostics.py:14: could not import 'dask_cuda': No module named 'dask_cuda' 2087s SKIPPED [1] ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_arrow.py:5: could not import 'pyarrow': No module named 'pyarrow' 2087s SKIPPED [1] ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_cupy.py:11: could not import 'cupy': No module named 'cupy' 2087s SKIPPED [1] ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_keras.py:5: could not import 'keras': No module named 'keras' 2087s SKIPPED [1] ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numba.py:11: could not import 'numba.cuda': No module named 'numba' 2087s SKIPPED [1] ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_rmm.py:10: could not import 'numba.cuda': No module named 'numba' 2087s SKIPPED [1] ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_sparse.py:6: could not import 'sparse': No module named 'sparse' 2087s SKIPPED [1] ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_torch.py:8: could not import 'torch': No module named 'torch' 2087s SKIPPED [1] ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_graph.py:9: could not import 'pyarrow': No module named 'pyarrow' 2087s SKIPPED [1] ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_merge.py:71: could not import 'pyarrow': No module named 'pyarrow' 2087s SKIPPED [1] ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_merge_column_and_index.py:110: could not import 'pyarrow': No module named 'pyarrow' 2087s SKIPPED [1] ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_metrics.py:71: could not import 'pyarrow': No module named 'pyarrow' 2087s SKIPPED [1] ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_shuffle.py:195: could not import 'pyarrow': No module named 'pyarrow' 2087s SKIPPED [1] ../../../usr/lib/python3/dist-packages/distributed/tests/test_parse_stdout.py:14: could not import 'parse_stdout': No module named 'parse_stdout' 2087s SKIPPED [1] ../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py:85: could not import 'bokeh': No module named 'bokeh' 2087s SKIPPED [1] ../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py:117: could not import 'bokeh': No module named 'bokeh' 2087s SKIPPED [1] ../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py:168: could not import 'bokeh': No module named 'bokeh' 2087s SKIPPED [1] ../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py:325: could not import 'bokeh': No module named 'bokeh' 2087s SKIPPED [4] ../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py:508: ipv6 required 2087s SKIPPED [1] ../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py:580: could not import 'bokeh': No module named 'bokeh' 2087s SKIPPED [1] ../../../usr/lib/python3/dist-packages/distributed/comm/tests/test_comms.py:573: could not import 'ucp': No module named 'ucp' 2087s SKIPPED [1] ../../../usr/lib/python3/dist-packages/distributed/comm/tests/test_comms.py:626: ipv6 required 2087s SKIPPED [1] ../../../usr/lib/python3/dist-packages/distributed/comm/tests/test_comms.py:652: ipv6 required 2087s SKIPPED [1] ../../../usr/lib/python3/dist-packages/distributed/comm/tests/test_comms.py:675: ipv6 required 2087s SKIPPED [1] ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_local.py:257: could not import 'bokeh': No module named 'bokeh' 2087s SKIPPED [2] ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_local.py:471: could not import 'bokeh': No module named 'bokeh' 2087s SKIPPED [1] ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_local.py:609: could not import 'bokeh': No module named 'bokeh' 2087s SKIPPED [1] ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_local.py:646: could not import 'ipywidgets': No module named 'ipywidgets' 2087s SKIPPED [1] ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_local.py:664: could not import 'ipywidgets': No module named 'ipywidgets' 2087s SKIPPED [1] ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_subprocess.py:92: Windows-specific error testing (distributed#7434) 2087s SKIPPED [1] ../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_eventstream.py:16: could not import 'bokeh': No module named 'bokeh' 2087s SKIPPED [1] ../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_task_stream.py:140: could not import 'bokeh.models': No module named 'bokeh' 2087s SKIPPED [1] ../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_task_stream.py:151: could not import 'bokeh.models': No module named 'bokeh' 2087s SKIPPED [1] ../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_missing_bokeh.py:35: could not import 'bokeh': No module named 'bokeh' 2087s SKIPPED [1] ../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_missing_bokeh.py:59: could not import 'bokeh': No module named 'bokeh' 2087s SKIPPED [1] ../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py:87: could not import 'bokeh': No module named 'bokeh' 2087s SKIPPED [1] ../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py:648: could not import 'bokeh': No module named 'bokeh' 2087s SKIPPED [1] ../../../usr/lib/python3/dist-packages/distributed/http/worker/tests/test_worker_http.py:234: Fails on 32-bit, seems to be large memory request 2087s SKIPPED [4] ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_collection_cuda.py:12: could not import 'cupy': No module named 'cupy' 2087s SKIPPED [4] ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_collection_cuda.py:44: could not import 'cudf': No module named 'cudf' 2087s SKIPPED [2] ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py:132: could not import 'snappy': No module named 'snappy' 2087s SKIPPED [2] ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py:132: could not import 'zstandard': No module named 'zstandard' 2087s SKIPPED [1] ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py:143: could not import 'snappy': No module named 'snappy' 2087s SKIPPED [1] ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py:143: could not import 'zstandard': No module named 'zstandard' 2087s SKIPPED [1] ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py:151: could not import 'snappy': No module named 'snappy' 2087s SKIPPED [1] ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py:151: could not import 'zstandard': No module named 'zstandard' 2087s SKIPPED [2] ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py:168: could not import 'snappy': No module named 'snappy' 2087s SKIPPED [2] ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py:168: could not import 'zstandard': No module named 'zstandard' 2087s SKIPPED [1] ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py:188: could not import 'snappy': No module named 'snappy' 2087s SKIPPED [1] ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py:188: could not import 'zstandard': No module named 'zstandard' 2087s SKIPPED [1] ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py:150: could not import 'numpy.core.test_rational': No module named 'numpy.core.test_rational' 2087s SKIPPED [1] ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py:1870: unconditional skip 2087s SKIPPED [1] ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py:2088: unconditional skip 2087s SKIPPED [1] ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py:2677: Use fast random selection now 2087s SKIPPED [1] ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py:3301: unconditional skip 2087s SKIPPED [1] ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py:4667: Now prefer first-in-first-out 2087s SKIPPED [1] ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py:5961: unconditional skip 2087s SKIPPED [1] ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py:6179: could not import 'bokeh.plotting': No module named 'bokeh' 2087s SKIPPED [1] ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py:6540: known intermittent failure 2087s SKIPPED [2] ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py:6626: could not import 'bokeh': No module named 'bokeh' 2087s SKIPPED [1] ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py:7065: could not import 'bokeh': No module named 'bokeh' 2087s SKIPPED [1] ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py:7265: numpy >=1.25 can capture ufunc code 2087s SKIPPED [1] ../../../usr/lib/python3/dist-packages/distributed/tests/test_config.py:356: could not import 'uvloop': No module named 'uvloop' 2087s SKIPPED [1] ../../../usr/lib/python3/dist-packages/distributed/tests/test_core.py:115: could not import 'gilknocker': No module named 'gilknocker' 2087s SKIPPED [1] ../../../usr/lib/python3/dist-packages/distributed/tests/test_core.py:915: could not import 'crick': No module named 'crick' 2087s SKIPPED [1] ../../../usr/lib/python3/dist-packages/distributed/tests/test_core.py:924: could not import 'crick': No module named 'crick' 2087s SKIPPED [1] ../../../usr/lib/python3/dist-packages/distributed/tests/test_counter.py:13: no crick library 2087s SKIPPED [1] ../../../usr/lib/python3/dist-packages/distributed/tests/test_dask_collections.py:221: could not import 'sparse': No module named 'sparse' 2087s SKIPPED [1] ../../../usr/lib/python3/dist-packages/distributed/tests/test_metrics.py:30: WindowsTime doesn't work with high accuracy base timer 2087s SKIPPED [2] ../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py:567: could not import 'ucp': No module named 'ucp' 2087s SKIPPED [1] ../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py:75: could not import 'stacktrace': No module named 'stacktrace' 2087s SKIPPED [1] ../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py:363: Skipped 2087s SKIPPED [1] ../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py:422: Should protect resource keys from optimization 2087s SKIPPED [1] ../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py:445: atop fusion seemed to break this 2087s SKIPPED [1] ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py:286: Not relevant with queuing on; see https://github.com/dask/distributed/issues/7204 2087s SKIPPED [1] ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py:2661: could not import 'bokeh': No module named 'bokeh' 2087s SKIPPED [1] ../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py:285: Skipped 2087s SKIPPED [1] ../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py:1287: executing heartbeats not considered yet 2087s SKIPPED [1] ../../../usr/lib/python3/dist-packages/distributed/tests/test_stress.py:209: unconditional skip 2087s SKIPPED [1] ../../../usr/lib/python3/dist-packages/distributed/tests/test_stress.py:277: could not import 'crick': No module named 'crick' 2087s SKIPPED [1] ../../../usr/lib/python3/dist-packages/distributed/tests/test_system_monitor.py:111: could not import 'gilknocker': No module named 'gilknocker' 2087s SKIPPED [1] ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py:347: could not import 'pyarrow': No module named 'pyarrow' 2087s SKIPPED [1] ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py:146: This hangs on travis 2087s SKIPPED [1] ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py:219: don't yet support uploading pyc files 2087s SKIPPED [1] ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py:309: could not import 'crick': No module named 'crick' 2087s SKIPPED [2] ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py:1453: could not import 'ucp': No module named 'ucp' 2087s FAILED tests/test_tls_functional.py::test_retire_workers - TimeoutError 2087s = 1 failed, 3511 passed, 114 skipped, 38 deselected, 16 xfailed, 8 xpassed, 3 rerun in 1860.24s (0:31:00) = 2098s *** END OF RUN 1: NOT ALL TESTS HAVE YET PASSED/XFAILED *** 2098s *** STARTING RUN 2: python3.12 -m pytest -m not avoid_ci --verbose --timeout-method=signal --timeout=300 --durations=20 --color=no --runslow --pyargs distributed -rfE --last-failed --last-failed-no-failures none --deselect=cli/tests/test_dask_scheduler.py::test_no_dashboard --deselect=deploy/tests/test_local.py::test_localcluster_get_client --deselect=deploy/tests/test_old_ssh.py::test_cluster --deselect=deploy/tests/test_old_ssh.py::test_old_ssh_nprocs_renamed_to_n_workers --deselect=deploy/tests/test_old_ssh.py::test_nprocs_attribute_is_deprecated --deselect=deploy/tests/test_ssh.py::test_nprocs_attribute_is_deprecated --deselect=http/tests/test_core.py::test_prometheus_api_doc --deselect=tests/test_init.py::test_git_revision --deselect=tests/test_jupyter.py::test_jupyter_idle_timeout --deselect=tests/test_jupyter.py::test_jupyter_idle_timeout_returned --deselect=tests/test_jupyter.py::test_jupyter_server --deselect=tests/test_jupyter.py::test_shutsdown_cleanly --deselect=tests/test_profile.py::test_stack_overflow --deselect=tests/test_pubsub.py::test_client_worker --deselect=tests/test_queues.py::test_queue_in_task --deselect=tests/test_spill.py::test_spillbuffer_oserror --deselect=tests/test_steal.py::test_steal_twice --deselect=tests/test_utils_test.py::test_cluster --deselect=tests/test_variable.py::test_variable_in_task --deselect=tests/test_worker.py::test_process_executor_kills_process --deselect=tests/test_worker_memory.py::test_fail_to_pickle_execute_1 --deselect=tests/test_worker_state_machine.py::test_task_state_instance_are_garbage_collected --deselect=protocol/tests/test_protocol.py::test_deeply_nested_structures --deselect=protocol/tests/test_serialize.py::test_deeply_nested_structures 2099s ============================= test session starts ============================== 2099s platform linux -- Python 3.12.9, pytest-8.3.4, pluggy-1.5.0 -- /usr/bin/python3.12 2099s cachedir: .pytest_cache 2099s rootdir: /tmp/autopkgtest.4PKwEm/autopkgtest_tmp 2099s configfile: pyproject.toml 2099s plugins: timeout-2.3.1, rerunfailures-15.0, anyio-4.7.0, typeguard-4.4.1 2099s timeout: 300.0s 2099s timeout method: signal 2099s timeout func_only: False 2108s collecting ... collected 3663 items / 3662 deselected / 25 skipped / 1 selected 2108s run-last-failure: rerun previous 1 failure 2108s 2112s tests/test_tls_functional.py::test_retire_workers <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_tls_functional.py PASSED [100%] 2112s 2112s ============================= slowest 20 durations ============================= 2112s 3.29s call tests/test_tls_functional.py::test_retire_workers 2112s 0.00s setup tests/test_tls_functional.py::test_retire_workers 2112s 0.00s teardown tests/test_tls_functional.py::test_retire_workers 2112s =============== 1 passed, 25 skipped, 3662 deselected in 12.62s ================ 2112s *** END OF RUN 2: ALL TESTS RUN HAVE NOW PASSED/XFAILED *** 2112s Testing with python3.13: 2113s *** STARTING RUN 1: python3.13 -m pytest -m not avoid_ci --verbose --timeout-method=signal --timeout=300 --durations=20 --color=no --runslow --pyargs distributed -rsfE --deselect=cli/tests/test_dask_scheduler.py::test_no_dashboard --deselect=deploy/tests/test_local.py::test_localcluster_get_client --deselect=deploy/tests/test_old_ssh.py::test_cluster --deselect=deploy/tests/test_old_ssh.py::test_old_ssh_nprocs_renamed_to_n_workers --deselect=deploy/tests/test_old_ssh.py::test_nprocs_attribute_is_deprecated --deselect=deploy/tests/test_ssh.py::test_nprocs_attribute_is_deprecated --deselect=http/tests/test_core.py::test_prometheus_api_doc --deselect=tests/test_init.py::test_git_revision --deselect=tests/test_jupyter.py::test_jupyter_idle_timeout --deselect=tests/test_jupyter.py::test_jupyter_idle_timeout_returned --deselect=tests/test_jupyter.py::test_jupyter_server --deselect=tests/test_jupyter.py::test_shutsdown_cleanly --deselect=tests/test_profile.py::test_stack_overflow --deselect=tests/test_pubsub.py::test_client_worker --deselect=tests/test_queues.py::test_queue_in_task --deselect=tests/test_spill.py::test_spillbuffer_oserror --deselect=tests/test_steal.py::test_steal_twice --deselect=tests/test_utils_test.py::test_cluster --deselect=tests/test_variable.py::test_variable_in_task --deselect=tests/test_worker.py::test_process_executor_kills_process --deselect=tests/test_worker_memory.py::test_fail_to_pickle_execute_1 --deselect=tests/test_worker_state_machine.py::test_task_state_instance_are_garbage_collected --deselect=protocol/tests/test_protocol.py::test_deeply_nested_structures --deselect=protocol/tests/test_serialize.py::test_deeply_nested_structures 2114s ============================= test session starts ============================== 2114s platform linux -- Python 3.13.2, pytest-8.3.4, pluggy-1.5.0 -- /usr/bin/python3.13 2114s cachedir: .pytest_cache 2114s rootdir: /tmp/autopkgtest.4PKwEm/autopkgtest_tmp 2114s configfile: pyproject.toml 2114s plugins: timeout-2.3.1, rerunfailures-15.0, anyio-4.7.0, typeguard-4.4.1 2114s timeout: 300.0s 2114s timeout method: signal 2114s timeout func_only: False 2122s collecting ... collected 3663 items / 38 deselected / 25 skipped / 3625 selected 2122s 2123s cli/tests/test_dask_scheduler.py::test_defaults <- ../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py PASSED [ 0%] 2130s cli/tests/test_dask_scheduler.py::test_hostport <- ../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py PASSED [ 0%] 2130s cli/tests/test_dask_scheduler.py::test_dashboard <- ../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py SKIPPED [ 0%] 2130s cli/tests/test_dask_scheduler.py::test_dashboard_non_standard_ports <- ../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py SKIPPED [ 0%] 2131s cli/tests/test_dask_scheduler.py::test_multiple_protocols <- ../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py PASSED [ 0%] 2131s cli/tests/test_dask_scheduler.py::test_dashboard_allowlist <- ../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py SKIPPED [ 0%] 2132s cli/tests/test_dask_scheduler.py::test_interface <- ../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py PASSED [ 0%] 2134s cli/tests/test_dask_scheduler.py::test_pid_file <- ../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py PASSED [ 0%] 2134s cli/tests/test_dask_scheduler.py::test_scheduler_port_zero <- ../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py PASSED [ 0%] 2134s cli/tests/test_dask_scheduler.py::test_dashboard_port_zero <- ../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py SKIPPED [ 0%] 2135s cli/tests/test_dask_scheduler.py::test_preload_file <- ../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py PASSED [ 0%] 2136s cli/tests/test_dask_scheduler.py::test_preload_module <- ../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py PASSED [ 0%] 2137s cli/tests/test_dask_scheduler.py::test_preload_remote_module <- ../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py PASSED [ 0%] 2138s cli/tests/test_dask_scheduler.py::test_preload_config <- ../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py PASSED [ 0%] 2139s cli/tests/test_dask_scheduler.py::test_preload_command <- ../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py PASSED [ 0%] 2140s cli/tests/test_dask_scheduler.py::test_preload_command_default <- ../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py PASSED [ 0%] 2140s cli/tests/test_dask_scheduler.py::test_version_option <- ../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py PASSED [ 0%] 2141s cli/tests/test_dask_scheduler.py::test_idle_timeout <- ../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py PASSED [ 0%] 2142s cli/tests/test_dask_scheduler.py::test_restores_signal_handler <- ../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py PASSED [ 0%] 2143s cli/tests/test_dask_scheduler.py::test_multiple_workers_2 <- ../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py PASSED [ 0%] 2145s cli/tests/test_dask_scheduler.py::test_multiple_workers <- ../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py PASSED [ 0%] 2146s cli/tests/test_dask_scheduler.py::test_signal_handling[2] <- ../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py PASSED [ 0%] 2147s cli/tests/test_dask_scheduler.py::test_signal_handling[15] <- ../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py PASSED [ 0%] 2148s cli/tests/test_dask_scheduler.py::test_single_executable_deprecated <- ../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py PASSED [ 0%] 2149s cli/tests/test_dask_spec.py::test_text <- ../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_spec.py PASSED [ 0%] 2150s cli/tests/test_dask_spec.py::test_file <- ../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_spec.py PASSED [ 0%] 2151s cli/tests/test_dask_spec.py::test_errors <- ../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_spec.py PASSED [ 0%] 2152s cli/tests/test_dask_spec.py::test_signal_handling_worker[2-Nanny] <- ../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_spec.py PASSED [ 0%] 2153s cli/tests/test_dask_spec.py::test_signal_handling_worker[2-Worker] <- ../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_spec.py PASSED [ 0%] 2155s cli/tests/test_dask_spec.py::test_signal_handling_worker[15-Nanny] <- ../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_spec.py PASSED [ 0%] 2155s cli/tests/test_dask_spec.py::test_signal_handling_worker[15-Worker] <- ../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_spec.py PASSED [ 0%] 2156s cli/tests/test_dask_spec.py::test_signal_handling_scheduler[2] <- ../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_spec.py PASSED [ 0%] 2157s cli/tests/test_dask_spec.py::test_signal_handling_scheduler[15] <- ../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_spec.py PASSED [ 0%] 2157s cli/tests/test_dask_ssh.py::test_version_option <- ../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_ssh.py PASSED [ 0%] 2157s cli/tests/test_dask_worker.py::test_apportion_ports[args0-expect0] <- ../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 0%] 2157s cli/tests/test_dask_worker.py::test_apportion_ports[args1-expect1] <- ../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 0%] 2157s cli/tests/test_dask_worker.py::test_apportion_ports[args2-expect2] <- ../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 1%] 2157s cli/tests/test_dask_worker.py::test_apportion_ports[args3-expect3] <- ../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 1%] 2157s cli/tests/test_dask_worker.py::test_apportion_ports[args4-expect4] <- ../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 1%] 2157s cli/tests/test_dask_worker.py::test_apportion_ports[args5-expect5] <- ../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 1%] 2157s cli/tests/test_dask_worker.py::test_apportion_ports[args6-expect6] <- ../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 1%] 2157s cli/tests/test_dask_worker.py::test_apportion_ports[args7-expect7] <- ../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 1%] 2157s cli/tests/test_dask_worker.py::test_apportion_ports[args8-expect8] <- ../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 1%] 2157s cli/tests/test_dask_worker.py::test_apportion_ports[args9-expect9] <- ../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 1%] 2157s cli/tests/test_dask_worker.py::test_apportion_ports[args10-expect10] <- ../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 1%] 2157s cli/tests/test_dask_worker.py::test_apportion_ports[args11-expect11] <- ../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 1%] 2157s cli/tests/test_dask_worker.py::test_apportion_ports[args12-expect12] <- ../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 1%] 2157s cli/tests/test_dask_worker.py::test_apportion_ports[args13-expect13] <- ../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 1%] 2157s cli/tests/test_dask_worker.py::test_apportion_ports[args14-expect14] <- ../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 1%] 2157s cli/tests/test_dask_worker.py::test_apportion_ports[args15-expect15] <- ../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 1%] 2157s cli/tests/test_dask_worker.py::test_apportion_ports[args16-expect16] <- ../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 1%] 2157s cli/tests/test_dask_worker.py::test_apportion_ports[args17-expect17] <- ../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 1%] 2157s cli/tests/test_dask_worker.py::test_apportion_ports_bad <- ../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 1%] 2159s cli/tests/test_dask_worker.py::test_nanny_worker_ports <- ../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 1%] 2161s cli/tests/test_dask_worker.py::test_nanny_worker_port_range <- ../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 1%] 2161s cli/tests/test_dask_worker.py::test_nanny_worker_port_range_too_many_workers_raises <- ../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 1%] 2162s cli/tests/test_dask_worker.py::test_memory_limit <- ../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 1%] 2163s cli/tests/test_dask_worker.py::test_no_nanny <- ../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 1%] 2165s cli/tests/test_dask_worker.py::test_resources <- ../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 1%] 2166s cli/tests/test_dask_worker.py::test_local_directory[--nanny] <- ../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 1%] 2167s cli/tests/test_dask_worker.py::test_local_directory[--no-nanny] <- ../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 1%] 2169s cli/tests/test_dask_worker.py::test_scheduler_file[--nanny] <- ../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 1%] 2170s cli/tests/test_dask_worker.py::test_scheduler_file[--no-nanny] <- ../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 1%] 2172s cli/tests/test_dask_worker.py::test_scheduler_address_env <- ../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 1%] 2173s cli/tests/test_dask_worker.py::test_nworkers_requires_nanny <- ../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 1%] 2174s cli/tests/test_dask_worker.py::test_nworkers_negative <- ../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 1%] 2176s cli/tests/test_dask_worker.py::test_nworkers_auto <- ../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 1%] 2177s cli/tests/test_dask_worker.py::test_nworkers_expands_name <- ../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 1%] 2179s cli/tests/test_dask_worker.py::test_contact_listen_address[tcp://0.0.0.0:---nanny] <- ../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 1%] 2180s cli/tests/test_dask_worker.py::test_contact_listen_address[tcp://0.0.0.0:---no-nanny] <- ../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 1%] 2181s cli/tests/test_dask_worker.py::test_contact_listen_address[tcp://127.0.0.2:---nanny] <- ../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 1%] 2182s cli/tests/test_dask_worker.py::test_contact_listen_address[tcp://127.0.0.2:---no-nanny] <- ../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 1%] 2182s cli/tests/test_dask_worker.py::test_listen_address_ipv6[tcp://:---nanny] <- ../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py SKIPPED [ 2%] 2182s cli/tests/test_dask_worker.py::test_listen_address_ipv6[tcp://:---no-nanny] <- ../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py SKIPPED [ 2%] 2182s cli/tests/test_dask_worker.py::test_listen_address_ipv6[tcp://[::1]:---nanny] <- ../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py SKIPPED [ 2%] 2182s cli/tests/test_dask_worker.py::test_listen_address_ipv6[tcp://[::1]:---no-nanny] <- ../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py SKIPPED [ 2%] 2184s cli/tests/test_dask_worker.py::test_respect_host_listen_address[127.0.0.2---nanny] <- ../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 2%] 2185s cli/tests/test_dask_worker.py::test_respect_host_listen_address[127.0.0.2---no-nanny] <- ../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 2%] 2186s cli/tests/test_dask_worker.py::test_respect_host_listen_address[0.0.0.0---nanny] <- ../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 2%] 2187s cli/tests/test_dask_worker.py::test_respect_host_listen_address[0.0.0.0---no-nanny] <- ../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 2%] 2187s cli/tests/test_dask_worker.py::test_dashboard_non_standard_ports <- ../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py SKIPPED [ 2%] 2187s cli/tests/test_dask_worker.py::test_version_option <- ../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 2%] 2188s cli/tests/test_dask_worker.py::test_worker_timeout[True] <- ../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 2%] 2189s cli/tests/test_dask_worker.py::test_worker_timeout[False] <- ../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 2%] 2191s cli/tests/test_dask_worker.py::test_integer_names <- ../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 2%] 2192s cli/tests/test_dask_worker.py::test_worker_class[--nanny] <- ../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 2%] 2193s cli/tests/test_dask_worker.py::test_worker_class[--no-nanny] <- ../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 2%] 2194s cli/tests/test_dask_worker.py::test_preload_config <- ../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 2%] 2196s cli/tests/test_dask_worker.py::test_set_lifetime_stagger_via_env_var <- ../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 2%] 2198s cli/tests/test_dask_worker.py::test_set_lifetime_restart_via_env_var <- ../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 2%] 2199s cli/tests/test_dask_worker.py::test_timeout[--nanny] <- ../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 2%] 2201s cli/tests/test_dask_worker.py::test_timeout[--no-nanny] <- ../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 2%] 2202s cli/tests/test_dask_worker.py::test_signal_handling[2---nanny] <- ../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 2%] 2203s cli/tests/test_dask_worker.py::test_signal_handling[2---no-nanny] <- ../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 2%] 2205s cli/tests/test_dask_worker.py::test_signal_handling[15---nanny] <- ../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 2%] 2206s cli/tests/test_dask_worker.py::test_signal_handling[15---no-nanny] <- ../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 2%] 2208s cli/tests/test_dask_worker.py::test_error_during_startup[--nanny] <- ../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 2%] 2210s cli/tests/test_dask_worker.py::test_error_during_startup[--no-nanny] <- ../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 2%] 2213s cli/tests/test_dask_worker.py::test_single_executable_deprecated <- ../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 2%] 2215s cli/tests/test_dask_worker.py::test_single_executable_works <- ../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 2%] 2216s cli/tests/test_tls_cli.py::test_basic <- ../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_tls_cli.py PASSED [ 2%] 2218s cli/tests/test_tls_cli.py::test_sni <- ../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_tls_cli.py PASSED [ 2%] 2220s cli/tests/test_tls_cli.py::test_nanny <- ../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_tls_cli.py PASSED [ 2%] 2222s cli/tests/test_tls_cli.py::test_separate_key_cert <- ../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_tls_cli.py PASSED [ 2%] 2224s cli/tests/test_tls_cli.py::test_use_config_file <- ../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_tls_cli.py PASSED [ 2%] 2224s comm/tests/test_comms.py::test_parse_host_port[tornado] <- ../../../usr/lib/python3/dist-packages/distributed/comm/tests/test_comms.py PASSED [ 2%] 2224s comm/tests/test_comms.py::test_unparse_host_port[tornado] <- ../../../usr/lib/python3/dist-packages/distributed/comm/tests/test_comms.py PASSED [ 2%] 2224s comm/tests/test_comms.py::test_get_address_host[tornado] <- ../../../usr/lib/python3/dist-packages/distributed/comm/tests/test_comms.py PASSED [ 2%] 2224s comm/tests/test_comms.py::test_resolve_address[tornado] <- ../../../usr/lib/python3/dist-packages/distributed/comm/tests/test_comms.py PASSED [ 3%] 2224s comm/tests/test_comms.py::test_get_local_address_for[tornado] <- ../../../usr/lib/python3/dist-packages/distributed/comm/tests/test_comms.py PASSED [ 3%] 2224s comm/tests/test_comms.py::test_tcp_listener_does_not_call_handler_on_handshake_error[tornado] <- ../../../usr/lib/python3/dist-packages/distributed/comm/tests/test_comms.py PASSED [ 3%] 2224s comm/tests/test_comms.py::test_tcp_specific[tornado] <- ../../../usr/lib/python3/dist-packages/distributed/comm/tests/test_comms.py PASSED [ 3%] 2224s comm/tests/test_comms.py::test_tls_specific[tornado-None] <- ../../../usr/lib/python3/dist-packages/distributed/comm/tests/test_comms.py PASSED [ 3%] 2225s comm/tests/test_comms.py::test_tls_specific[tornado-localhost] <- ../../../usr/lib/python3/dist-packages/distributed/comm/tests/test_comms.py PASSED [ 3%] 2225s comm/tests/test_comms.py::test_comm_failure_threading[tornado] <- ../../../usr/lib/python3/dist-packages/distributed/comm/tests/test_comms.py PASSED [ 3%] 2225s comm/tests/test_comms.py::test_inproc_specific_same_thread <- ../../../usr/lib/python3/dist-packages/distributed/comm/tests/test_comms.py PASSED [ 3%] 2225s comm/tests/test_comms.py::test_inproc_specific_different_threads <- ../../../usr/lib/python3/dist-packages/distributed/comm/tests/test_comms.py PASSED [ 3%] 2225s comm/tests/test_comms.py::test_inproc_continues_listening_after_handshake_error <- ../../../usr/lib/python3/dist-packages/distributed/comm/tests/test_comms.py PASSED [ 3%] 2225s comm/tests/test_comms.py::test_inproc_handshakes_concurrently <- ../../../usr/lib/python3/dist-packages/distributed/comm/tests/test_comms.py PASSED [ 3%] 2225s comm/tests/test_comms.py::test_ucx_client_server <- ../../../usr/lib/python3/dist-packages/distributed/comm/tests/test_comms.py SKIPPED [ 3%] 2225s comm/tests/test_comms.py::test_default_client_server_ipv4[tornado] <- ../../../usr/lib/python3/dist-packages/distributed/comm/tests/test_comms.py PASSED [ 3%] 2225s comm/tests/test_comms.py::test_default_client_server_ipv6[tornado] <- ../../../usr/lib/python3/dist-packages/distributed/comm/tests/test_comms.py SKIPPED [ 3%] 2226s comm/tests/test_comms.py::test_tcp_client_server_ipv4[tornado] <- ../../../usr/lib/python3/dist-packages/distributed/comm/tests/test_comms.py PASSED [ 3%] 2226s comm/tests/test_comms.py::test_tcp_client_server_ipv6[tornado] <- ../../../usr/lib/python3/dist-packages/distributed/comm/tests/test_comms.py SKIPPED [ 3%] 2226s comm/tests/test_comms.py::test_tls_client_server_ipv4[tornado] <- ../../../usr/lib/python3/dist-packages/distributed/comm/tests/test_comms.py PASSED [ 3%] 2226s comm/tests/test_comms.py::test_tls_client_server_ipv6[tornado] <- ../../../usr/lib/python3/dist-packages/distributed/comm/tests/test_comms.py SKIPPED [ 3%] 2226s comm/tests/test_comms.py::test_inproc_client_server <- ../../../usr/lib/python3/dist-packages/distributed/comm/tests/test_comms.py PASSED [ 3%] 2226s comm/tests/test_comms.py::test_tls_reject_certificate[tornado] <- ../../../usr/lib/python3/dist-packages/distributed/comm/tests/test_comms.py PASSED [ 3%] 2226s comm/tests/test_comms.py::test_tcp_comm_closed_implicit[tornado] <- ../../../usr/lib/python3/dist-packages/distributed/comm/tests/test_comms.py PASSED [ 3%] 2226s comm/tests/test_comms.py::test_tls_comm_closed_implicit[tornado] <- ../../../usr/lib/python3/dist-packages/distributed/comm/tests/test_comms.py PASSED [ 3%] 2226s comm/tests/test_comms.py::test_inproc_comm_closed_implicit <- ../../../usr/lib/python3/dist-packages/distributed/comm/tests/test_comms.py PASSED [ 3%] 2226s comm/tests/test_comms.py::test_tcp_comm_closed_explicit[tornado] <- ../../../usr/lib/python3/dist-packages/distributed/comm/tests/test_comms.py PASSED [ 3%] 2226s comm/tests/test_comms.py::test_tls_comm_closed_explicit[tornado] <- ../../../usr/lib/python3/dist-packages/distributed/comm/tests/test_comms.py PASSED [ 3%] 2226s comm/tests/test_comms.py::test_inproc_comm_closed_explicit <- ../../../usr/lib/python3/dist-packages/distributed/comm/tests/test_comms.py PASSED [ 3%] 2226s comm/tests/test_comms.py::test_inproc_comm_closed_explicit_2 <- ../../../usr/lib/python3/dist-packages/distributed/comm/tests/test_comms.py PASSED [ 3%] 2226s comm/tests/test_comms.py::test_comm_closed_on_write_error[tornado-BufferError] <- ../../../usr/lib/python3/dist-packages/distributed/comm/tests/test_comms.py PASSED [ 3%] 2226s comm/tests/test_comms.py::test_comm_closed_on_write_error[tornado-CustomBase] <- ../../../usr/lib/python3/dist-packages/distributed/comm/tests/test_comms.py PASSED [ 3%] 2226s comm/tests/test_comms.py::test_comm_closed_on_read_error[tornado] <- ../../../usr/lib/python3/dist-packages/distributed/comm/tests/test_comms.py PASSED [ 3%] 2226s comm/tests/test_comms.py::test_retry_connect[tornado] <- ../../../usr/lib/python3/dist-packages/distributed/comm/tests/test_comms.py PASSED [ 3%] 2229s comm/tests/test_comms.py::test_handshake_slow_comm[tornado] <- ../../../usr/lib/python3/dist-packages/distributed/comm/tests/test_comms.py PASSED [ 3%] 2230s comm/tests/test_comms.py::test_tcp_connect_timeout[tornado] <- ../../../usr/lib/python3/dist-packages/distributed/comm/tests/test_comms.py PASSED [ 3%] 2230s comm/tests/test_comms.py::test_inproc_connect_timeout <- ../../../usr/lib/python3/dist-packages/distributed/comm/tests/test_comms.py PASSED [ 3%] 2230s comm/tests/test_comms.py::test_tcp_many_listeners[tornado] <- ../../../usr/lib/python3/dist-packages/distributed/comm/tests/test_comms.py PASSED [ 3%] 2230s comm/tests/test_comms.py::test_inproc_many_listeners <- ../../../usr/lib/python3/dist-packages/distributed/comm/tests/test_comms.py PASSED [ 3%] 2230s comm/tests/test_comms.py::test_tcp_deserialize[tornado] <- ../../../usr/lib/python3/dist-packages/distributed/comm/tests/test_comms.py PASSED [ 4%] 2230s comm/tests/test_comms.py::test_inproc_deserialize <- ../../../usr/lib/python3/dist-packages/distributed/comm/tests/test_comms.py PASSED [ 4%] 2230s comm/tests/test_comms.py::test_inproc_deserialize_roundtrip <- ../../../usr/lib/python3/dist-packages/distributed/comm/tests/test_comms.py PASSED [ 4%] 2230s comm/tests/test_comms.py::test_tcp_deserialize_roundtrip[tornado] <- ../../../usr/lib/python3/dist-packages/distributed/comm/tests/test_comms.py PASSED [ 4%] 2230s comm/tests/test_comms.py::test_tcp_deserialize_eoferror[tornado] <- ../../../usr/lib/python3/dist-packages/distributed/comm/tests/test_comms.py PASSED [ 4%] 2230s comm/tests/test_comms.py::test_tcp_repr[tornado] <- ../../../usr/lib/python3/dist-packages/distributed/comm/tests/test_comms.py PASSED [ 4%] 2230s comm/tests/test_comms.py::test_tls_repr[tornado] <- ../../../usr/lib/python3/dist-packages/distributed/comm/tests/test_comms.py PASSED [ 4%] 2230s comm/tests/test_comms.py::test_inproc_repr <- ../../../usr/lib/python3/dist-packages/distributed/comm/tests/test_comms.py PASSED [ 4%] 2230s comm/tests/test_comms.py::test_tcp_adresses[tornado] <- ../../../usr/lib/python3/dist-packages/distributed/comm/tests/test_comms.py PASSED [ 4%] 2230s comm/tests/test_comms.py::test_get_stream_address_raises_if_closed <- ../../../usr/lib/python3/dist-packages/distributed/comm/tests/test_comms.py PASSED [ 4%] 2230s comm/tests/test_comms.py::test_tls_adresses[tornado] <- ../../../usr/lib/python3/dist-packages/distributed/comm/tests/test_comms.py PASSED [ 4%] 2230s comm/tests/test_comms.py::test_inproc_adresses <- ../../../usr/lib/python3/dist-packages/distributed/comm/tests/test_comms.py PASSED [ 4%] 2231s comm/tests/test_comms.py::test_register_backend_entrypoint <- ../../../usr/lib/python3/dist-packages/distributed/comm/tests/test_comms.py PASSED [ 4%] 2231s comm/tests/test_comms.py::test_do_not_share_buffers[tornado-list] <- ../../../usr/lib/python3/dist-packages/distributed/comm/tests/test_comms.py PASSED [ 4%] 2231s comm/tests/test_comms.py::test_do_not_share_buffers[tornado-OpaqueList] <- ../../../usr/lib/python3/dist-packages/distributed/comm/tests/test_comms.py PASSED [ 4%] 2231s comm/tests/test_comms.py::test_share_buffer_with_header[tornado-1-0-False] <- ../../../usr/lib/python3/dist-packages/distributed/comm/tests/test_comms.py PASSED [ 4%] 2231s comm/tests/test_comms.py::test_share_buffer_with_header[tornado-1-1800-False] <- ../../../usr/lib/python3/dist-packages/distributed/comm/tests/test_comms.py PASSED [ 4%] 2231s comm/tests/test_comms.py::test_share_buffer_with_header[tornado-1-2100-True] <- ../../../usr/lib/python3/dist-packages/distributed/comm/tests/test_comms.py PASSED [ 4%] 2231s comm/tests/test_comms.py::test_share_buffer_with_header[tornado-200000-9500-False] <- ../../../usr/lib/python3/dist-packages/distributed/comm/tests/test_comms.py PASSED [ 4%] 2231s comm/tests/test_comms.py::test_share_buffer_with_header[tornado-200000-10500-True] <- ../../../usr/lib/python3/dist-packages/distributed/comm/tests/test_comms.py PASSED [ 4%] 2231s comm/tests/test_comms.py::test_share_buffer_with_header[tornado-350000-0-False] <- ../../../usr/lib/python3/dist-packages/distributed/comm/tests/test_comms.py PASSED [ 4%] 2231s comm/tests/test_tcp.py::test_getaddrinfo_invalid_af <- ../../../usr/lib/python3/dist-packages/distributed/comm/tests/test_tcp.py PASSED [ 4%] 2231s comm/tests/test_ws.py::test_registered <- ../../../usr/lib/python3/dist-packages/distributed/comm/tests/test_ws.py PASSED [ 4%] 2231s comm/tests/test_ws.py::test_listen_connect <- ../../../usr/lib/python3/dist-packages/distributed/comm/tests/test_ws.py PASSED [ 4%] 2231s comm/tests/test_ws.py::test_listen_connect_wss <- ../../../usr/lib/python3/dist-packages/distributed/comm/tests/test_ws.py PASSED [ 4%] 2231s comm/tests/test_ws.py::test_expect_ssl_context <- ../../../usr/lib/python3/dist-packages/distributed/comm/tests/test_ws.py PASSED [ 4%] 2231s comm/tests/test_ws.py::test_expect_scheduler_ssl_when_sharing_server <- ../../../usr/lib/python3/dist-packages/distributed/comm/tests/test_ws.py PASSED [ 4%] 2231s comm/tests/test_ws.py::test_roundtrip <- ../../../usr/lib/python3/dist-packages/distributed/comm/tests/test_ws.py PASSED [ 4%] 2233s comm/tests/test_ws.py::test_collections <- ../../../usr/lib/python3/dist-packages/distributed/comm/tests/test_ws.py PASSED [ 4%] 2234s comm/tests/test_ws.py::test_large_transfer <- ../../../usr/lib/python3/dist-packages/distributed/comm/tests/test_ws.py PASSED [ 4%] 2234s comm/tests/test_ws.py::test_http_and_comm_server[True-ws://-None-8787] <- ../../../usr/lib/python3/dist-packages/distributed/comm/tests/test_ws.py PASSED [ 4%] 2235s comm/tests/test_ws.py::test_http_and_comm_server[True-wss://-True-8787] <- ../../../usr/lib/python3/dist-packages/distributed/comm/tests/test_ws.py PASSED [ 4%] 2235s comm/tests/test_ws.py::test_http_and_comm_server[False-ws://-None-8787] <- ../../../usr/lib/python3/dist-packages/distributed/comm/tests/test_ws.py PASSED [ 4%] 2235s comm/tests/test_ws.py::test_http_and_comm_server[False-wss://-True-8787] <- ../../../usr/lib/python3/dist-packages/distributed/comm/tests/test_ws.py PASSED [ 4%] 2236s comm/tests/test_ws.py::test_http_and_comm_server[True-ws://-None-8786] <- ../../../usr/lib/python3/dist-packages/distributed/comm/tests/test_ws.py PASSED [ 4%] 2236s comm/tests/test_ws.py::test_http_and_comm_server[True-wss://-True-8786] <- ../../../usr/lib/python3/dist-packages/distributed/comm/tests/test_ws.py PASSED [ 4%] 2236s comm/tests/test_ws.py::test_http_and_comm_server[False-ws://-None-8786] <- ../../../usr/lib/python3/dist-packages/distributed/comm/tests/test_ws.py PASSED [ 4%] 2237s comm/tests/test_ws.py::test_http_and_comm_server[False-wss://-True-8786] <- ../../../usr/lib/python3/dist-packages/distributed/comm/tests/test_ws.py PASSED [ 5%] 2237s comm/tests/test_ws.py::test_connection_made_with_extra_conn_args[ws://-True] <- ../../../usr/lib/python3/dist-packages/distributed/comm/tests/test_ws.py PASSED [ 5%] 2237s comm/tests/test_ws.py::test_connection_made_with_extra_conn_args[ws://-False] <- ../../../usr/lib/python3/dist-packages/distributed/comm/tests/test_ws.py PASSED [ 5%] 2237s comm/tests/test_ws.py::test_connection_made_with_extra_conn_args[wss://-True] <- ../../../usr/lib/python3/dist-packages/distributed/comm/tests/test_ws.py PASSED [ 5%] 2237s comm/tests/test_ws.py::test_connection_made_with_extra_conn_args[wss://-False] <- ../../../usr/lib/python3/dist-packages/distributed/comm/tests/test_ws.py PASSED [ 5%] 2237s comm/tests/test_ws.py::test_connection_made_with_sni <- ../../../usr/lib/python3/dist-packages/distributed/comm/tests/test_ws.py PASSED [ 5%] 2237s comm/tests/test_ws.py::test_quiet_close <- ../../../usr/lib/python3/dist-packages/distributed/comm/tests/test_ws.py PASSED [ 5%] 2238s comm/tests/test_ws.py::test_ws_roundtrip <- ../../../usr/lib/python3/dist-packages/distributed/comm/tests/test_ws.py PASSED [ 5%] 2238s comm/tests/test_ws.py::test_wss_roundtrip <- ../../../usr/lib/python3/dist-packages/distributed/comm/tests/test_ws.py PASSED [ 5%] 2238s dashboard/tests/test_bokeh.py::test_old_import <- ../../../usr/lib/python3/dist-packages/distributed/dashboard/tests/test_bokeh.py PASSED [ 5%] 2239s deploy/tests/test_adaptive.py::test_adaptive_local_cluster <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_adaptive.py PASSED [ 5%] 2241s deploy/tests/test_adaptive.py::test_adaptive_local_cluster_multi_workers <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_adaptive.py PASSED [ 5%] 2242s deploy/tests/test_adaptive.py::test_min_max <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_adaptive.py PASSED [ 5%] 2243s deploy/tests/test_adaptive.py::test_avoid_churn <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_adaptive.py PASSED [ 5%] 2243s deploy/tests/test_adaptive.py::test_adapt_quickly <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_adaptive.py PASSED [ 5%] 2244s deploy/tests/test_adaptive.py::test_adapt_down <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_adaptive.py PASSED [ 5%] 2244s deploy/tests/test_adaptive.py::test_no_more_workers_than_tasks <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_adaptive.py PASSED [ 5%] 2246s deploy/tests/test_adaptive.py::test_basic_no_loop <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_adaptive.py PASSED [ 5%] 2248s deploy/tests/test_adaptive.py::test_target_duration[5] <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_adaptive.py PASSED [ 5%] 2248s deploy/tests/test_adaptive.py::test_target_duration[1] <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_adaptive.py PASSED [ 5%] 2251s deploy/tests/test_adaptive.py::test_worker_keys <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_adaptive.py PASSED [ 5%] 2251s deploy/tests/test_adaptive.py::test_adapt_cores_memory <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_adaptive.py PASSED [ 5%] 2251s deploy/tests/test_adaptive.py::test_adaptive_config <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_adaptive.py PASSED [ 5%] 2251s deploy/tests/test_adaptive.py::test_update_adaptive <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_adaptive.py PASSED [ 5%] 2254s deploy/tests/test_adaptive.py::test_adaptive_no_memory_limit <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_adaptive.py PASSED [ 5%] 2254s deploy/tests/test_adaptive.py::test_adapt_gets_stopped_on_cluster_close <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_adaptive.py PASSED [ 5%] 2259s deploy/tests/test_adaptive.py::test_scale_needs_to_be_awaited <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_adaptive.py PASSED [ 5%] 2259s deploy/tests/test_adaptive.py::test_adaptive_stopped <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_adaptive.py PASSED [ 5%] 2259s deploy/tests/test_adaptive.py::test_scale_up_large_tasks[1] <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_adaptive.py PASSED [ 5%] 2259s deploy/tests/test_adaptive.py::test_scale_up_large_tasks[inf] <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_adaptive.py PASSED [ 5%] 2259s deploy/tests/test_adaptive.py::test_respect_average_nthreads <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_adaptive.py PASSED [ 5%] 2259s deploy/tests/test_adaptive.py::test_adaptive_stops_on_cluster_status_change <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_adaptive.py PASSED [ 5%] 2260s deploy/tests/test_adaptive.py::test_interval <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_adaptive.py PASSED [ 5%] 2260s deploy/tests/test_adaptive.py::test_adapt_logs_error_in_safe_target <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_adaptive.py PASSED [ 5%] 2260s deploy/tests/test_adaptive.py::test_adapt_callback_logs_error_in_scale_down <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_adaptive.py PASSED [ 5%] 2260s deploy/tests/test_adaptive.py::test_adaptive_logs_stopping_once[True] <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_adaptive.py PASSED [ 5%] 2260s deploy/tests/test_adaptive.py::test_adaptive_logs_stopping_once[False] <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_adaptive.py PASSED [ 6%] 2260s deploy/tests/test_adaptive.py::test_adapt_stop_del <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_adaptive.py PASSED [ 6%] 2260s deploy/tests/test_adaptive_core.py::test_safe_target <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_adaptive_core.py PASSED [ 6%] 2260s deploy/tests/test_adaptive_core.py::test_scale_up <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_adaptive_core.py PASSED [ 6%] 2260s deploy/tests/test_adaptive_core.py::test_scale_down <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_adaptive_core.py PASSED [ 6%] 2260s deploy/tests/test_cluster.py::test_eq <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_cluster.py PASSED [ 6%] 2260s deploy/tests/test_cluster.py::test_repr <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_cluster.py PASSED [ 6%] 2262s deploy/tests/test_cluster.py::test_cluster_wait_for_worker <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_cluster.py PASSED [ 6%] 2262s deploy/tests/test_cluster.py::test_deprecated_loop_properties <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_cluster.py PASSED [ 6%] 2262s deploy/tests/test_cluster.py::test_exponential_backoff <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_cluster.py PASSED [ 6%] 2262s deploy/tests/test_cluster.py::test_sync_context_manager_used_with_async_cluster <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_cluster.py PASSED [ 6%] 2262s deploy/tests/test_deploy_utils.py::test_default_process_thread_breakdown <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_deploy_utils.py PASSED [ 6%] 2262s deploy/tests/test_local.py::test_simple <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_local.py PASSED [ 6%] 2262s deploy/tests/test_local.py::test_local_cluster_supports_blocked_handlers <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_local.py PASSED [ 6%] 2264s deploy/tests/test_local.py::test_close_twice <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_local.py PASSED [ 6%] 2266s deploy/tests/test_local.py::test_procs <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_local.py PASSED [ 6%] 2266s deploy/tests/test_local.py::test_move_unserializable_data <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_local.py PASSED [ 6%] 2266s deploy/tests/test_local.py::test_transports_inproc <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_local.py PASSED [ 6%] 2267s deploy/tests/test_local.py::test_transports_tcp <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_local.py PASSED [ 6%] 2267s deploy/tests/test_local.py::test_transports_tcp_port <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_local.py PASSED [ 6%] 2267s deploy/tests/test_local.py::test_cores <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_local.py PASSED [ 6%] 2267s deploy/tests/test_local.py::test_submit <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_local.py PASSED [ 6%] 2267s deploy/tests/test_local.py::test_context_manager <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_local.py PASSED [ 6%] 2268s deploy/tests/test_local.py::test_no_workers_sync <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_local.py PASSED [ 6%] 2268s deploy/tests/test_local.py::test_Client_with_local <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_local.py PASSED [ 6%] 2269s deploy/tests/test_local.py::test_Client_solo <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_local.py PASSED [ 6%] 2269s deploy/tests/test_local.py::test_duplicate_clients <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_local.py SKIPPED [ 6%] 2270s deploy/tests/test_local.py::test_Client_kwargs <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_local.py PASSED [ 6%] 2271s deploy/tests/test_local.py::test_Client_unused_kwargs_with_cluster <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_local.py PASSED [ 6%] 2271s deploy/tests/test_local.py::test_Client_unused_kwargs_with_address <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_local.py PASSED [ 6%] 2273s deploy/tests/test_local.py::test_Client_twice <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_local.py PASSED [ 6%] 2274s deploy/tests/test_local.py::test_client_constructor_with_temporary_security <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_local.py PASSED [ 6%] 2275s deploy/tests/test_local.py::test_defaults <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_local.py PASSED [ 6%] 2275s deploy/tests/test_local.py::test_defaults_2 <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_local.py PASSED [ 6%] 2276s deploy/tests/test_local.py::test_defaults_3 <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_local.py PASSED [ 6%] 2277s deploy/tests/test_local.py::test_defaults_4 <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_local.py PASSED [ 6%] 2279s deploy/tests/test_local.py::test_defaults_5 <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_local.py PASSED [ 7%] 2280s deploy/tests/test_local.py::test_defaults_6 <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_local.py PASSED [ 7%] 2280s deploy/tests/test_local.py::test_worker_params <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_local.py PASSED [ 7%] 2280s deploy/tests/test_local.py::test_memory_limit_none <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_local.py PASSED [ 7%] 2282s deploy/tests/test_local.py::test_cleanup <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_local.py PASSED [ 7%] 2282s deploy/tests/test_local.py::test_repeated <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_local.py PASSED [ 7%] 2282s deploy/tests/test_local.py::test_bokeh[True] <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_local.py SKIPPED [ 7%] 2282s deploy/tests/test_local.py::test_bokeh[False] <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_local.py SKIPPED [ 7%] 2283s deploy/tests/test_local.py::test_blocks_until_full <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_local.py PASSED [ 7%] 2283s deploy/tests/test_local.py::test_scale_up_and_down <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_local.py PASSED [ 7%] 2285s deploy/tests/test_local.py::test_silent_startup <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_local.py PASSED [ 7%] 2285s deploy/tests/test_local.py::test_only_local_access <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_local.py PASSED [ 7%] 2285s deploy/tests/test_local.py::test_remote_access <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_local.py PASSED [ 7%] 2285s deploy/tests/test_local.py::test_memory[None] <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_local.py PASSED [ 7%] 2285s deploy/tests/test_local.py::test_memory[3] <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_local.py PASSED [ 7%] 2286s deploy/tests/test_local.py::test_memory_nanny[None] <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_local.py PASSED [ 7%] 2287s deploy/tests/test_local.py::test_memory_nanny[3] <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_local.py PASSED [ 7%] 2287s deploy/tests/test_local.py::test_death_timeout_raises <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_local.py PASSED [ 7%] 2287s deploy/tests/test_local.py::test_bokeh_kwargs <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_local.py SKIPPED [ 7%] 2288s deploy/tests/test_local.py::test_io_loop_periodic_callbacks <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_local.py PASSED [ 7%] 2288s deploy/tests/test_local.py::test_logging <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_local.py PASSED [ 7%] 2288s deploy/tests/test_local.py::test_ipywidgets <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_local.py SKIPPED [ 7%] 2288s deploy/tests/test_local.py::test_ipywidgets_loop <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_local.py SKIPPED [ 7%] 2288s deploy/tests/test_local.py::test_no_ipywidgets <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_local.py PASSED [ 7%] 2289s deploy/tests/test_local.py::test_scale <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_local.py PASSED [ 7%] 2289s deploy/tests/test_local.py::test_adapt <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_local.py PASSED [ 7%] 2289s deploy/tests/test_local.py::test_adapt_then_manual <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_local.py PASSED [ 7%] 2289s deploy/tests/test_local.py::test_local_tls[True] <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_local.py PASSED [ 7%] 2289s deploy/tests/test_local.py::test_local_tls[False] <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_local.py PASSED [ 7%] 2289s deploy/tests/test_local.py::test_scale_retires_workers <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_local.py PASSED [ 7%] 2292s deploy/tests/test_local.py::test_local_tls_restart <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_local.py PASSED [ 7%] 2292s deploy/tests/test_local.py::test_asynchronous_property <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_local.py PASSED [ 7%] 2292s deploy/tests/test_local.py::test_protocol_inproc <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_local.py PASSED [ 7%] 2292s deploy/tests/test_local.py::test_protocol_tcp <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_local.py PASSED [ 7%] 2292s deploy/tests/test_local.py::test_protocol_ip <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_local.py PASSED [ 7%] 2292s deploy/tests/test_local.py::test_worker_class_worker <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_local.py PASSED [ 7%] 2293s deploy/tests/test_local.py::test_worker_class_nanny <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_local.py PASSED [ 8%] 2294s deploy/tests/test_local.py::test_worker_class_nanny_async <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_local.py PASSED [ 8%] 2294s deploy/tests/test_local.py::test_starts_up_sync <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_local.py PASSED [ 8%] 2296s deploy/tests/test_local.py::test_dont_select_closed_worker <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_local.py PASSED [ 8%] 2296s deploy/tests/test_local.py::test_client_cluster_synchronous <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_local.py PASSED [ 8%] 2296s deploy/tests/test_local.py::test_scale_memory_cores <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_local.py PASSED [ 8%] 2296s deploy/tests/test_local.py::test_repr[2 GiB] <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_local.py PASSED [ 8%] 2296s deploy/tests/test_local.py::test_repr[None] <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_local.py PASSED [ 8%] 2296s deploy/tests/test_local.py::test_threads_per_worker_set_to_0 <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_local.py PASSED [ 8%] 2296s deploy/tests/test_local.py::test_capture_security[True] <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_local.py PASSED [ 8%] 2296s deploy/tests/test_local.py::test_capture_security[False] <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_local.py PASSED [ 8%] 2296s deploy/tests/test_local.py::test_no_dangling_asyncio_tasks <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_local.py PASSED [ 8%] 2296s deploy/tests/test_local.py::test_async_with <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_local.py PASSED [ 8%] 2296s deploy/tests/test_local.py::test_no_workers <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_local.py PASSED [ 8%] 2296s deploy/tests/test_local.py::test_cluster_names <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_local.py PASSED [ 8%] 2297s deploy/tests/test_local.py::test_local_cluster_redundant_kwarg[True] <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_local.py PASSED [ 8%] 2297s deploy/tests/test_local.py::test_local_cluster_redundant_kwarg[False] <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_local.py PASSED [ 8%] 2297s deploy/tests/test_local.py::test_cluster_info_sync <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_local.py PASSED [ 8%] 2297s deploy/tests/test_local.py::test_cluster_info_sync_is_robust_to_network_blips <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_local.py PASSED [ 8%] 2298s deploy/tests/test_local.py::test_cluster_host_used_throughout_cluster[True-None] <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_local.py PASSED [ 8%] 2299s deploy/tests/test_local.py::test_cluster_host_used_throughout_cluster[True-127.0.0.1] <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_local.py PASSED [ 8%] 2300s deploy/tests/test_local.py::test_cluster_host_used_throughout_cluster[False-None] <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_local.py PASSED [ 8%] 2301s deploy/tests/test_local.py::test_cluster_host_used_throughout_cluster[False-127.0.0.1] <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_local.py PASSED [ 8%] 2301s deploy/tests/test_local.py::test_connect_to_closed_cluster <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_local.py PASSED [ 8%] 2302s deploy/tests/test_local.py::test_localcluster_start_exception <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_local.py PASSED [ 8%] 2302s deploy/tests/test_old_ssh.py::test_old_ssh_n_workers_with_nprocs_is_an_error <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_old_ssh.py PASSED [ 8%] 2302s deploy/tests/test_old_ssh.py::test_extra_kwargs_is_an_error <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_old_ssh.py PASSED [ 8%] 2302s deploy/tests/test_slow_adaptive.py::test_startup <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_slow_adaptive.py PASSED [ 8%] 2302s deploy/tests/test_slow_adaptive.py::test_scale_up_down <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_slow_adaptive.py PASSED [ 8%] 2302s deploy/tests/test_slow_adaptive.py::test_adaptive <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_slow_adaptive.py PASSED [ 8%] 2302s deploy/tests/test_spec_cluster.py::test_specification <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_spec_cluster.py PASSED [ 8%] 2303s deploy/tests/test_spec_cluster.py::test_spec_sync <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_spec_cluster.py PASSED [ 8%] 2303s deploy/tests/test_spec_cluster.py::test_loop_started_in_constructor <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_spec_cluster.py PASSED [ 8%] 2303s deploy/tests/test_spec_cluster.py::test_repr <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_spec_cluster.py PASSED [ 8%] 2303s deploy/tests/test_spec_cluster.py::test_scale <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_spec_cluster.py PASSED [ 8%] 2306s deploy/tests/test_spec_cluster.py::test_adaptive_killed_worker <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_spec_cluster.py PASSED [ 8%] 2306s deploy/tests/test_spec_cluster.py::test_unexpected_closed_worker <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_spec_cluster.py PASSED [ 8%] 2308s deploy/tests/test_spec_cluster.py::test_restart <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_spec_cluster.py PASSED [ 9%] 2308s deploy/tests/test_spec_cluster.py::test_broken_worker <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_spec_cluster.py PASSED [ 9%] 2308s deploy/tests/test_spec_cluster.py::test_spec_close_clusters <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_spec_cluster.py PASSED [ 9%] 2308s deploy/tests/test_spec_cluster.py::test_new_worker_spec <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_spec_cluster.py PASSED [ 9%] 2309s deploy/tests/test_spec_cluster.py::test_nanny_port <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_spec_cluster.py PASSED [ 9%] 2309s deploy/tests/test_spec_cluster.py::test_spec_process <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_spec_cluster.py PASSED [ 9%] 2309s deploy/tests/test_spec_cluster.py::test_get_logs <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_spec_cluster.py PASSED [ 9%] 2309s deploy/tests/test_spec_cluster.py::test_logs_deprecated <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_spec_cluster.py PASSED [ 9%] 2309s deploy/tests/test_spec_cluster.py::test_scheduler_info <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_spec_cluster.py PASSED [ 9%] 2309s deploy/tests/test_spec_cluster.py::test_dashboard_link <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_spec_cluster.py PASSED [ 9%] 2309s deploy/tests/test_spec_cluster.py::test_widget <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_spec_cluster.py PASSED [ 9%] 2309s deploy/tests/test_spec_cluster.py::test_scale_cores_memory <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_spec_cluster.py PASSED [ 9%] 2309s deploy/tests/test_spec_cluster.py::test_ProcessInterfaceValid <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_spec_cluster.py PASSED [ 9%] 2310s deploy/tests/test_spec_cluster.py::test_MultiWorker <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_spec_cluster.py PASSED [ 9%] 2310s deploy/tests/test_spec_cluster.py::test_run_spec <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_spec_cluster.py PASSED [ 9%] 2310s deploy/tests/test_spec_cluster.py::test_run_spec_cluster_worker_names <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_spec_cluster.py PASSED [ 9%] 2310s deploy/tests/test_spec_cluster.py::test_bad_close <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_spec_cluster.py PASSED [ 9%] 2312s deploy/tests/test_subprocess.py::test_basic <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_subprocess.py PASSED [ 9%] 2314s deploy/tests/test_subprocess.py::test_n_workers <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_subprocess.py PASSED [ 9%] 2316s deploy/tests/test_subprocess.py::test_scale_up_and_down <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_subprocess.py PASSED [ 9%] 2316s deploy/tests/test_subprocess.py::test_raise_if_scheduler_fails_to_start <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_subprocess.py PASSED [ 9%] 2318s deploy/tests/test_subprocess.py::test_subprocess_cluster_does_not_depend_on_logging <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_subprocess.py PASSED [ 9%] 2318s deploy/tests/test_subprocess.py::test_raise_on_windows <- ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_subprocess.py SKIPPED [ 9%] 2321s diagnostics/tests/test_cluster_dump_plugin.py::test_cluster_dump_plugin <- ../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_cluster_dump_plugin.py PASSED [ 9%] 2321s diagnostics/tests/test_eventstream.py::test_eventstream <- ../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_eventstream.py SKIPPED [ 9%] 2321s diagnostics/tests/test_eventstream.py::test_eventstream_remote <- ../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_eventstream.py PASSED [ 9%] 2321s diagnostics/tests/test_graph_layout.py::test_basic <- ../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_graph_layout.py PASSED [ 9%] 2321s diagnostics/tests/test_graph_layout.py::test_construct_after_call <- ../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_graph_layout.py PASSED [ 9%] 2321s diagnostics/tests/test_graph_layout.py::test_states <- ../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_graph_layout.py PASSED [ 9%] 2321s diagnostics/tests/test_graph_layout.py::test_release_tasks <- ../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_graph_layout.py PASSED [ 9%] 2321s diagnostics/tests/test_graph_layout.py::test_forget <- ../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_graph_layout.py PASSED [ 9%] 2321s diagnostics/tests/test_graph_layout.py::test_unique_positions <- ../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_graph_layout.py PASSED [ 9%] 2321s diagnostics/tests/test_graph_layout.py::test_layout_scatter <- ../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_graph_layout.py PASSED [ 9%] 2321s diagnostics/tests/test_install_plugin.py::test_pip_install <- ../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_install_plugin.py PASSED [ 9%] 2321s diagnostics/tests/test_install_plugin.py::test_conda_install <- ../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_install_plugin.py PASSED [ 9%] 2321s diagnostics/tests/test_install_plugin.py::test_pip_install_fails <- ../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_install_plugin.py PASSED [ 9%] 2321s diagnostics/tests/test_install_plugin.py::test_conda_install_fails_when_conda_not_found <- ../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_install_plugin.py PASSED [ 10%] 2322s diagnostics/tests/test_install_plugin.py::test_conda_install_fails_when_conda_raises <- ../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_install_plugin.py PASSED [ 10%] 2322s diagnostics/tests/test_install_plugin.py::test_conda_install_fails_on_returncode <- ../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_install_plugin.py PASSED [ 10%] 2322s diagnostics/tests/test_install_plugin.py::test_package_install_on_worker <- ../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_install_plugin.py PASSED [ 10%] 2323s diagnostics/tests/test_install_plugin.py::test_package_install_on_nanny <- ../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_install_plugin.py PASSED [ 10%] 2324s diagnostics/tests/test_install_plugin.py::test_package_install_restarts_on_nanny <- ../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_install_plugin.py PASSED [ 10%] 2325s diagnostics/tests/test_install_plugin.py::test_package_install_failing_does_not_restart_on_nanny <- ../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_install_plugin.py PASSED [ 10%] 2327s diagnostics/tests/test_memory_sampler.py::test_sync <- ../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_memory_sampler.py PASSED [ 10%] 2327s diagnostics/tests/test_memory_sampler.py::test_at_least_one_sample <- ../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_memory_sampler.py PASSED [ 10%] 2327s diagnostics/tests/test_memory_sampler.py::test_multi_sample <- ../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_memory_sampler.py PASSED [ 10%] 2328s diagnostics/tests/test_memory_sampler.py::test_pandas[False] <- ../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_memory_sampler.py PASSED [ 10%] 2328s diagnostics/tests/test_memory_sampler.py::test_pandas[True] <- ../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_memory_sampler.py PASSED [ 10%] 2328s diagnostics/tests/test_memory_sampler.py::test_pandas_multiseries[False] <- ../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_memory_sampler.py PASSED [ 10%] 2328s diagnostics/tests/test_memory_sampler.py::test_pandas_multiseries[True] <- ../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_memory_sampler.py PASSED [ 10%] 2329s diagnostics/tests/test_nanny_plugin.py::test_register_worker_plugin_is_deprecated <- ../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_nanny_plugin.py PASSED [ 10%] 2330s diagnostics/tests/test_nanny_plugin.py::test_register_worker_plugin_typing_over_nanny_keyword <- ../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_nanny_plugin.py PASSED [ 10%] 2331s diagnostics/tests/test_nanny_plugin.py::test_duck_typed_register_nanny_plugin_is_deprecated <- ../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_nanny_plugin.py PASSED [ 10%] 2332s diagnostics/tests/test_nanny_plugin.py::test_register_idempotent_plugin <- ../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_nanny_plugin.py PASSED [ 10%] 2333s diagnostics/tests/test_nanny_plugin.py::test_register_non_idempotent_plugin <- ../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_nanny_plugin.py PASSED [ 10%] 2334s diagnostics/tests/test_nanny_plugin.py::test_register_plugin_with_idempotent_keyword_is_deprecated <- ../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_nanny_plugin.py PASSED [ 10%] 2335s diagnostics/tests/test_nanny_plugin.py::test_register_plugin_with_broken_setup_to_existing_nannies_raises <- ../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_nanny_plugin.py PASSED [ 10%] 2336s diagnostics/tests/test_nanny_plugin.py::test_plugin_with_broken_setup_on_new_nanny_logs <- ../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_nanny_plugin.py PASSED [ 10%] 2337s diagnostics/tests/test_nanny_plugin.py::test_unregister_nanny_plugin_with_broken_teardown_raises <- ../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_nanny_plugin.py PASSED [ 10%] 2338s diagnostics/tests/test_nanny_plugin.py::test_nanny_plugin_with_broken_teardown_logs_on_close <- ../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_nanny_plugin.py PASSED [ 10%] 2339s diagnostics/tests/test_progress.py::test_many_Progress <- ../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_progress.py PASSED [ 10%] 2339s diagnostics/tests/test_progress.py::test_multiprogress <- ../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_progress.py PASSED [ 10%] 2339s diagnostics/tests/test_progress.py::test_multiprogress_cancel <- ../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_progress.py PASSED [ 10%] 2339s diagnostics/tests/test_progress.py::test_multiprogress_with_spans <- ../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_progress.py PASSED [ 10%] 2339s diagnostics/tests/test_progress.py::test_multiprogress_with_prefix <- ../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_progress.py PASSED [ 10%] 2339s diagnostics/tests/test_progress.py::test_multiprogress_warns <- ../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_progress.py PASSED [ 10%] 2339s diagnostics/tests/test_progress.py::test_robust_to_bad_plugin <- ../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_progress.py PASSED [ 10%] 2343s diagnostics/tests/test_progress.py::test_AllProgress <- ../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_progress.py PASSED [ 10%] 2345s diagnostics/tests/test_progress.py::test_AllProgress_lost_key <- ../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_progress.py PASSED [ 10%] 2350s diagnostics/tests/test_progress.py::test_group_timing <- ../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_progress.py PASSED [ 10%] 2350s diagnostics/tests/test_progressbar.py::test_text_progressbar <- ../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_progressbar.py PASSED [ 10%] 2351s diagnostics/tests/test_progressbar.py::test_TextProgressBar_error <- ../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_progressbar.py PASSED [ 10%] 2351s diagnostics/tests/test_progressbar.py::test_TextProgressBar_empty <- ../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_progressbar.py PASSED [ 11%] 2352s diagnostics/tests/test_progressbar.py::test_progress_function <- ../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_progressbar.py PASSED [ 11%] 2353s diagnostics/tests/test_progressbar.py::test_progress_function_w_kwargs <- ../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_progressbar.py PASSED [ 11%] 2355s diagnostics/tests/test_progressbar.py::test_progress_function_warns <- ../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_progressbar.py PASSED [ 11%] 2355s diagnostics/tests/test_progressbar.py::test_progress_function_raises <- ../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_progressbar.py PASSED [ 11%] 2355s diagnostics/tests/test_progressbar.py::test_deprecated_loop_properties <- ../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_progressbar.py PASSED [ 11%] 2355s diagnostics/tests/test_scheduler_plugin.py::test_simple <- ../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_scheduler_plugin.py PASSED [ 11%] 2355s diagnostics/tests/test_scheduler_plugin.py::test_add_remove_worker <- ../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_scheduler_plugin.py PASSED [ 11%] 2355s diagnostics/tests/test_scheduler_plugin.py::test_remove_worker_renamed_kwargs_allowed <- ../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_scheduler_plugin.py PASSED [ 11%] 2355s diagnostics/tests/test_scheduler_plugin.py::test_remove_worker_without_kwargs_deprecated <- ../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_scheduler_plugin.py PASSED [ 11%] 2355s diagnostics/tests/test_scheduler_plugin.py::test_async_add_remove_worker <- ../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_scheduler_plugin.py PASSED [ 11%] 2355s diagnostics/tests/test_scheduler_plugin.py::test_async_and_sync_add_remove_worker <- ../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_scheduler_plugin.py PASSED [ 11%] 2355s diagnostics/tests/test_scheduler_plugin.py::test_failing_async_add_remove_worker <- ../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_scheduler_plugin.py PASSED [ 11%] 2355s diagnostics/tests/test_scheduler_plugin.py::test_failing_sync_add_remove_worker <- ../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_scheduler_plugin.py PASSED [ 11%] 2355s diagnostics/tests/test_scheduler_plugin.py::test_lifecycle <- ../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_scheduler_plugin.py PASSED [ 11%] 2355s diagnostics/tests/test_scheduler_plugin.py::test_register_plugin <- ../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_scheduler_plugin.py PASSED [ 11%] 2355s diagnostics/tests/test_scheduler_plugin.py::test_register_scheduler_plugin_deprecated <- ../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_scheduler_plugin.py PASSED [ 11%] 2355s diagnostics/tests/test_scheduler_plugin.py::test_unregister_scheduler_plugin <- ../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_scheduler_plugin.py PASSED [ 11%] 2355s diagnostics/tests/test_scheduler_plugin.py::test_unregister_scheduler_plugin_from_client <- ../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_scheduler_plugin.py PASSED [ 11%] 2355s diagnostics/tests/test_scheduler_plugin.py::test_register_plugin_on_scheduler <- ../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_scheduler_plugin.py PASSED [ 11%] 2357s diagnostics/tests/test_scheduler_plugin.py::test_closing_errors_ok <- ../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_scheduler_plugin.py PASSED [ 11%] 2357s diagnostics/tests/test_scheduler_plugin.py::test_update_graph_hook_simple <- ../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_scheduler_plugin.py PASSED [ 11%] 2357s diagnostics/tests/test_scheduler_plugin.py::test_update_graph_hook_complex <- ../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_scheduler_plugin.py PASSED [ 11%] 2357s diagnostics/tests/test_scheduler_plugin.py::test_scheduler_plugin_in_register_worker_plugin_overrides <- ../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_scheduler_plugin.py PASSED [ 11%] 2359s diagnostics/tests/test_scheduler_plugin.py::test_scheduler_plugin_in_register_worker_plugin_overrides_nanny <- ../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_scheduler_plugin.py PASSED [ 11%] 2359s diagnostics/tests/test_scheduler_plugin.py::test_register_idempotent_plugin <- ../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_scheduler_plugin.py PASSED [ 11%] 2359s diagnostics/tests/test_scheduler_plugin.py::test_register_non_idempotent_plugin <- ../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_scheduler_plugin.py PASSED [ 11%] 2359s diagnostics/tests/test_scheduler_plugin.py::test_register_plugin_with_idempotent_keyword_is_deprecated <- ../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_scheduler_plugin.py PASSED [ 11%] 2359s diagnostics/tests/test_scheduler_plugin.py::test_register_idempotent_plugins_directly <- ../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_scheduler_plugin.py PASSED [ 11%] 2359s diagnostics/tests/test_scheduler_plugin.py::test_register_non_idempotent_plugins_directly <- ../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_scheduler_plugin.py PASSED [ 11%] 2359s diagnostics/tests/test_task_stream.py::test_TaskStreamPlugin <- ../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_task_stream.py PASSED [ 11%] 2359s diagnostics/tests/test_task_stream.py::test_maxlen <- ../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_task_stream.py PASSED [ 11%] 2359s diagnostics/tests/test_task_stream.py::test_collect <- ../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_task_stream.py PASSED [ 11%] 2359s diagnostics/tests/test_task_stream.py::test_no_startstops <- ../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_task_stream.py PASSED [ 11%] 2360s diagnostics/tests/test_task_stream.py::test_client <- ../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_task_stream.py PASSED [ 11%] 2362s diagnostics/tests/test_task_stream.py::test_client_sync <- ../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_task_stream.py PASSED [ 11%] 2362s diagnostics/tests/test_task_stream.py::test_get_task_stream_plot <- ../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_task_stream.py SKIPPED [ 12%] 2363s diagnostics/tests/test_task_stream.py::test_get_task_stream_save <- ../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_task_stream.py SKIPPED [ 12%] 2363s diagnostics/tests/test_worker_plugin.py::test_create_with_client <- ../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_worker_plugin.py PASSED [ 12%] 2363s diagnostics/tests/test_worker_plugin.py::test_remove_with_client <- ../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_worker_plugin.py PASSED [ 12%] 2363s diagnostics/tests/test_worker_plugin.py::test_remove_with_client_raises <- ../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_worker_plugin.py PASSED [ 12%] 2363s diagnostics/tests/test_worker_plugin.py::test_create_on_construction <- ../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_worker_plugin.py PASSED [ 12%] 2363s diagnostics/tests/test_worker_plugin.py::test_normal_task_transitions_called <- ../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_worker_plugin.py PASSED [ 12%] 2363s diagnostics/tests/test_worker_plugin.py::test_failing_task_transitions_called <- ../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_worker_plugin.py PASSED [ 12%] 2363s diagnostics/tests/test_worker_plugin.py::test_superseding_task_transitions_called <- ../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_worker_plugin.py PASSED [ 12%] 2363s diagnostics/tests/test_worker_plugin.py::test_dependent_tasks <- ../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_worker_plugin.py PASSED [ 12%] 2363s diagnostics/tests/test_worker_plugin.py::test_empty_plugin <- ../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_worker_plugin.py PASSED [ 12%] 2363s diagnostics/tests/test_worker_plugin.py::test_default_name <- ../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_worker_plugin.py PASSED [ 12%] 2363s diagnostics/tests/test_worker_plugin.py::test_assert_no_warning_no_overload <- ../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_worker_plugin.py PASSED [ 12%] 2364s diagnostics/tests/test_worker_plugin.py::test_WorkerPlugin_overwrite <- ../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_worker_plugin.py PASSED [ 12%] 2364s diagnostics/tests/test_worker_plugin.py::test_register_worker_plugin_is_deprecated <- ../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_worker_plugin.py PASSED [ 12%] 2364s diagnostics/tests/test_worker_plugin.py::test_register_worker_plugin_typing_over_nanny_keyword <- ../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_worker_plugin.py PASSED [ 12%] 2364s diagnostics/tests/test_worker_plugin.py::test_duck_typed_register_worker_plugin_is_deprecated <- ../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_worker_plugin.py PASSED [ 12%] 2364s diagnostics/tests/test_worker_plugin.py::test_register_idempotent_plugin <- ../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_worker_plugin.py PASSED [ 12%] 2364s diagnostics/tests/test_worker_plugin.py::test_register_non_idempotent_plugin <- ../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_worker_plugin.py PASSED [ 12%] 2364s diagnostics/tests/test_worker_plugin.py::test_register_plugin_with_idempotent_keyword_is_deprecated <- ../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_worker_plugin.py PASSED [ 12%] 2364s diagnostics/tests/test_worker_plugin.py::test_register_plugin_with_broken_setup_to_existing_workers_raises <- ../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_worker_plugin.py PASSED [ 12%] 2364s diagnostics/tests/test_worker_plugin.py::test_plugin_with_broken_setup_on_new_worker_logs <- ../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_worker_plugin.py PASSED [ 12%] 2364s diagnostics/tests/test_worker_plugin.py::test_unregister_worker_plugin_with_broken_teardown_raises <- ../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_worker_plugin.py PASSED [ 12%] 2364s diagnostics/tests/test_worker_plugin.py::test_plugin_with_broken_teardown_logs_on_close <- ../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_worker_plugin.py PASSED [ 12%] 2364s http/scheduler/tests/test_missing_bokeh.py::test_missing_bokeh <- ../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_missing_bokeh.py PASSED [ 12%] 2364s http/scheduler/tests/test_missing_bokeh.py::test_bokeh_version_too_low <- ../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_missing_bokeh.py SKIPPED [ 12%] 2364s http/scheduler/tests/test_missing_bokeh.py::test_bokeh_version_too_high <- ../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_missing_bokeh.py SKIPPED [ 12%] 2364s http/scheduler/tests/test_scheduler_http.py::test_connect <- ../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 12%] 2364s http/scheduler/tests/test_scheduler_http.py::test_worker_404 <- ../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 12%] 2364s http/scheduler/tests/test_scheduler_http.py::test_prefix <- ../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py SKIPPED [ 12%] 2364s http/scheduler/tests/test_scheduler_http.py::test_prometheus <- ../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 12%] 2364s http/scheduler/tests/test_scheduler_http.py::test_metrics_when_prometheus_client_not_installed <- ../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 12%] 2364s http/scheduler/tests/test_scheduler_http.py::test_prometheus_collect_client_connections_totals <- ../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 12%] 2365s http/scheduler/tests/test_scheduler_http.py::test_prometheus_collect_task_states <- ../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 12%] 2365s http/scheduler/tests/test_scheduler_http.py::test_prometheus_collect_task_groups <- ../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 12%] 2365s http/scheduler/tests/test_scheduler_http.py::test_prometheus_collect_task_prefix_counts <- ../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 12%] 2365s http/scheduler/tests/test_scheduler_http.py::test_prometheus_collect_worker_totals <- ../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 12%] 2366s http/scheduler/tests/test_scheduler_http.py::test_prometheus_collect_worker_states <- ../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 13%] 2366s http/scheduler/tests/test_scheduler_http.py::test_health <- ../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 13%] 2366s http/scheduler/tests/test_scheduler_http.py::test_sitemap <- ../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 13%] 2366s http/scheduler/tests/test_scheduler_http.py::test_task_page[1_0] <- ../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 13%] 2366s http/scheduler/tests/test_scheduler_http.py::test_task_page[1_1] <- ../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 13%] 2366s http/scheduler/tests/test_scheduler_http.py::test_task_page[x] <- ../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 13%] 2366s http/scheduler/tests/test_scheduler_http.py::test_task_page[a+b] <- ../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 13%] 2366s http/scheduler/tests/test_scheduler_http.py::test_task_page[a b] <- ../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 13%] 2366s http/scheduler/tests/test_scheduler_http.py::test_task_page[key5] <- ../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 13%] 2366s http/scheduler/tests/test_scheduler_http.py::test_task_page[key6] <- ../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 13%] 2366s http/scheduler/tests/test_scheduler_http.py::test_task_page[key7] <- ../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 13%] 2366s http/scheduler/tests/test_scheduler_http.py::test_task_page[key8] <- ../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 13%] 2367s http/scheduler/tests/test_scheduler_http.py::test_task_page[(] <- ../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 13%] 2367s http/scheduler/tests/test_scheduler_http.py::test_task_page[[] <- ../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 13%] 2367s http/scheduler/tests/test_scheduler_http.py::test_task_page['] <- ../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 13%] 2367s http/scheduler/tests/test_scheduler_http.py::test_task_page["] <- ../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 13%] 2367s http/scheduler/tests/test_scheduler_http.py::test_task_page[123] <- ../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 13%] 2367s http/scheduler/tests/test_scheduler_http.py::test_task_page[key14] <- ../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 13%] 2367s http/scheduler/tests/test_scheduler_http.py::test_task_page[key15] <- ../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 13%] 2367s http/scheduler/tests/test_scheduler_http.py::test_task_page[key16] <- ../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 13%] 2367s http/scheduler/tests/test_scheduler_http.py::test_task_page[key17] <- ../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 13%] 2367s http/scheduler/tests/test_scheduler_http.py::test_task_page[key18] <- ../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 13%] 2367s http/scheduler/tests/test_scheduler_http.py::test_call_stack_page[1_0] <- ../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 13%] 2367s http/scheduler/tests/test_scheduler_http.py::test_call_stack_page[1_1] <- ../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 13%] 2367s http/scheduler/tests/test_scheduler_http.py::test_call_stack_page[x] <- ../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 13%] 2367s http/scheduler/tests/test_scheduler_http.py::test_call_stack_page[a+b] <- ../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 13%] 2367s http/scheduler/tests/test_scheduler_http.py::test_call_stack_page[a b] <- ../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 13%] 2367s http/scheduler/tests/test_scheduler_http.py::test_call_stack_page[key5] <- ../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 13%] 2368s http/scheduler/tests/test_scheduler_http.py::test_call_stack_page[key6] <- ../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 13%] 2368s http/scheduler/tests/test_scheduler_http.py::test_call_stack_page[key7] <- ../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 13%] 2368s http/scheduler/tests/test_scheduler_http.py::test_call_stack_page[key8] <- ../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 13%] 2368s http/scheduler/tests/test_scheduler_http.py::test_call_stack_page[(] <- ../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 13%] 2368s http/scheduler/tests/test_scheduler_http.py::test_call_stack_page[[] <- ../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 13%] 2368s http/scheduler/tests/test_scheduler_http.py::test_call_stack_page['] <- ../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 13%] 2368s http/scheduler/tests/test_scheduler_http.py::test_call_stack_page["] <- ../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 13%] 2368s http/scheduler/tests/test_scheduler_http.py::test_call_stack_page[123] <- ../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 13%] 2368s http/scheduler/tests/test_scheduler_http.py::test_call_stack_page[key14] <- ../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 14%] 2368s http/scheduler/tests/test_scheduler_http.py::test_call_stack_page[key15] <- ../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 14%] 2368s http/scheduler/tests/test_scheduler_http.py::test_call_stack_page[key16] <- ../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 14%] 2368s http/scheduler/tests/test_scheduler_http.py::test_call_stack_page[key17] <- ../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 14%] 2369s http/scheduler/tests/test_scheduler_http.py::test_call_stack_page[key18] <- ../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 14%] 2369s http/scheduler/tests/test_scheduler_http.py::test_allow_websocket_origin <- ../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py SKIPPED [ 14%] 2369s http/scheduler/tests/test_scheduler_http.py::test_eventstream <- ../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 14%] 2369s http/scheduler/tests/test_scheduler_http.py::test_api_disabled_by_default <- ../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 14%] 2369s http/scheduler/tests/test_scheduler_http.py::test_api <- ../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 14%] 2369s http/scheduler/tests/test_scheduler_http.py::test_retire_workers <- ../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 14%] 2369s http/scheduler/tests/test_scheduler_http.py::test_get_workers <- ../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 14%] 2369s http/scheduler/tests/test_scheduler_http.py::test_adaptive_target <- ../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 14%] 2369s http/scheduler/tests/test_scheduler_http.py::test_check_idle <- ../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 14%] 2369s http/scheduler/tests/test_semaphore_http.py::test_prometheus <- ../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_semaphore_http.py PASSED [ 14%] 2369s http/scheduler/tests/test_semaphore_http.py::test_prometheus_without_semaphore_extension <- ../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_semaphore_http.py PASSED [ 14%] 2369s http/scheduler/tests/test_stealing_http.py::test_prometheus <- ../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_stealing_http.py PASSED [ 14%] 2370s http/scheduler/tests/test_stealing_http.py::test_prometheus_collect_count_total_by_cost_multipliers <- ../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_stealing_http.py PASSED [ 14%] 2370s http/scheduler/tests/test_stealing_http.py::test_prometheus_collect_cost_total_by_cost_multipliers <- ../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_stealing_http.py PASSED [ 14%] 2370s http/scheduler/tests/test_stealing_http.py::test_prometheus_without_stealing_extension <- ../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_stealing_http.py PASSED [ 14%] 2370s http/tests/test_core.py::test_scheduler <- ../../../usr/lib/python3/dist-packages/distributed/http/tests/test_core.py PASSED [ 14%] 2370s http/tests/test_routing.py::test_basic <- ../../../usr/lib/python3/dist-packages/distributed/http/tests/test_routing.py PASSED [ 14%] 2370s http/worker/tests/test_worker_http.py::test_prometheus <- ../../../usr/lib/python3/dist-packages/distributed/http/worker/tests/test_worker_http.py PASSED [ 14%] 2370s http/worker/tests/test_worker_http.py::test_metrics_when_prometheus_client_not_installed <- ../../../usr/lib/python3/dist-packages/distributed/http/worker/tests/test_worker_http.py PASSED [ 14%] 2371s http/worker/tests/test_worker_http.py::test_prometheus_collect_task_states <- ../../../usr/lib/python3/dist-packages/distributed/http/worker/tests/test_worker_http.py PASSED [ 14%] 2371s http/worker/tests/test_worker_http.py::test_health <- ../../../usr/lib/python3/dist-packages/distributed/http/worker/tests/test_worker_http.py PASSED [ 14%] 2371s http/worker/tests/test_worker_http.py::test_sitemap <- ../../../usr/lib/python3/dist-packages/distributed/http/worker/tests/test_worker_http.py PASSED [ 14%] 2371s http/worker/tests/test_worker_http.py::test_prometheus_collect_memory_metrics <- ../../../usr/lib/python3/dist-packages/distributed/http/worker/tests/test_worker_http.py PASSED [ 14%] 2371s http/worker/tests/test_worker_http.py::test_prometheus_collect_memory_metrics_spill_disabled <- ../../../usr/lib/python3/dist-packages/distributed/http/worker/tests/test_worker_http.py PASSED [ 14%] 2371s http/worker/tests/test_worker_http.py::test_prometheus_collect_memory_metrics_bogus_sizeof <- ../../../usr/lib/python3/dist-packages/distributed/http/worker/tests/test_worker_http.py SKIPPED [ 14%] 2371s protocol/tests/test_collection.py::test_serialize_collection[y0-dask-tuple] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_collection.py PASSED [ 14%] 2371s protocol/tests/test_collection.py::test_serialize_collection[y0-dask-dict] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_collection.py PASSED [ 14%] 2371s protocol/tests/test_collection.py::test_serialize_collection[y0-dask-list] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_collection.py PASSED [ 14%] 2371s protocol/tests/test_collection.py::test_serialize_collection[y1-pickle-tuple] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_collection.py PASSED [ 14%] 2371s protocol/tests/test_collection.py::test_serialize_collection[y1-pickle-dict] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_collection.py PASSED [ 14%] 2371s protocol/tests/test_collection.py::test_serialize_collection[y1-pickle-list] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_collection.py PASSED [ 14%] 2371s protocol/tests/test_collection.py::test_serialize_collection[None-pickle-tuple] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_collection.py PASSED [ 14%] 2371s protocol/tests/test_collection.py::test_serialize_collection[None-pickle-dict] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_collection.py PASSED [ 15%] 2371s protocol/tests/test_collection.py::test_serialize_collection[None-pickle-list] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_collection.py PASSED [ 15%] 2371s protocol/tests/test_collection.py::test_large_collections_serialize_simply <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_collection.py PASSED [ 15%] 2371s protocol/tests/test_collection.py::test_nested_types <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_collection.py PASSED [ 15%] 2371s protocol/tests/test_collection_cuda.py::test_serialize_cupy[50-cuda-tuple] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_collection_cuda.py SKIPPED [ 15%] 2371s protocol/tests/test_collection_cuda.py::test_serialize_cupy[50-cuda-dict] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_collection_cuda.py SKIPPED [ 15%] 2371s protocol/tests/test_collection_cuda.py::test_serialize_cupy[None-pickle-tuple] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_collection_cuda.py SKIPPED [ 15%] 2371s protocol/tests/test_collection_cuda.py::test_serialize_cupy[None-pickle-dict] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_collection_cuda.py SKIPPED [ 15%] 2371s protocol/tests/test_collection_cuda.py::test_serialize_pandas_pandas[df20-cuda-tuple] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_collection_cuda.py SKIPPED [ 15%] 2371s protocol/tests/test_collection_cuda.py::test_serialize_pandas_pandas[df20-cuda-dict] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_collection_cuda.py SKIPPED [ 15%] 2371s protocol/tests/test_collection_cuda.py::test_serialize_pandas_pandas[None-pickle-tuple] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_collection_cuda.py SKIPPED [ 15%] 2371s protocol/tests/test_collection_cuda.py::test_serialize_pandas_pandas[None-pickle-dict] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_collection_cuda.py SKIPPED [ 15%] 2371s protocol/tests/test_compression.py::test_get_compression_settings <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py PASSED [ 15%] 2371s protocol/tests/test_compression.py::test_auto_compression <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py PASSED [ 15%] 2371s protocol/tests/test_compression.py::test_compression_1 <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py PASSED [ 15%] 2371s protocol/tests/test_compression.py::test_compression_2 <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py PASSED [ 15%] 2371s protocol/tests/test_compression.py::test_compression_3 <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py PASSED [ 15%] 2371s protocol/tests/test_compression.py::test_compression_without_deserialization <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py PASSED [ 15%] 2371s protocol/tests/test_compression.py::test_lz4_decompression_avoids_deep_copy <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py PASSED [ 15%] 2371s protocol/tests/test_compression.py::test_maybe_compress[None-bytes] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py PASSED [ 15%] 2371s protocol/tests/test_compression.py::test_maybe_compress[None-memoryview] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py PASSED [ 15%] 2371s protocol/tests/test_compression.py::test_maybe_compress[zlib-bytes] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py PASSED [ 15%] 2371s protocol/tests/test_compression.py::test_maybe_compress[zlib-memoryview] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py PASSED [ 15%] 2371s protocol/tests/test_compression.py::test_maybe_compress[lz4-bytes] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py PASSED [ 15%] 2371s protocol/tests/test_compression.py::test_maybe_compress[lz4-memoryview] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py PASSED [ 15%] 2371s protocol/tests/test_compression.py::test_maybe_compress[snappy-bytes] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py SKIPPED [ 15%] 2371s protocol/tests/test_compression.py::test_maybe_compress[snappy-memoryview] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py SKIPPED [ 15%] 2371s protocol/tests/test_compression.py::test_maybe_compress[zstd-bytes] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py SKIPPED [ 15%] 2371s protocol/tests/test_compression.py::test_maybe_compress[zstd-memoryview] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py SKIPPED [ 15%] 2371s protocol/tests/test_compression.py::test_maybe_compress_sample[None] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py PASSED [ 15%] 2371s protocol/tests/test_compression.py::test_maybe_compress_sample[zlib] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py PASSED [ 15%] 2371s protocol/tests/test_compression.py::test_maybe_compress_sample[lz4] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py PASSED [ 15%] 2371s protocol/tests/test_compression.py::test_maybe_compress_sample[snappy] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py SKIPPED [ 15%] 2371s protocol/tests/test_compression.py::test_maybe_compress_sample[zstd] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py SKIPPED [ 15%] 2371s protocol/tests/test_compression.py::test_maybe_compress_memoryviews[None] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py PASSED [ 15%] 2372s protocol/tests/test_compression.py::test_maybe_compress_memoryviews[zlib] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py PASSED [ 15%] 2372s protocol/tests/test_compression.py::test_maybe_compress_memoryviews[lz4] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py PASSED [ 16%] 2372s protocol/tests/test_compression.py::test_maybe_compress_memoryviews[snappy] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py SKIPPED [ 16%] 2372s protocol/tests/test_compression.py::test_maybe_compress_memoryviews[zstd] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py SKIPPED [ 16%] 2372s protocol/tests/test_compression.py::test_maybe_compress_auto <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py PASSED [ 16%] 2372s protocol/tests/test_compression.py::test_compression_thread_safety[None-bytes] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py PASSED [ 16%] 2372s protocol/tests/test_compression.py::test_compression_thread_safety[None-memoryview] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py PASSED [ 16%] 2373s protocol/tests/test_compression.py::test_compression_thread_safety[zlib-bytes] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py PASSED [ 16%] 2373s protocol/tests/test_compression.py::test_compression_thread_safety[zlib-memoryview] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py PASSED [ 16%] 2374s protocol/tests/test_compression.py::test_compression_thread_safety[lz4-bytes] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py PASSED [ 16%] 2374s protocol/tests/test_compression.py::test_compression_thread_safety[lz4-memoryview] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py PASSED [ 16%] 2374s protocol/tests/test_compression.py::test_compression_thread_safety[snappy-bytes] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py SKIPPED [ 16%] 2374s protocol/tests/test_compression.py::test_compression_thread_safety[snappy-memoryview] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py SKIPPED [ 16%] 2374s protocol/tests/test_compression.py::test_compression_thread_safety[zstd-bytes] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py SKIPPED [ 16%] 2374s protocol/tests/test_compression.py::test_compression_thread_safety[zstd-memoryview] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py SKIPPED [ 16%] 2375s protocol/tests/test_compression.py::test_large_messages[None] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py PASSED [ 16%] 2381s protocol/tests/test_compression.py::test_large_messages[zlib] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py PASSED [ 16%] 2382s protocol/tests/test_compression.py::test_large_messages[lz4] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py PASSED [ 16%] 2382s protocol/tests/test_compression.py::test_large_messages[snappy] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py SKIPPED [ 16%] 2382s protocol/tests/test_compression.py::test_large_messages[zstd] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py SKIPPED [ 16%] 2382s protocol/tests/test_compression.py::test_loads_without_deserialization_avoids_compression <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py PASSED [ 16%] 2382s protocol/tests/test_compression.py::test_compress_remote_comms <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py PASSED [ 16%] 2383s protocol/tests/test_compression.py::test_disable_compression_on_localhost[None] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py PASSED [ 16%] 2383s protocol/tests/test_compression.py::test_disable_compression_on_localhost[127.0.0.1] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py PASSED [ 16%] 2383s protocol/tests/test_compression.py::test_disable_compression_on_localhost[localhost] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py PASSED [ 16%] 2383s protocol/tests/test_h5py.py::test_serialize_deserialize_file <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_h5py.py PASSED [ 16%] 2383s protocol/tests/test_h5py.py::test_serialize_deserialize_group <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_h5py.py PASSED [ 16%] 2383s protocol/tests/test_h5py.py::test_serialize_deserialize_dataset <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_h5py.py PASSED [ 16%] 2383s protocol/tests/test_h5py.py::test_raise_error_on_serialize_write_permissions <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_h5py.py PASSED [ 16%] 2383s protocol/tests/test_h5py.py::test_h5py_serialize <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_h5py.py PASSED [ 16%] 2383s protocol/tests/test_h5py.py::test_h5py_serialize_2 <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_h5py.py PASSED [ 16%] 2383s protocol/tests/test_highlevelgraph.py::test_combo_of_layer_types <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_highlevelgraph.py PASSED [ 16%] 2383s protocol/tests/test_highlevelgraph.py::test_blockwise <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_highlevelgraph.py PASSED [ 16%] 2384s protocol/tests/test_highlevelgraph.py::test_shuffle <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_highlevelgraph.py PASSED [ 16%] 2384s protocol/tests/test_highlevelgraph.py::test_array_annotations <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_highlevelgraph.py PASSED [ 16%] 2385s protocol/tests/test_highlevelgraph.py::test_dataframe_annotations <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_highlevelgraph.py PASSED [ 16%] 2385s protocol/tests/test_netcdf4.py::test_serialize_deserialize_dataset <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_netcdf4.py PASSED [ 16%] 2385s protocol/tests/test_netcdf4.py::test_serialize_deserialize_variable <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_netcdf4.py PASSED [ 16%] 2385s protocol/tests/test_netcdf4.py::test_serialize_deserialize_group <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_netcdf4.py PASSED [ 17%] 2385s protocol/tests/test_netcdf4.py::test_netcdf4_serialize <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_netcdf4.py PASSED [ 17%] 2385s protocol/tests/test_numpy.py::test_serialize <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 17%] 2385s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x0] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 17%] 2385s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x1] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 17%] 2385s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x2] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 17%] 2385s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x3] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 17%] 2385s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x4] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 17%] 2385s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x5] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 17%] 2385s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x6] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 17%] 2385s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x7] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 17%] 2385s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x8] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 17%] 2385s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x9] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 17%] 2385s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x10] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 17%] 2385s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x11] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 17%] 2385s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x12] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 17%] 2385s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x13] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 17%] 2385s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x14] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 17%] 2385s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x15] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 17%] 2385s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x16] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 17%] 2385s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x17] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 17%] 2385s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x18] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 17%] 2385s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x19] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 17%] 2385s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x20] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 17%] 2385s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x21] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 17%] 2385s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x22] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 17%] 2385s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x23] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 17%] 2385s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x24] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 17%] 2385s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x25] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 17%] 2385s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x26] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 17%] 2385s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x27] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 17%] 2385s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x28] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 17%] 2385s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x29] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 17%] 2385s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x30] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 17%] 2385s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x31] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 17%] 2385s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x32] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 17%] 2385s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x33] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 18%] 2385s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x34] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 18%] 2385s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x35] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 18%] 2385s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x36] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 18%] 2385s protocol/tests/test_numpy.py::test_dumps_numpy_writable[True] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 18%] 2385s protocol/tests/test_numpy.py::test_dumps_numpy_writable[False] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 18%] 2385s protocol/tests/test_numpy.py::test_serialize_numpy_ma_masked_array[x0] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 18%] 2385s protocol/tests/test_numpy.py::test_serialize_numpy_ma_masked_array[x1] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 18%] 2385s protocol/tests/test_numpy.py::test_serialize_numpy_ma_masked_array[x2] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 18%] 2385s protocol/tests/test_numpy.py::test_serialize_numpy_ma_masked_array[x3] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 18%] 2385s protocol/tests/test_numpy.py::test_serialize_numpy_ma_masked_array[x4] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 18%] 2385s protocol/tests/test_numpy.py::test_serialize_numpy_ma_masked_array[x5] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 18%] 2385s protocol/tests/test_numpy.py::test_serialize_numpy_ma_masked <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 18%] 2385s protocol/tests/test_numpy.py::test_dumps_serialize_numpy_custom_dtype <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py SKIPPED [ 18%] 2385s protocol/tests/test_numpy.py::test_memmap <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 18%] 2385s protocol/tests/test_numpy.py::test_dumps_serialize_numpy_large <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 18%] 2385s protocol/tests/test_numpy.py::test_itemsize[f8-8] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 18%] 2385s protocol/tests/test_numpy.py::test_itemsize[i4-4] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 18%] 2385s protocol/tests/test_numpy.py::test_itemsize[c16-16] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 18%] 2385s protocol/tests/test_numpy.py::test_itemsize[b-1] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 18%] 2385s protocol/tests/test_numpy.py::test_itemsize[S3-3] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 18%] 2385s protocol/tests/test_numpy.py::test_itemsize[M8[us]-8] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 18%] 2385s protocol/tests/test_numpy.py::test_itemsize[M8[s]-8] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 18%] 2385s protocol/tests/test_numpy.py::test_itemsize[U3-12] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 18%] 2385s protocol/tests/test_numpy.py::test_itemsize[dt8-12] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 18%] 2385s protocol/tests/test_numpy.py::test_itemsize[dt9-4] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 18%] 2385s protocol/tests/test_numpy.py::test_itemsize[dt10-8] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 18%] 2385s protocol/tests/test_numpy.py::test_itemsize[dt11-88] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 18%] 2385s protocol/tests/test_numpy.py::test_itemsize[dt12-8] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 18%] 2385s protocol/tests/test_numpy.py::test_compress_numpy <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 18%] 2385s protocol/tests/test_numpy.py::test_compress_memoryview <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 18%] 2386s protocol/tests/test_numpy.py::test_dumps_large <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 18%] 2386s protocol/tests/test_numpy.py::test_zero_strided_numpy_array[True-x0] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 18%] 2386s protocol/tests/test_numpy.py::test_zero_strided_numpy_array[True-x1] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 18%] 2386s protocol/tests/test_numpy.py::test_zero_strided_numpy_array[True-x2] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 18%] 2386s protocol/tests/test_numpy.py::test_zero_strided_numpy_array[True-x3] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 18%] 2386s protocol/tests/test_numpy.py::test_zero_strided_numpy_array[False-x0] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 19%] 2386s protocol/tests/test_numpy.py::test_zero_strided_numpy_array[False-x1] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 19%] 2386s protocol/tests/test_numpy.py::test_zero_strided_numpy_array[False-x2] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 19%] 2386s protocol/tests/test_numpy.py::test_zero_strided_numpy_array[False-x3] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 19%] 2386s protocol/tests/test_numpy.py::test_non_zero_strided_array <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 19%] 2386s protocol/tests/test_numpy.py::test_serialize_writeable_array_readonly_base_object <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 19%] 2386s protocol/tests/test_pandas.py::test_dumps_serialize_pandas[df0] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pandas.py PASSED [ 19%] 2386s protocol/tests/test_pandas.py::test_dumps_serialize_pandas[df1] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pandas.py PASSED [ 19%] 2386s protocol/tests/test_pandas.py::test_dumps_serialize_pandas[df2] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pandas.py PASSED [ 19%] 2386s protocol/tests/test_pandas.py::test_dumps_serialize_pandas[df3] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pandas.py PASSED [ 19%] 2386s protocol/tests/test_pandas.py::test_dumps_serialize_pandas[df4] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pandas.py PASSED [ 19%] 2386s protocol/tests/test_pandas.py::test_dumps_serialize_pandas[df5] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pandas.py PASSED [ 19%] 2386s protocol/tests/test_pandas.py::test_dumps_serialize_pandas[df6] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pandas.py PASSED [ 19%] 2386s protocol/tests/test_pandas.py::test_dumps_serialize_pandas[df7] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pandas.py PASSED [ 19%] 2386s protocol/tests/test_pandas.py::test_dumps_serialize_pandas[df8] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pandas.py PASSED [ 19%] 2386s protocol/tests/test_pandas.py::test_dumps_serialize_pandas[df9] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pandas.py PASSED [ 19%] 2386s protocol/tests/test_pandas.py::test_dumps_serialize_pandas[df10] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pandas.py PASSED [ 19%] 2386s protocol/tests/test_pandas.py::test_dumps_serialize_pandas[df11] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pandas.py PASSED [ 19%] 2386s protocol/tests/test_pandas.py::test_dumps_serialize_pandas[df12] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pandas.py PASSED [ 19%] 2386s protocol/tests/test_pandas.py::test_dumps_serialize_pandas[df13] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pandas.py PASSED [ 19%] 2386s protocol/tests/test_pandas.py::test_dumps_serialize_pandas[df14] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pandas.py PASSED [ 19%] 2386s protocol/tests/test_pandas.py::test_dumps_serialize_pandas[df15] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pandas.py PASSED [ 19%] 2386s protocol/tests/test_pandas.py::test_dumps_serialize_pandas[df16] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pandas.py PASSED [ 19%] 2386s protocol/tests/test_pandas.py::test_dumps_serialize_pandas[df17] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pandas.py PASSED [ 19%] 2386s protocol/tests/test_pandas.py::test_dumps_serialize_pandas[df18] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pandas.py PASSED [ 19%] 2386s protocol/tests/test_pandas.py::test_dumps_serialize_pandas[df19] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pandas.py PASSED [ 19%] 2386s protocol/tests/test_pandas.py::test_dumps_serialize_pandas[df20] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pandas.py PASSED [ 19%] 2386s protocol/tests/test_pandas.py::test_dumps_serialize_pandas[df21] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pandas.py PASSED [ 19%] 2386s protocol/tests/test_pandas.py::test_dumps_serialize_pandas[df22] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pandas.py PASSED [ 19%] 2386s protocol/tests/test_pandas.py::test_dumps_serialize_pandas[df23] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pandas.py PASSED [ 19%] 2386s protocol/tests/test_pandas.py::test_dumps_serialize_pandas[df24] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pandas.py PASSED [ 19%] 2386s protocol/tests/test_pandas.py::test_dumps_serialize_pandas[df25] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pandas.py PASSED [ 19%] 2386s protocol/tests/test_pandas.py::test_dumps_pandas_writable <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pandas.py PASSED [ 19%] 2386s protocol/tests/test_pickle.py::test_pickle_data[4] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pickle.py PASSED [ 19%] 2386s protocol/tests/test_pickle.py::test_pickle_data[5] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pickle.py PASSED [ 19%] 2386s protocol/tests/test_pickle.py::test_pickle_out_of_band[4] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pickle.py PASSED [ 19%] 2386s protocol/tests/test_pickle.py::test_pickle_out_of_band[5] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pickle.py PASSED [ 20%] 2386s protocol/tests/test_pickle.py::test_pickle_empty[4] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pickle.py PASSED [ 20%] 2386s protocol/tests/test_pickle.py::test_pickle_empty[5] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pickle.py PASSED [ 20%] 2386s protocol/tests/test_pickle.py::test_pickle_numpy[4] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pickle.py PASSED [ 20%] 2386s protocol/tests/test_pickle.py::test_pickle_numpy[5] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pickle.py PASSED [ 20%] 2386s protocol/tests/test_pickle.py::test_pickle_functions[4] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pickle.py PASSED [ 20%] 2386s protocol/tests/test_pickle.py::test_pickle_functions[5] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pickle.py PASSED [ 20%] 2386s protocol/tests/test_pickle.py::test_pickle_by_value_when_registered <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pickle.py PASSED [ 20%] 2386s protocol/tests/test_pickle.py::test_allow_pickle_if_registered_in_dask_serialize <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pickle.py PASSED [ 20%] 2386s protocol/tests/test_pickle.py::test_nopickle_nested <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pickle.py PASSED [ 20%] 2388s protocol/tests/test_pickle.py::test_pickle_functions_in_main <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pickle.py PASSED [ 20%] 2388s protocol/tests/test_pickle.py::test_pickle_zero_copy_read_only_flag[dask] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pickle.py PASSED [ 20%] 2388s protocol/tests/test_pickle.py::test_pickle_zero_copy_read_only_flag[pickle] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pickle.py PASSED [ 20%] 2388s protocol/tests/test_protocol.py::test_protocol <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol.py PASSED [ 20%] 2388s protocol/tests/test_protocol.py::test_small <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol.py PASSED [ 20%] 2388s protocol/tests/test_protocol.py::test_small_and_big <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol.py PASSED [ 20%] 2388s protocol/tests/test_protocol.py::test_large_bytes[bytes] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol.py PASSED [ 20%] 2388s protocol/tests/test_protocol.py::test_large_bytes[memoryview] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol.py PASSED [ 20%] 2388s protocol/tests/test_protocol.py::test_large_messages_map <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol.py PASSED [ 20%] 2388s protocol/tests/test_protocol.py::test_loads_deserialize_False <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol.py PASSED [ 20%] 2388s protocol/tests/test_protocol.py::test_dumps_loads_Serialize <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol.py PASSED [ 20%] 2388s protocol/tests/test_protocol.py::test_dumps_loads_Serialized <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol.py PASSED [ 20%] 2388s protocol/tests/test_protocol.py::test_preserve_header[serializers0] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol.py PASSED [ 20%] 2388s protocol/tests/test_protocol.py::test_preserve_header[serializers1] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol.py PASSED [ 20%] 2388s protocol/tests/test_protocol.py::test_sizeof_serialize[Serialize-Serialized0] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol.py PASSED [ 20%] 2388s protocol/tests/test_protocol.py::test_sizeof_serialize[Serialize-Serialized1] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol.py PASSED [ 20%] 2388s protocol/tests/test_protocol.py::test_sizeof_serialize[ToPickle-Pickled] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol.py PASSED [ 20%] 2388s protocol/tests/test_protocol.py::test_fallback_to_pickle <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol.py PASSED [ 20%] 2394s protocol/tests/test_protocol.py::test_large_payload[bytes] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol.py PASSED [ 20%] 2401s protocol/tests/test_protocol.py::test_large_payload[str] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol.py PASSED [ 20%] 2408s protocol/tests/test_protocol.py::test_large_payload[ext] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol.py PASSED [ 20%] 2408s protocol/tests/test_protocol_utils.py::test_pack_frames <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol_utils.py PASSED [ 20%] 2408s protocol/tests/test_protocol_utils.py::test_unpack_frames_remainder[456] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol_utils.py PASSED [ 20%] 2408s protocol/tests/test_protocol_utils.py::test_unpack_frames_remainder[] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol_utils.py PASSED [ 20%] 2408s protocol/tests/test_protocol_utils.py::test_unpack_frames_partial <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol_utils.py PASSED [ 20%] 2408s protocol/tests/test_protocol_utils.py::TestMergeMemroyviews::test_empty <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol_utils.py PASSED [ 20%] 2408s protocol/tests/test_protocol_utils.py::TestMergeMemroyviews::test_one <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol_utils.py PASSED [ 20%] 2408s protocol/tests/test_protocol_utils.py::TestMergeMemroyviews::test_parts[slices0] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol_utils.py PASSED [ 21%] 2408s protocol/tests/test_protocol_utils.py::TestMergeMemroyviews::test_parts[slices1] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol_utils.py PASSED [ 21%] 2408s protocol/tests/test_protocol_utils.py::TestMergeMemroyviews::test_parts[slices2] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol_utils.py PASSED [ 21%] 2408s protocol/tests/test_protocol_utils.py::TestMergeMemroyviews::test_parts[slices3] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol_utils.py PASSED [ 21%] 2408s protocol/tests/test_protocol_utils.py::TestMergeMemroyviews::test_parts[slices4] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol_utils.py PASSED [ 21%] 2408s protocol/tests/test_protocol_utils.py::TestMergeMemroyviews::test_parts[slices5] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol_utils.py PASSED [ 21%] 2408s protocol/tests/test_protocol_utils.py::TestMergeMemroyviews::test_parts[slices6] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol_utils.py PASSED [ 21%] 2408s protocol/tests/test_protocol_utils.py::TestMergeMemroyviews::test_parts[slices7] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol_utils.py PASSED [ 21%] 2408s protocol/tests/test_protocol_utils.py::TestMergeMemroyviews::test_parts[slices8] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol_utils.py PASSED [ 21%] 2408s protocol/tests/test_protocol_utils.py::TestMergeMemroyviews::test_parts[slices9] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol_utils.py PASSED [ 21%] 2408s protocol/tests/test_protocol_utils.py::TestMergeMemroyviews::test_readonly_buffer <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol_utils.py PASSED [ 21%] 2408s protocol/tests/test_protocol_utils.py::TestMergeMemroyviews::test_catch_non_memoryview <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol_utils.py PASSED [ 21%] 2408s protocol/tests/test_protocol_utils.py::TestMergeMemroyviews::test_catch_gaps[slices0] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol_utils.py PASSED [ 21%] 2408s protocol/tests/test_protocol_utils.py::TestMergeMemroyviews::test_catch_gaps[slices1] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol_utils.py PASSED [ 21%] 2408s protocol/tests/test_protocol_utils.py::TestMergeMemroyviews::test_catch_gaps[slices2] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol_utils.py PASSED [ 21%] 2408s protocol/tests/test_protocol_utils.py::TestMergeMemroyviews::test_catch_different_buffer <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol_utils.py PASSED [ 21%] 2408s protocol/tests/test_protocol_utils.py::TestMergeMemroyviews::test_catch_different_non_contiguous <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol_utils.py PASSED [ 21%] 2408s protocol/tests/test_protocol_utils.py::TestMergeMemroyviews::test_catch_multidimensional <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol_utils.py PASSED [ 21%] 2408s protocol/tests/test_protocol_utils.py::TestMergeMemroyviews::test_catch_different_formats <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol_utils.py PASSED [ 21%] 2408s protocol/tests/test_scipy.py::test_serialize_scipy_sparse[dtype0-bsr_matrix] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_scipy.py PASSED [ 21%] 2408s protocol/tests/test_scipy.py::test_serialize_scipy_sparse[dtype0-coo_matrix] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_scipy.py PASSED [ 21%] 2408s protocol/tests/test_scipy.py::test_serialize_scipy_sparse[dtype0-csc_matrix] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_scipy.py PASSED [ 21%] 2408s protocol/tests/test_scipy.py::test_serialize_scipy_sparse[dtype0-csr_matrix] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_scipy.py PASSED [ 21%] 2408s protocol/tests/test_scipy.py::test_serialize_scipy_sparse[dtype0-dia_matrix] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_scipy.py PASSED [ 21%] 2408s protocol/tests/test_scipy.py::test_serialize_scipy_sparse[dtype0-dok_matrix] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_scipy.py PASSED [ 21%] 2408s protocol/tests/test_scipy.py::test_serialize_scipy_sparse[dtype0-lil_matrix] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_scipy.py PASSED [ 21%] 2408s protocol/tests/test_scipy.py::test_serialize_scipy_sparse[dtype1-bsr_matrix] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_scipy.py PASSED [ 21%] 2408s protocol/tests/test_scipy.py::test_serialize_scipy_sparse[dtype1-coo_matrix] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_scipy.py PASSED [ 21%] 2408s protocol/tests/test_scipy.py::test_serialize_scipy_sparse[dtype1-csc_matrix] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_scipy.py PASSED [ 21%] 2408s protocol/tests/test_scipy.py::test_serialize_scipy_sparse[dtype1-csr_matrix] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_scipy.py PASSED [ 21%] 2408s protocol/tests/test_scipy.py::test_serialize_scipy_sparse[dtype1-dia_matrix] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_scipy.py PASSED [ 21%] 2408s protocol/tests/test_scipy.py::test_serialize_scipy_sparse[dtype1-dok_matrix] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_scipy.py PASSED [ 21%] 2408s protocol/tests/test_scipy.py::test_serialize_scipy_sparse[dtype1-lil_matrix] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_scipy.py PASSED [ 21%] 2408s protocol/tests/test_scipy.py::test_serialize_scipy_sparse[dtype2-bsr_matrix] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_scipy.py PASSED [ 21%] 2408s protocol/tests/test_scipy.py::test_serialize_scipy_sparse[dtype2-coo_matrix] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_scipy.py PASSED [ 21%] 2408s protocol/tests/test_scipy.py::test_serialize_scipy_sparse[dtype2-csc_matrix] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_scipy.py PASSED [ 21%] 2408s protocol/tests/test_scipy.py::test_serialize_scipy_sparse[dtype2-csr_matrix] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_scipy.py PASSED [ 22%] 2408s protocol/tests/test_scipy.py::test_serialize_scipy_sparse[dtype2-dia_matrix] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_scipy.py PASSED [ 22%] 2408s protocol/tests/test_scipy.py::test_serialize_scipy_sparse[dtype2-dok_matrix] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_scipy.py PASSED [ 22%] 2408s protocol/tests/test_scipy.py::test_serialize_scipy_sparse[dtype2-lil_matrix] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_scipy.py PASSED [ 22%] 2408s protocol/tests/test_scipy.py::test_serialize_scipy_sparse[dtype3-bsr_matrix] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_scipy.py PASSED [ 22%] 2408s protocol/tests/test_scipy.py::test_serialize_scipy_sparse[dtype3-coo_matrix] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_scipy.py PASSED [ 22%] 2408s protocol/tests/test_scipy.py::test_serialize_scipy_sparse[dtype3-csc_matrix] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_scipy.py PASSED [ 22%] 2408s protocol/tests/test_scipy.py::test_serialize_scipy_sparse[dtype3-csr_matrix] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_scipy.py PASSED [ 22%] 2408s protocol/tests/test_scipy.py::test_serialize_scipy_sparse[dtype3-dia_matrix] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_scipy.py PASSED [ 22%] 2408s protocol/tests/test_scipy.py::test_serialize_scipy_sparse[dtype3-dok_matrix] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_scipy.py PASSED [ 22%] 2408s protocol/tests/test_scipy.py::test_serialize_scipy_sparse[dtype3-lil_matrix] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_scipy.py PASSED [ 22%] 2408s protocol/tests/test_serialize.py::test_dumps_serialize <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 22%] 2408s protocol/tests/test_serialize.py::test_serialize_bytestrings <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 22%] 2408s protocol/tests/test_serialize.py::test_serialize_empty_array <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 22%] 2408s protocol/tests/test_serialize.py::test_serialize_arrays[b] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 22%] 2408s protocol/tests/test_serialize.py::test_serialize_arrays[B] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 22%] 2408s protocol/tests/test_serialize.py::test_serialize_arrays[h] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 22%] 2408s protocol/tests/test_serialize.py::test_serialize_arrays[H] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 22%] 2408s protocol/tests/test_serialize.py::test_serialize_arrays[i] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 22%] 2408s protocol/tests/test_serialize.py::test_serialize_arrays[I] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 22%] 2408s protocol/tests/test_serialize.py::test_serialize_arrays[l] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 22%] 2408s protocol/tests/test_serialize.py::test_serialize_arrays[L] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 22%] 2408s protocol/tests/test_serialize.py::test_serialize_arrays[q] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 22%] 2408s protocol/tests/test_serialize.py::test_serialize_arrays[Q] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 22%] 2408s protocol/tests/test_serialize.py::test_serialize_arrays[f] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 22%] 2408s protocol/tests/test_serialize.py::test_serialize_arrays[d] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 22%] 2408s protocol/tests/test_serialize.py::test_Serialize <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 22%] 2408s protocol/tests/test_serialize.py::test_Serialized <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 22%] 2408s protocol/tests/test_serialize.py::test_nested_deserialize <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 22%] 2408s protocol/tests/test_serialize.py::test_serialize_iterate_collection <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 22%] 2408s protocol/tests/test_serialize.py::test_object_in_graph <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 22%] 2408s protocol/tests/test_serialize.py::test_scatter <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 22%] 2408s protocol/tests/test_serialize.py::test_inter_worker_comms <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 22%] 2408s protocol/tests/test_serialize.py::test_empty <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 22%] 2408s protocol/tests/test_serialize.py::test_empty_loads <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 22%] 2408s protocol/tests/test_serialize.py::test_empty_loads_deep <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 22%] 2409s protocol/tests/test_serialize.py::test_serialize_bytes[kwargs0] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 23%] 2411s protocol/tests/test_serialize.py::test_serialize_bytes[kwargs1] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 23%] 2411s protocol/tests/test_serialize.py::test_serialize_bytes_numpy[kwargs0] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 23%] 2411s protocol/tests/test_serialize.py::test_serialize_bytes_numpy[kwargs1] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 23%] 2411s protocol/tests/test_serialize.py::test_deserialize_bytes_zero_copy_read_only <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 23%] 2411s protocol/tests/test_serialize.py::test_deserialize_bytes_zero_copy_writeable <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 23%] 2411s protocol/tests/test_serialize.py::test_serialize_list_compress <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 23%] 2411s protocol/tests/test_serialize.py::test_malicious_exception <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 23%] 2411s protocol/tests/test_serialize.py::test_errors <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 23%] 2411s protocol/tests/test_serialize.py::test_err_on_bad_deserializer <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 23%] 2412s protocol/tests/test_serialize.py::test_context_specific_serialization <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 23%] 2412s protocol/tests/test_serialize.py::test_context_specific_serialization_class <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 23%] 2412s protocol/tests/test_serialize.py::test_serialize_raises <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 23%] 2412s protocol/tests/test_serialize.py::test_different_compression_families <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 23%] 2412s protocol/tests/test_serialize.py::test_frame_split <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 23%] 2412s protocol/tests/test_serialize.py::test_check_dask_serializable[data0-False] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 23%] 2412s protocol/tests/test_serialize.py::test_check_dask_serializable[data1-False] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 23%] 2412s protocol/tests/test_serialize.py::test_check_dask_serializable[data2-False] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 23%] 2412s protocol/tests/test_serialize.py::test_check_dask_serializable[data3-False] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 23%] 2412s protocol/tests/test_serialize.py::test_check_dask_serializable[data4-False] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 23%] 2412s protocol/tests/test_serialize.py::test_check_dask_serializable[data5-True] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 23%] 2412s protocol/tests/test_serialize.py::test_check_dask_serializable[data6-True] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 23%] 2412s protocol/tests/test_serialize.py::test_check_dask_serializable[data7-True] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py XFAIL [ 23%] 2412s protocol/tests/test_serialize.py::test_check_dask_serializable[data8-True] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 23%] 2412s protocol/tests/test_serialize.py::test_check_dask_serializable[data9-True] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 23%] 2412s protocol/tests/test_serialize.py::test_check_dask_serializable[data10-True] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 23%] 2412s protocol/tests/test_serialize.py::test_check_dask_serializable[data11-True] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 23%] 2412s protocol/tests/test_serialize.py::test_check_dask_serializable[data12-True] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 23%] 2412s protocol/tests/test_serialize.py::test_serialize_lists[serializers0] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 23%] 2412s protocol/tests/test_serialize.py::test_serialize_lists[serializers1] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 23%] 2412s protocol/tests/test_serialize.py::test_serialize_lists[serializers2] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 23%] 2412s protocol/tests/test_serialize.py::test_serialize_lists[serializers3] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 23%] 2412s protocol/tests/test_serialize.py::test_deser_memoryview[data_in0] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 23%] 2412s protocol/tests/test_serialize.py::test_deser_memoryview[data_in1] <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 23%] 2412s protocol/tests/test_serialize.py::test_ser_memoryview_object <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 23%] 2412s protocol/tests/test_serialize.py::test_ser_empty_1d_memoryview <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 23%] 2412s protocol/tests/test_serialize.py::test_ser_empty_nd_memoryview <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 24%] 2414s protocol/tests/test_serialize.py::test_large_pickled_object <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 24%] 2414s protocol/tests/test_serialize.py::test__is_msgpack_serializable <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 24%] 2414s protocol/tests/test_to_pickle.py::test_ToPickle <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_to_pickle.py PASSED [ 24%] 2414s protocol/tests/test_utils.py::test_host_array <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_utils.py PASSED [ 24%] 2414s protocol/tests/test_utils.py::test_host_array_from_buffers <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_utils.py PASSED [ 24%] 2414s protocol/tests/test_utils.py::test_host_array_from_buffers_numpy <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_utils.py PASSED [ 24%] 2414s protocol/tests/test_utils_test.py::test_get_host_array <- ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_utils_test.py PASSED [ 24%] 2414s shuffle/tests/test_buffer.py::test_memory_limit[big_payloads0] <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_buffer.py PASSED [ 24%] 2415s shuffle/tests/test_buffer.py::test_memory_limit[big_payloads1] <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_buffer.py PASSED [ 24%] 2415s shuffle/tests/test_buffer.py::test_memory_limit[big_payloads2] <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_buffer.py PASSED [ 24%] 2416s shuffle/tests/test_buffer.py::test_memory_limit[big_payloads3] <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_buffer.py PASSED [ 24%] 2416s shuffle/tests/test_buffer.py::test_memory_limit_blocked_exception <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_buffer.py PASSED [ 24%] 2416s shuffle/tests/test_comm_buffer.py::test_basic <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_comm_buffer.py PASSED [ 24%] 2416s shuffle/tests/test_comm_buffer.py::test_exceptions <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_comm_buffer.py PASSED [ 24%] 2416s shuffle/tests/test_comm_buffer.py::test_slow_send <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_comm_buffer.py PASSED [ 24%] 2416s shuffle/tests/test_comm_buffer.py::test_concurrent_puts <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_comm_buffer.py PASSED [ 24%] 2416s shuffle/tests/test_comm_buffer.py::test_concurrent_puts_error <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_comm_buffer.py PASSED [ 24%] 2416s shuffle/tests/test_core.py::test_mean_shard_size <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_core.py PASSED [ 24%] 2416s shuffle/tests/test_core.py::test_mean_shard_size_numpy <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_core.py PASSED [ 24%] 2416s shuffle/tests/test_disk_buffer.py::test_basic <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_disk_buffer.py PASSED [ 24%] 2416s shuffle/tests/test_disk_buffer.py::test_read_before_flush <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_disk_buffer.py PASSED [ 24%] 2416s shuffle/tests/test_disk_buffer.py::test_many[2] <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_disk_buffer.py PASSED [ 24%] 2416s shuffle/tests/test_disk_buffer.py::test_many[100] <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_disk_buffer.py PASSED [ 24%] 2416s shuffle/tests/test_disk_buffer.py::test_many[1000] <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_disk_buffer.py PASSED [ 24%] 2417s shuffle/tests/test_disk_buffer.py::test_exceptions <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_disk_buffer.py PASSED [ 24%] 2417s shuffle/tests/test_disk_buffer.py::test_high_pressure_flush_with_exception <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_disk_buffer.py PASSED [ 24%] 2417s shuffle/tests/test_limiter.py::test_limiter_basic <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_limiter.py PASSED [ 24%] 2417s shuffle/tests/test_limiter.py::test_unlimited_limiter <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_limiter.py PASSED [ 24%] 2417s shuffle/tests/test_limiter.py::test_limiter_concurrent_decrease_releases_waiter <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_limiter.py PASSED [ 24%] 2417s shuffle/tests/test_limiter.py::test_limiter_statistics <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_limiter.py PASSED [ 24%] 2417s shuffle/tests/test_limiter.py::test_limiter_no_limit_no_statistics <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_limiter.py PASSED [ 24%] 2417s shuffle/tests/test_memory_buffer.py::test_basic <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_memory_buffer.py PASSED [ 24%] 2417s shuffle/tests/test_memory_buffer.py::test_read_before_flush <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_memory_buffer.py PASSED [ 24%] 2417s shuffle/tests/test_memory_buffer.py::test_many[2] <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_memory_buffer.py PASSED [ 24%] 2417s shuffle/tests/test_memory_buffer.py::test_many[100] <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_memory_buffer.py PASSED [ 24%] 2417s shuffle/tests/test_memory_buffer.py::test_many[1000] <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_memory_buffer.py PASSED [ 24%] 2417s shuffle/tests/test_pickle.py::test_pickle <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_pickle.py PASSED [ 25%] 2417s shuffle/tests/test_pickle.py::test_pickle_numpy <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_pickle.py PASSED [ 25%] 2417s shuffle/tests/test_pickle.py::test_pickle_zero_copy <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_pickle.py PASSED [ 25%] 2417s shuffle/tests/test_read_write_lock.py::test_basic <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_read_write_lock.py PASSED [ 25%] 2417s shuffle/tests/test_read_write_lock.py::test_lock_timeout <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_read_write_lock.py PASSED [ 25%] 2417s shuffle/tests/test_read_write_lock.py::test_concurrent_reads_are_allowed <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_read_write_lock.py PASSED [ 25%] 2418s shuffle/tests/test_read_write_lock.py::test_read_blocks_write <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_read_write_lock.py PASSED [ 25%] 2418s shuffle/tests/test_read_write_lock.py::test_write_blocks_read <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_read_write_lock.py PASSED [ 25%] 2418s shuffle/tests/test_read_write_lock.py::test_write_blocks_write <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_read_write_lock.py PASSED [ 25%] 2418s shuffle/tests/test_read_write_lock.py::test_write_preferred_over_read <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_read_write_lock.py PASSED [ 25%] 2418s shuffle/tests/test_rechunk.py::test_lowlevel_rechunk[True-True-1] <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 25%] 2418s shuffle/tests/test_rechunk.py::test_lowlevel_rechunk[True-True-10] <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 25%] 2418s shuffle/tests/test_rechunk.py::test_lowlevel_rechunk[True-False-1] <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 25%] 2418s shuffle/tests/test_rechunk.py::test_lowlevel_rechunk[True-False-10] <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 25%] 2418s shuffle/tests/test_rechunk.py::test_lowlevel_rechunk[False-True-1] <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 25%] 2418s shuffle/tests/test_rechunk.py::test_lowlevel_rechunk[False-True-10] <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 25%] 2418s shuffle/tests/test_rechunk.py::test_lowlevel_rechunk[False-False-1] <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 25%] 2418s shuffle/tests/test_rechunk.py::test_lowlevel_rechunk[False-False-10] <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 25%] 2418s shuffle/tests/test_rechunk.py::test_rechunk_configuration[tasks-tasks] <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 25%] 2419s shuffle/tests/test_rechunk.py::test_rechunk_configuration[tasks-p2p] <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 25%] 2419s shuffle/tests/test_rechunk.py::test_rechunk_configuration[tasks-None] <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 25%] 2419s shuffle/tests/test_rechunk.py::test_rechunk_configuration[p2p-tasks] <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 25%] 2419s shuffle/tests/test_rechunk.py::test_rechunk_configuration[p2p-p2p] <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 25%] 2419s shuffle/tests/test_rechunk.py::test_rechunk_configuration[p2p-None] <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 25%] 2419s shuffle/tests/test_rechunk.py::test_rechunk_configuration[None-tasks] <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 25%] 2420s shuffle/tests/test_rechunk.py::test_rechunk_configuration[None-p2p] <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 25%] 2420s shuffle/tests/test_rechunk.py::test_rechunk_configuration[None-None] <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 25%] 2421s shuffle/tests/test_rechunk.py::test_rechunk_heuristic[new0-p2p] <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 25%] 2422s shuffle/tests/test_rechunk.py::test_rechunk_heuristic[new1-tasks] <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 25%] 2423s shuffle/tests/test_rechunk.py::test_rechunk_heuristic[new2-tasks] <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 25%] 2424s shuffle/tests/test_rechunk.py::test_rechunk_heuristic[new3-p2p] <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 25%] 2424s shuffle/tests/test_rechunk.py::test_cull_p2p_rechunk_independent_partitions <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 25%] 2424s shuffle/tests/test_rechunk.py::test_cull_p2p_rechunking_single_chunk <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 25%] 2424s shuffle/tests/test_rechunk.py::test_cull_p2p_rechunk_overlapping_partitions <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 25%] 2425s shuffle/tests/test_rechunk.py::test_rechunk_2d[True] <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 25%] 2425s shuffle/tests/test_rechunk.py::test_rechunk_2d[False] <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 25%] 2425s shuffle/tests/test_rechunk.py::test_rechunk_4d[True] <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 26%] 2425s shuffle/tests/test_rechunk.py::test_rechunk_4d[False] <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 26%] 2425s shuffle/tests/test_rechunk.py::test_rechunk_expand <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 26%] 2425s shuffle/tests/test_rechunk.py::test_rechunk_expand2 <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 26%] 2429s shuffle/tests/test_rechunk.py::test_rechunk_method <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 26%] 2429s shuffle/tests/test_rechunk.py::test_rechunk_blockshape <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 26%] 2429s shuffle/tests/test_rechunk.py::test_dtype <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 26%] 2429s shuffle/tests/test_rechunk.py::test_rechunk_with_dict <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 26%] 2429s shuffle/tests/test_rechunk.py::test_rechunk_with_empty_input <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 26%] 2429s shuffle/tests/test_rechunk.py::test_rechunk_with_null_dimensions <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 26%] 2429s shuffle/tests/test_rechunk.py::test_rechunk_with_integer <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 26%] 2429s shuffle/tests/test_rechunk.py::test_rechunk_0d <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 26%] 2430s shuffle/tests/test_rechunk.py::test_rechunk_empty_array[arr0] <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 26%] 2430s shuffle/tests/test_rechunk.py::test_rechunk_empty_array[arr1] <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 26%] 2430s shuffle/tests/test_rechunk.py::test_rechunk_empty_array[arr2] <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 26%] 2430s shuffle/tests/test_rechunk.py::test_rechunk_empty <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 26%] 2430s shuffle/tests/test_rechunk.py::test_rechunk_zero_dim_array <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 26%] 2430s shuffle/tests/test_rechunk.py::test_rechunk_zero_dim_array_II <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 26%] 2430s shuffle/tests/test_rechunk.py::test_rechunk_same <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 26%] 2430s shuffle/tests/test_rechunk.py::test_rechunk_same_fully_unknown <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 26%] 2430s shuffle/tests/test_rechunk.py::test_rechunk_same_fully_unknown_floats <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 26%] 2430s shuffle/tests/test_rechunk.py::test_rechunk_same_partially_unknown <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 26%] 2430s shuffle/tests/test_rechunk.py::test_rechunk_with_zero_placeholders <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 26%] 2431s shuffle/tests/test_rechunk.py::test_rechunk_minus_one <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 26%] 2431s shuffle/tests/test_rechunk.py::test_rechunk_warning <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 26%] 2431s shuffle/tests/test_rechunk.py::test_rechunk_unknown_from_pandas <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 26%] 2431s shuffle/tests/test_rechunk.py::test_rechunk_unknown_from_array <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 26%] 2431s shuffle/tests/test_rechunk.py::test_rechunk_with_fully_unknown_dimension[x0-chunks0] <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 26%] 2431s shuffle/tests/test_rechunk.py::test_rechunk_with_fully_unknown_dimension[x1-chunks1] <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 26%] 2432s shuffle/tests/test_rechunk.py::test_rechunk_with_fully_unknown_dimension[x2-chunks2] <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 26%] 2433s shuffle/tests/test_rechunk.py::test_rechunk_with_fully_unknown_dimension[x3-chunks3] <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 26%] 2434s shuffle/tests/test_rechunk.py::test_rechunk_with_fully_unknown_dimension[x4-chunks4] <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 26%] 2435s shuffle/tests/test_rechunk.py::test_rechunk_with_fully_unknown_dimension[x5-chunks5] <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 26%] 2436s shuffle/tests/test_rechunk.py::test_rechunk_with_fully_unknown_dimension[x6-chunks6] <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 26%] 2436s shuffle/tests/test_rechunk.py::test_rechunk_with_fully_unknown_dimension[x7-chunks7] <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 26%] 2436s shuffle/tests/test_rechunk.py::test_rechunk_with_fully_unknown_dimension[x8-chunks8] <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 26%] 2436s shuffle/tests/test_rechunk.py::test_rechunk_with_fully_unknown_dimension[x9-chunks9] <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 27%] 2436s shuffle/tests/test_rechunk.py::test_rechunk_with_fully_unknown_dimension[x10-chunks10] <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 27%] 2437s shuffle/tests/test_rechunk.py::test_rechunk_with_fully_unknown_dimension[x11-chunks11] <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 27%] 2437s shuffle/tests/test_rechunk.py::test_rechunk_with_partially_unknown_dimension[x0-chunks0] <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 27%] 2437s shuffle/tests/test_rechunk.py::test_rechunk_with_partially_unknown_dimension[x1-chunks1] <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 27%] 2438s shuffle/tests/test_rechunk.py::test_rechunk_with_partially_unknown_dimension[x2-chunks2] <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 27%] 2441s shuffle/tests/test_rechunk.py::test_rechunk_with_partially_unknown_dimension[x3-chunks3] <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 27%] 2443s shuffle/tests/test_rechunk.py::test_rechunk_with_partially_unknown_dimension[x4-chunks4] <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 27%] 2446s shuffle/tests/test_rechunk.py::test_rechunk_with_partially_unknown_dimension[x5-chunks5] <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 27%] 2446s shuffle/tests/test_rechunk.py::test_rechunk_with_partially_unknown_dimension[x6-chunks6] <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 27%] 2446s shuffle/tests/test_rechunk.py::test_rechunk_with_partially_unknown_dimension[x7-chunks7] <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 27%] 2446s shuffle/tests/test_rechunk.py::test_rechunk_with_partially_unknown_dimension[x8-chunks8] <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 27%] 2447s shuffle/tests/test_rechunk.py::test_rechunk_with_partially_unknown_dimension[x9-chunks9] <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 27%] 2447s shuffle/tests/test_rechunk.py::test_rechunk_with_partially_unknown_dimension[x10-chunks10] <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 27%] 2447s shuffle/tests/test_rechunk.py::test_rechunk_with_partially_unknown_dimension[x11-chunks11] <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 27%] 2448s shuffle/tests/test_rechunk.py::test_rechunk_with_fully_unknown_dimension_explicit[new_chunks0] <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 27%] 2448s shuffle/tests/test_rechunk.py::test_rechunk_with_fully_unknown_dimension_explicit[new_chunks1] <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 27%] 2448s shuffle/tests/test_rechunk.py::test_rechunk_with_fully_unknown_dimension_explicit[new_chunks2] <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 27%] 2448s shuffle/tests/test_rechunk.py::test_rechunk_unknown_raises <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 27%] 2448s shuffle/tests/test_rechunk.py::test_rechunk_zero_dim <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 27%] 2449s shuffle/tests/test_rechunk.py::test_rechunk_empty_chunks <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 27%] 2449s shuffle/tests/test_rechunk.py::test_rechunk_avoid_needless_chunking <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 27%] 2449s shuffle/tests/test_rechunk.py::test_rechunk_auto_1d[100-1-10-expected0] <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 27%] 2449s shuffle/tests/test_rechunk.py::test_rechunk_auto_1d[100-50-10-expected1] <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 27%] 2449s shuffle/tests/test_rechunk.py::test_rechunk_auto_1d[100-100-10-expected2] <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 27%] 2449s shuffle/tests/test_rechunk.py::test_rechunk_auto_1d[20-7-10-expected3] <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 27%] 2449s shuffle/tests/test_rechunk.py::test_rechunk_auto_1d[20-chunks4-5-expected4] <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 27%] 2449s shuffle/tests/test_rechunk.py::test_rechunk_auto_2d <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 27%] 2449s shuffle/tests/test_rechunk.py::test_rechunk_auto_3d <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 27%] 2449s shuffle/tests/test_rechunk.py::test_rechunk_auto_image_stack[100] <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 27%] 2449s shuffle/tests/test_rechunk.py::test_rechunk_auto_image_stack[1000] <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 27%] 2449s shuffle/tests/test_rechunk.py::test_rechunk_down <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 27%] 2450s shuffle/tests/test_rechunk.py::test_rechunk_zero <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 27%] 2450s shuffle/tests/test_rechunk.py::test_rechunk_bad_keys <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 27%] 2450s shuffle/tests/test_rechunk.py::test_rechunk_with_zero <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 27%] 2450s shuffle/tests/test_rechunk.py::test_split_axes_1 <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 27%] 2450s shuffle/tests/test_rechunk.py::test_split_axes_2 <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 28%] 2450s shuffle/tests/test_rechunk.py::test_split_axes_nan <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 28%] 2450s shuffle/tests/test_rechunk.py::test_split_axes_nan_single <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 28%] 2450s shuffle/tests/test_rechunk.py::test_split_axes_nan_long <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 28%] 2450s shuffle/tests/test_rechunk.py::test_split_axes_with_nonzero <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 28%] 2450s shuffle/tests/test_rechunk.py::test_split_axes_with_zero <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 28%] 2450s shuffle/tests/test_rechunk.py::test_preserve_writeable_flag <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 28%] 2450s shuffle/tests/test_rechunk.py::test_rechunk_in_memory_shards_dont_share_buffer <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 28%] 2450s shuffle/tests/test_rechunk.py::test_pick_worker_homogeneous_distribution[1] <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 28%] 2450s shuffle/tests/test_rechunk.py::test_pick_worker_homogeneous_distribution[2] <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 28%] 2450s shuffle/tests/test_rechunk.py::test_pick_worker_homogeneous_distribution[41] <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 28%] 2450s shuffle/tests/test_rechunk.py::test_pick_worker_homogeneous_distribution[50] <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 28%] 2451s shuffle/tests/test_rechunk.py::test_partial_rechunk_homogeneous_distribution <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 28%] 2451s shuffle/tests/test_rechunk.py::test_partial_rechunk_taskgroups <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 28%] 2451s shuffle/tests/test_rechunk.py::test_calculate_prechunking_1d[old0-new0-expected0] <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 28%] 2451s shuffle/tests/test_rechunk.py::test_calculate_prechunking_1d[old1-new1-expected1] <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 28%] 2451s shuffle/tests/test_rechunk.py::test_calculate_prechunking_1d[old2-new2-expected2] <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 28%] 2451s shuffle/tests/test_rechunk.py::test_calculate_prechunking_1d[old3-new3-expected3] <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 28%] 2451s shuffle/tests/test_rechunk.py::test_calculate_prechunking_1d[old4-new4-expected4] <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 28%] 2451s shuffle/tests/test_rechunk.py::test_calculate_prechunking_2d[old0-new0-expected0] <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 28%] 2451s shuffle/tests/test_rechunk.py::test_calculate_prechunking_2d[old1-new1-expected1] <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 28%] 2451s shuffle/tests/test_rechunk.py::test_calculate_prechunking_2d[old2-new2-expected2] <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 28%] 2451s shuffle/tests/test_rechunk.py::test_calculate_prechunking_2d[old3-new3-expected3] <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 28%] 2451s shuffle/tests/test_rechunk.py::test_calculate_prechunking_2d[old4-new4-expected4] <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 28%] 2451s shuffle/tests/test_rechunk.py::test_calculate_prechunking_2d[old5-new5-expected5] <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 28%] 2451s shuffle/tests/test_rechunk.py::test_calculate_prechunking_3d[old0-new0-expected0] <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 28%] 2451s shuffle/tests/test_rechunk.py::test_calculate_prechunking_3d[old1-new1-expected1] <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 28%] 2451s shuffle/tests/test_rechunk.py::test_calculate_prechunking_3d[old2-new2-expected2] <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 28%] 2451s shuffle/tests/test_rechunk.py::test_calculate_prechunking_3d[old3-new3-expected3] <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 28%] 2451s shuffle/tests/test_rechunk.py::test_calculate_prechunking_concatenation[1 B-expected0] <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 28%] 2451s shuffle/tests/test_rechunk.py::test_calculate_prechunking_concatenation[20 B-expected1] <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 28%] 2451s shuffle/tests/test_rechunk.py::test_calculate_prechunking_concatenation[40 B-expected2] <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 28%] 2451s shuffle/tests/test_rechunk.py::test_calculate_prechunking_concatenation[100 B-expected3] <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 28%] 2451s shuffle/tests/test_rechunk.py::test_calculate_prechunking_does_not_concatenate_object_type <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 28%] 2451s shuffle/tests/test_rechunk.py::test_calculate_prechunking_splitting[old0-new0-expected0] <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 28%] 2451s shuffle/tests/test_rechunk.py::test_calculate_prechunking_splitting[old1-new1-expected1] <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 28%] 2451s shuffle/tests/test_rechunk.py::test_calculate_prechunking_splitting[old2-new2-expected2] <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 28%] 2455s shuffle/tests/test_rechunk.py::test_homogeneously_schedule_unpack <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 29%] 2455s shuffle/tests/test_rechunk.py::test_rechunk_datetime[tasks] <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 29%] 2455s shuffle/tests/test_rechunk.py::test_rechunk_datetime[p2p] <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 29%] 2455s shuffle/tests/test_shuffle_plugins.py::test_installation_on_worker <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_shuffle_plugins.py PASSED [ 29%] 2455s shuffle/tests/test_shuffle_plugins.py::test_installation_on_scheduler <- ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_shuffle_plugins.py PASSED [ 29%] 2455s tests/test_active_memory_manager.py::test_no_policies <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 29%] 2455s tests/test_active_memory_manager.py::test_drop <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 29%] 2456s tests/test_active_memory_manager.py::test_start_stop <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 29%] 2456s tests/test_active_memory_manager.py::test_auto_start <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 29%] 2456s tests/test_active_memory_manager.py::test_add_policy <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 29%] 2457s tests/test_active_memory_manager.py::test_multi_start <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 29%] 2457s tests/test_active_memory_manager.py::test_not_registered <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 29%] 2458s tests/test_active_memory_manager.py::test_client_proxy_sync <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 29%] 2459s tests/test_active_memory_manager.py::test_client_proxy_async <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 29%] 2459s tests/test_active_memory_manager.py::test_drop_not_in_memory <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 29%] 2459s tests/test_active_memory_manager.py::test_drop_with_waiter <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 29%] 2460s tests/test_active_memory_manager.py::test_double_drop <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 29%] 2460s tests/test_active_memory_manager.py::test_double_drop_stress <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 29%] 2460s tests/test_active_memory_manager.py::test_drop_from_worker_with_least_free_memory <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 29%] 2460s tests/test_active_memory_manager.py::test_drop_with_candidates <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 29%] 2461s tests/test_active_memory_manager.py::test_drop_with_empty_candidates <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 29%] 2461s tests/test_active_memory_manager.py::test_drop_from_candidates_without_key <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 29%] 2461s tests/test_active_memory_manager.py::test_drop_with_bad_candidates <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 29%] 2461s tests/test_active_memory_manager.py::test_drop_prefers_paused_workers <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 29%] 2461s tests/test_active_memory_manager.py::test_drop_with_paused_workers_with_running_tasks_1 <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 29%] 2462s tests/test_active_memory_manager.py::test_drop_with_paused_workers_with_running_tasks_2 <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 29%] 2462s tests/test_active_memory_manager.py::test_drop_with_paused_workers_with_running_tasks_3_4[True] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 29%] 2462s tests/test_active_memory_manager.py::test_drop_with_paused_workers_with_running_tasks_3_4[False] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 29%] 2462s tests/test_active_memory_manager.py::test_drop_with_paused_workers_with_running_tasks_5 <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 29%] 2462s tests/test_active_memory_manager.py::test_replicate <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 29%] 2462s tests/test_active_memory_manager.py::test_replicate_not_in_memory <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 29%] 2462s tests/test_active_memory_manager.py::test_double_replicate_stress <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 29%] 2463s tests/test_active_memory_manager.py::test_replicate_to_worker_with_most_free_memory <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 29%] 2463s tests/test_active_memory_manager.py::test_replicate_with_candidates <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 29%] 2463s tests/test_active_memory_manager.py::test_replicate_with_empty_candidates <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 29%] 2463s tests/test_active_memory_manager.py::test_replicate_to_candidates_with_key <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 29%] 2464s tests/test_active_memory_manager.py::test_replicate_avoids_paused_workers_1 <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 30%] 2464s tests/test_active_memory_manager.py::test_replicate_avoids_paused_workers_2 <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 30%] 2464s tests/test_active_memory_manager.py::test_bad_measure <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 30%] 2464s tests/test_active_memory_manager.py::test_ReduceReplicas <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 30%] 2464s tests/test_active_memory_manager.py::test_ReduceReplicas_with_waiters[0-0-0-1] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 30%] 2465s tests/test_active_memory_manager.py::test_ReduceReplicas_with_waiters[1-0-0-1] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 30%] 2465s tests/test_active_memory_manager.py::test_ReduceReplicas_with_waiters[0-0-1-1] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 30%] 2465s tests/test_active_memory_manager.py::test_ReduceReplicas_with_waiters[2-0-0-1] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 30%] 2466s tests/test_active_memory_manager.py::test_ReduceReplicas_with_waiters[1-1-0-2] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 30%] 2466s tests/test_active_memory_manager.py::test_ReduceReplicas_with_waiters[1-1-1-3] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 30%] 2466s tests/test_active_memory_manager.py::test_ReduceReplicas_with_waiters[1-1-2-4] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 30%] 2467s tests/test_active_memory_manager.py::test_ReduceReplicas_with_waiters[2-1-1-3] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 30%] 2467s tests/test_active_memory_manager.py::test_ReduceReplicas_with_waiters[1-1-17-4] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 30%] 2468s tests/test_active_memory_manager.py::test_ReduceReplicas_with_waiters[17-1-1-3] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 30%] 2468s tests/test_active_memory_manager.py::test_ReduceReplicas_with_waiters[18-1-1-4] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 30%] 2468s tests/test_active_memory_manager.py::test_RetireWorker_amm_on_off[False] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 30%] 2468s tests/test_active_memory_manager.py::test_RetireWorker_amm_on_off[True] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 30%] 2468s tests/test_active_memory_manager.py::test_RetireWorker_no_extension <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 30%] 2468s tests/test_active_memory_manager.py::test_RetireWorker_no_remove <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 30%] 2469s tests/test_active_memory_manager.py::test_RetireWorker_with_ReduceReplicas[False] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 30%] 2469s tests/test_active_memory_manager.py::test_RetireWorker_with_ReduceReplicas[True] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 30%] 2469s tests/test_active_memory_manager.py::test_RetireWorker_all_replicas_are_being_retired <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 30%] 2469s tests/test_active_memory_manager.py::test_RetireWorker_no_recipients <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 30%] 2469s tests/test_active_memory_manager.py::test_RetireWorker_all_recipients_are_paused <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 30%] 2470s tests/test_active_memory_manager.py::test_RetireWorker_new_keys_arrive_after_all_keys_moved_away <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 30%] 2470s tests/test_active_memory_manager.py::test_RetireWorker_faulty_recipient <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 30%] 2470s tests/test_active_memory_manager.py::test_RetireWorker_mass <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 30%] 2470s tests/test_active_memory_manager.py::test_RetireWorker_incremental <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 30%] 2471s tests/test_active_memory_manager.py::test_dont_drop_actors <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 30%] 2471s tests/test_active_memory_manager.py::test_dont_replicate_actors <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 30%] 2471s tests/test_active_memory_manager.py::test_RetireWorker_with_actor[False] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 30%] 2471s tests/test_active_memory_manager.py::test_RetireWorker_with_actor[True] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 30%] 2471s tests/test_active_memory_manager.py::test_RetireWorker_with_actor_proxy <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 30%] 2476s tests/test_active_memory_manager.py::test_noamm_stress <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 30%] 2482s tests/test_active_memory_manager.py::test_drop_stress <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 30%] 2487s tests/test_active_memory_manager.py::test_ReduceReplicas_stress <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 30%] 2491s tests/test_active_memory_manager.py::test_RetireWorker_stress[False] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 31%] 2496s tests/test_active_memory_manager.py::test_RetireWorker_stress[True] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 31%] 2496s tests/test_actor.py::test_client_actions[True] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 31%] 2496s tests/test_actor.py::test_client_actions[False] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 31%] 2497s tests/test_actor.py::test_worker_actions[False] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 31%] 2497s tests/test_actor.py::test_worker_actions[True] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 31%] 2497s tests/test_actor.py::test_Actor <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 31%] 2497s tests/test_actor.py::test_linear_access <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py XFAILges rather than rpc) [ 31%] 2497s tests/test_actor.py::test_exceptions_create <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 31%] 2497s tests/test_actor.py::test_exceptions_method <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 31%] 2497s tests/test_actor.py::test_gc <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 31%] 2498s tests/test_actor.py::test_track_dependencies <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 31%] 2498s tests/test_actor.py::test_future <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 31%] 2498s tests/test_actor.py::test_future_dependencies <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 31%] 2500s tests/test_actor.py::test_sync <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 31%] 2501s tests/test_actor.py::test_timeout <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 31%] 2501s tests/test_actor.py::test_failed_worker <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 31%] 2502s tests/test_actor.py::test_numpy_roundtrip <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 31%] 2502s tests/test_actor.py::test_numpy_roundtrip_getattr <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 31%] 2502s tests/test_actor.py::test_repr <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 31%] 2502s tests/test_actor.py::test_dir <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 31%] 2502s tests/test_actor.py::test_many_computations <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 31%] 2502s tests/test_actor.py::test_thread_safety <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 31%] 2502s tests/test_actor.py::test_Actors_create_dependencies <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 31%] 2502s tests/test_actor.py::test_load_balance <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 31%] 2503s tests/test_actor.py::test_load_balance_map <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 31%] 2503s tests/test_actor.py::test_compute <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 31%] 2504s tests/test_actor.py::test_compute_sync <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 31%] 2504s tests/test_actor.py::test_actors_in_profile <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 31%] 2505s tests/test_actor.py::test_waiter <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 31%] 2505s tests/test_actor.py::test_worker_actor_handle_is_weakref <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 31%] 2506s tests/test_actor.py::test_worker_actor_handle_is_weakref_sync <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 31%] 2508s tests/test_actor.py::test_worker_actor_handle_is_weakref_from_compute_sync <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 31%] 2509s tests/test_actor.py::test_one_thread_deadlock <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 31%] 2511s tests/test_actor.py::test_one_thread_deadlock_timeout <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 31%] 2512s tests/test_actor.py::test_one_thread_deadlock_sync_client <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 31%] 2512s tests/test_actor.py::test_async_deadlock <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 32%] 2514s tests/test_actor.py::test_exception <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 32%] 2514s tests/test_actor.py::test_exception_async <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 32%] 2515s tests/test_actor.py::test_as_completed <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 32%] 2515s tests/test_actor.py::test_actor_future_awaitable <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 32%] 2515s tests/test_actor.py::test_actor_future_awaitable_deadlock <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 32%] 2515s tests/test_actor.py::test_serialize_with_pickle <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 32%] 2515s tests/test_actor.py::test_worker_client_async <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 32%] 2516s tests/test_actor.py::test_worker_client_separate_thread <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 32%] 2516s tests/test_actor.py::test_get_worker <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 32%] 2516s tests/test_as_completed.py::test_as_completed_async <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_as_completed.py PASSED [ 32%] 2517s tests/test_as_completed.py::test_as_completed_timeout_async <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_as_completed.py PASSED [ 32%] 2519s tests/test_as_completed.py::test_as_completed_timeout_sync <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_as_completed.py PASSED [ 32%] 2520s tests/test_as_completed.py::test_as_completed_sync <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_as_completed.py PASSED [ 32%] 2522s tests/test_as_completed.py::test_as_completed_with_non_futures <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_as_completed.py PASSED [ 32%] 2523s tests/test_as_completed.py::test_as_completed_add <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_as_completed.py PASSED [ 32%] 2525s tests/test_as_completed.py::test_as_completed_update <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_as_completed.py PASSED [ 32%] 2526s tests/test_as_completed.py::test_as_completed_repeats <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_as_completed.py PASSED [ 32%] 2528s tests/test_as_completed.py::test_as_completed_is_empty <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_as_completed.py PASSED [ 32%] 2528s tests/test_as_completed.py::test_as_completed_cancel <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_as_completed.py PASSED [ 32%] 2529s tests/test_as_completed.py::test_as_completed_cancel_last <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_as_completed.py PASSED [ 32%] 2529s tests/test_as_completed.py::test_async_for_py2_equivalent <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_as_completed.py PASSED [ 32%] 2529s tests/test_as_completed.py::test_as_completed_error_async <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_as_completed.py PASSED [ 32%] 2531s tests/test_as_completed.py::test_as_completed_error <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_as_completed.py PASSED [ 32%] 2532s tests/test_as_completed.py::test_as_completed_with_results <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_as_completed.py PASSED [ 32%] 2532s tests/test_as_completed.py::test_as_completed_with_results_async <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_as_completed.py PASSED [ 32%] 2534s tests/test_as_completed.py::test_as_completed_with_results_no_raise <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_as_completed.py PASSED [ 32%] 2534s tests/test_as_completed.py::test_str <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_as_completed.py PASSED [ 32%] 2534s tests/test_as_completed.py::test_as_completed_with_results_no_raise_async <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_as_completed.py PASSED [ 32%] 2534s tests/test_as_completed.py::test_clear <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_as_completed.py PASSED [ 32%] 2534s tests/test_async_task_group.py::test_async_task_group_initialization <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_async_task_group.py PASSED [ 32%] 2534s tests/test_async_task_group.py::test_async_task_group_call_soon_executes_task_in_background <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_async_task_group.py PASSED [ 32%] 2535s tests/test_async_task_group.py::test_async_task_group_call_later_executes_delayed_task_in_background <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_async_task_group.py PASSED [ 32%] 2535s tests/test_async_task_group.py::test_async_task_group_close_closes <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_async_task_group.py PASSED [ 32%] 2535s tests/test_async_task_group.py::test_async_task_group_close_does_not_cancel_existing_tasks <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_async_task_group.py PASSED [ 32%] 2535s tests/test_async_task_group.py::test_async_task_group_close_prohibits_new_tasks <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_async_task_group.py PASSED [ 32%] 2535s tests/test_async_task_group.py::test_async_task_group_stop_disallows_shutdown <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_async_task_group.py PASSED [ 32%] 2535s tests/test_async_task_group.py::test_async_task_group_stop_cancels_long_running <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_async_task_group.py PASSED [ 33%] 2535s tests/test_asyncio.py::test_rlock <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_asyncio.py PASSED [ 33%] 2535s tests/test_asyncio.py::test_rlock_nonreentrant <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_asyncio.py PASSED [ 33%] 2535s tests/test_asyncio.py::test_rlock_none <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_asyncio.py PASSED [ 33%] 2535s tests/test_asyncio.py::test_rlock_release_on_raise <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_asyncio.py PASSED [ 33%] 2538s tests/test_asyncprocess.py::test_simple <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_asyncprocess.py PASSED [ 33%] 2539s tests/test_asyncprocess.py::test_exitcode <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_asyncprocess.py PASSED [ 33%] 2540s tests/test_asyncprocess.py::test_sigint_from_same_process <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_asyncprocess.py PASSED [ 33%] 2540s tests/test_asyncprocess.py::test_sigterm_from_parent_process <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_asyncprocess.py PASSED [ 33%] 2540s tests/test_asyncprocess.py::test_terminate <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_asyncprocess.py PASSED [ 33%] 2541s tests/test_asyncprocess.py::test_close <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_asyncprocess.py PASSED [ 33%] 2542s tests/test_asyncprocess.py::test_exit_callback <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_asyncprocess.py PASSED [ 33%] 2543s tests/test_asyncprocess.py::test_child_main_thread <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_asyncprocess.py PASSED [ 33%] 2545s tests/test_asyncprocess.py::test_num_fds <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_asyncprocess.py PASSED [ 33%] 2545s tests/test_asyncprocess.py::test_terminate_after_stop <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_asyncprocess.py PASSED [ 33%] 2546s tests/test_asyncprocess.py::test_kill <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_asyncprocess.py PASSED [ 33%] 2548s tests/test_asyncprocess.py::test_asyncprocess_child_teardown_on_parent_exit <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_asyncprocess.py PASSED [ 33%] 2548s tests/test_batched.py::test_BatchedSend <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_batched.py PASSED [ 33%] 2548s tests/test_batched.py::test_send_before_start <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_batched.py PASSED [ 33%] 2548s tests/test_batched.py::test_send_after_stream_start <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_batched.py PASSED [ 33%] 2548s tests/test_batched.py::test_send_before_close <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_batched.py PASSED [ 33%] 2548s tests/test_batched.py::test_close_closed <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_batched.py PASSED [ 33%] 2548s tests/test_batched.py::test_close_not_started <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_batched.py PASSED [ 33%] 2548s tests/test_batched.py::test_close_twice <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_batched.py PASSED [ 33%] 2552s tests/test_batched.py::test_stress <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_batched.py PASSED [ 33%] 2552s tests/test_batched.py::test_sending_traffic_jam <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_batched.py PASSED [ 33%] 2553s tests/test_batched.py::test_large_traffic_jam <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_batched.py PASSED [ 33%] 2554s tests/test_batched.py::test_serializers <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_batched.py PASSED [ 33%] 2554s tests/test_cancelled_state.py::test_abort_execution_release <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 33%] 2554s tests/test_cancelled_state.py::test_abort_execution_reschedule <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 33%] 2554s tests/test_cancelled_state.py::test_abort_execution_add_as_dependency <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 33%] 2554s tests/test_cancelled_state.py::test_abort_execution_to_fetch <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 33%] 2554s tests/test_cancelled_state.py::test_worker_stream_died_during_comm <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 33%] 2554s tests/test_cancelled_state.py::test_flight_to_executing_via_cancelled_resumed <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 33%] 2554s tests/test_cancelled_state.py::test_executing_cancelled_error <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 33%] 2554s tests/test_cancelled_state.py::test_flight_cancelled_error <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 33%] 2554s tests/test_cancelled_state.py::test_in_flight_lost_after_resumed <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 34%] 2555s tests/test_cancelled_state.py::test_cancelled_error <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 34%] 2555s tests/test_cancelled_state.py::test_cancelled_error_with_resources <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 34%] 2555s tests/test_cancelled_state.py::test_cancelled_resumed_after_flight_with_dependencies <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 34%] 2555s tests/test_cancelled_state.py::test_cancelled_resumed_after_flight_with_dependencies_workerstate <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 34%] 2555s tests/test_cancelled_state.py::test_resumed_cancelled_handle_compute[True-True] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 34%] 2555s tests/test_cancelled_state.py::test_resumed_cancelled_handle_compute[True-False] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 34%] 2556s tests/test_cancelled_state.py::test_resumed_cancelled_handle_compute[False-True] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 34%] 2556s tests/test_cancelled_state.py::test_resumed_cancelled_handle_compute[False-False] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 34%] 2556s tests/test_cancelled_state.py::test_cancelled_handle_compute[True] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 34%] 2556s tests/test_cancelled_state.py::test_cancelled_handle_compute[False] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 34%] 2556s tests/test_cancelled_state.py::test_cancelled_task_error_rejected <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 34%] 2557s tests/test_cancelled_state.py::test_deadlock_cancelled_after_inflight_before_gather_from_worker[True-resumed] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 34%] 2558s tests/test_cancelled_state.py::test_deadlock_cancelled_after_inflight_before_gather_from_worker[True-cancelled] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 34%] 2558s tests/test_cancelled_state.py::test_workerstate_executing_to_executing[executing] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 34%] 2558s tests/test_cancelled_state.py::test_workerstate_executing_to_executing[long-running] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 34%] 2558s tests/test_cancelled_state.py::test_workerstate_flight_to_flight <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 34%] 2558s tests/test_cancelled_state.py::test_workerstate_executing_skips_fetch_on_success[executing] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 34%] 2558s tests/test_cancelled_state.py::test_workerstate_executing_skips_fetch_on_success[long-running] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 34%] 2558s tests/test_cancelled_state.py::test_workerstate_executing_failure_to_fetch[executing] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 34%] 2558s tests/test_cancelled_state.py::test_workerstate_executing_failure_to_fetch[long-running] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 34%] 2558s tests/test_cancelled_state.py::test_workerstate_flight_skips_executing_on_success <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 34%] 2558s tests/test_cancelled_state.py::test_workerstate_flight_failure_to_executing[False] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 34%] 2558s tests/test_cancelled_state.py::test_workerstate_flight_failure_to_executing[True] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 34%] 2558s tests/test_cancelled_state.py::test_workerstate_resumed_fetch_to_cancelled_to_executing[executing] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 34%] 2558s tests/test_cancelled_state.py::test_workerstate_resumed_fetch_to_cancelled_to_executing[long-running] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 34%] 2558s tests/test_cancelled_state.py::test_workerstate_resumed_fetch_to_executing[executing] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 34%] 2558s tests/test_cancelled_state.py::test_workerstate_resumed_fetch_to_executing[long-running] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 34%] 2558s tests/test_cancelled_state.py::test_workerstate_resumed_waiting_to_flight <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 34%] 2558s tests/test_cancelled_state.py::test_execute_preamble_early_cancel[executing-False] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 34%] 2558s tests/test_cancelled_state.py::test_execute_preamble_early_cancel[executing-True] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 34%] 2558s tests/test_cancelled_state.py::test_execute_preamble_early_cancel[resumed-False] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 34%] 2558s tests/test_cancelled_state.py::test_execute_preamble_early_cancel[resumed-True] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 34%] 2558s tests/test_cancelled_state.py::test_cancel_with_dependencies_in_memory[ExecuteSuccessEvent-False] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 34%] 2558s tests/test_cancelled_state.py::test_cancel_with_dependencies_in_memory[ExecuteSuccessEvent-True] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 34%] 2558s tests/test_cancelled_state.py::test_cancel_with_dependencies_in_memory[ExecuteFailureEvent-False] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 34%] 2558s tests/test_cancelled_state.py::test_cancel_with_dependencies_in_memory[ExecuteFailureEvent-True] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 35%] 2558s tests/test_cancelled_state.py::test_cancel_with_dependencies_in_memory[RescheduleEvent-False] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 35%] 2558s tests/test_cancelled_state.py::test_cancel_with_dependencies_in_memory[RescheduleEvent-True] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 35%] 2558s tests/test_cancelled_state.py::test_secede_cancelled_or_resumed_workerstate[ExecuteSuccessEvent-False-False] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 35%] 2558s tests/test_cancelled_state.py::test_secede_cancelled_or_resumed_workerstate[ExecuteSuccessEvent-False-True] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 35%] 2558s tests/test_cancelled_state.py::test_secede_cancelled_or_resumed_workerstate[ExecuteSuccessEvent-True-False] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 35%] 2558s tests/test_cancelled_state.py::test_secede_cancelled_or_resumed_workerstate[ExecuteSuccessEvent-True-True] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 35%] 2558s tests/test_cancelled_state.py::test_secede_cancelled_or_resumed_workerstate[ExecuteFailureEvent-False-False] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 35%] 2558s tests/test_cancelled_state.py::test_secede_cancelled_or_resumed_workerstate[ExecuteFailureEvent-False-True] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 35%] 2558s tests/test_cancelled_state.py::test_secede_cancelled_or_resumed_workerstate[ExecuteFailureEvent-True-False] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 35%] 2558s tests/test_cancelled_state.py::test_secede_cancelled_or_resumed_workerstate[ExecuteFailureEvent-True-True] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 35%] 2558s tests/test_cancelled_state.py::test_secede_cancelled_or_resumed_workerstate[RescheduleEvent-False-False] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 35%] 2558s tests/test_cancelled_state.py::test_secede_cancelled_or_resumed_workerstate[RescheduleEvent-False-True] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 35%] 2558s tests/test_cancelled_state.py::test_secede_cancelled_or_resumed_workerstate[RescheduleEvent-True-False] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 35%] 2558s tests/test_cancelled_state.py::test_secede_cancelled_or_resumed_workerstate[RescheduleEvent-True-True] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 35%] 2558s tests/test_cancelled_state.py::test_secede_cancelled_or_resumed_scheduler <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 35%] 2558s tests/test_cancelled_state.py::test_workerstate_remove_replica_of_cancelled_task_dependency <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 35%] 2563s tests/test_chaos.py::test_KillWorker[sys.exit] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_chaos.py PASSED [ 35%] 2564s tests/test_chaos.py::test_KillWorker[graceful] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_chaos.py PASSED [ 35%] 2569s tests/test_chaos.py::test_KillWorker[segfault] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_chaos.py PASSED [ 35%] 2569s tests/test_client.py::test_submit <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 35%] 2569s tests/test_client.py::test_map <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 35%] 2569s tests/test_client.py::test_map_empty <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 35%] 2570s tests/test_client.py::test_map_keynames <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 35%] 2570s tests/test_client.py::test_map_retries <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 35%] 2570s tests/test_client.py::test_map_batch_size <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 35%] 2570s tests/test_client.py::test_custom_key_with_batches <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 35%] 2570s tests/test_client.py::test_compute_retries <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 35%] 2571s tests/test_client.py::test_compute_retries_annotations <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 35%] 2572s tests/test_client.py::test_retries_get <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 35%] 2572s tests/test_client.py::test_persist_retries <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 35%] 2572s tests/test_client.py::test_persist_retries_annotations <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 35%] 2572s tests/test_client.py::test_retries_dask_array <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 35%] 2573s tests/test_client.py::test_future_repr <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 35%] 2573s tests/test_client.py::test_future_tuple_repr <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 35%] 2573s tests/test_client.py::test_Future_exception <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 35%] 2574s tests/test_client.py::test_Future_exception_sync <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 36%] 2575s tests/test_client.py::test_Future_release <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 36%] 2576s tests/test_client.py::test_Future_release_sync <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 36%] 2578s tests/test_client.py::test_short_tracebacks[result] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 36%] 2579s tests/test_client.py::test_short_tracebacks[gather] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 36%] 2579s tests/test_client.py::test_short_tracebacks_async[await] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 36%] 2579s tests/test_client.py::test_short_tracebacks_async[result] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 36%] 2579s tests/test_client.py::test_short_tracebacks_async[gather] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 36%] 2580s tests/test_client.py::test_map_naming <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 36%] 2580s tests/test_client.py::test_submit_naming <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 36%] 2580s tests/test_client.py::test_exceptions <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 36%] 2580s tests/test_client.py::test_gc <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 36%] 2582s tests/test_client.py::test_thread <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 36%] 2583s tests/test_client.py::test_sync_exceptions <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 36%] 2583s tests/test_client.py::test_gather <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 36%] 2583s tests/test_client.py::test_gather_mismatched_client <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 36%] 2583s tests/test_client.py::test_gather_lost <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 36%] 2585s tests/test_client.py::test_gather_sync <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 36%] 2585s tests/test_client.py::test_gather_strict <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 36%] 2585s tests/test_client.py::test_gather_skip <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 36%] 2586s tests/test_client.py::test_limit_concurrent_gathering <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 36%] 2586s tests/test_client.py::test_get <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 36%] 2587s tests/test_client.py::test_get_sync <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 36%] 2589s tests/test_client.py::test_no_future_references <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 36%] 2590s tests/test_client.py::test_get_sync_optimize_graph_passes_through <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 36%] 2591s tests/test_client.py::test_gather_errors <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 36%] 2591s tests/test_client.py::test_wait <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 36%] 2591s tests/test_client.py::test_wait_first_completed <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 36%] 2591s tests/test_client.py::test_wait_timeout <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 36%] 2592s tests/test_client.py::test_wait_sync <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 36%] 2594s tests/test_client.py::test_wait_informative_error_for_timeouts <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 36%] 2594s tests/test_client.py::test_garbage_collection <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 36%] 2594s tests/test_client.py::test_garbage_collection_with_scatter <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 36%] 2594s tests/test_client.py::test_recompute_released_key <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 36%] 2597s tests/test_client.py::test_long_tasks_dont_trigger_timeout <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 36%] 2598s tests/test_client.py::test_tokenize_on_futures <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 36%] 2598s tests/test_client.py::test_restrictions_submit <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 36%] 2598s tests/test_client.py::test_restrictions_ip_port <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 37%] 2598s tests/test_client.py::test_restrictions_map <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 37%] 2598s tests/test_client.py::test_restrictions_get <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 37%] 2598s tests/test_client.py::test_restrictions_get_annotate <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 37%] 2598s tests/test_client.py::test_remove_worker <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 37%] 2598s tests/test_client.py::test_errors_dont_block <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 37%] 2598s tests/test_client.py::test_submit_quotes <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 37%] 2599s tests/test_client.py::test_map_quotes <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 37%] 2599s tests/test_client.py::test_two_consecutive_clients_share_results <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 37%] 2599s tests/test_client.py::test_submit_then_get_with_Future <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 37%] 2599s tests/test_client.py::test_aliases <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 37%] 2599s tests/test_client.py::test_aliases_2 <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 37%] 2599s tests/test_client.py::test_scatter <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 37%] 2599s tests/test_client.py::test_scatter_types <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 37%] 2599s tests/test_client.py::test_scatter_non_list <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 37%] 2599s tests/test_client.py::test_scatter_tokenize_local <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 37%] 2600s tests/test_client.py::test_scatter_singletons <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 37%] 2600s tests/test_client.py::test_scatter_typename <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 37%] 2600s tests/test_client.py::test_scatter_hash <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 37%] 2600s tests/test_client.py::test_scatter_hash_2 <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 37%] 2600s tests/test_client.py::test_get_releases_data <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 37%] 2602s tests/test_client.py::test_current <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 37%] 2603s tests/test_client.py::test_current_nested <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 37%] 2603s tests/test_client.py::test_current_nested_async <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 37%] 2603s tests/test_client.py::test_current_concurrent <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 37%] 2603s tests/test_client.py::test_context_manager_used_from_different_tasks <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 37%] 2604s tests/test_client.py::test_context_manager_used_from_different_threads <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 37%] 2606s tests/test_client.py::test_global_clients <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 37%] 2606s tests/test_client.py::test_exception_on_exception <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 37%] 2606s tests/test_client.py::test_get_task_prefix_states <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 37%] 2606s tests/test_client.py::test_get_nbytes <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 37%] 2606s tests/test_client.py::test_nbytes_determines_worker <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 37%] 2606s tests/test_client.py::test_if_intermediates_clear_on_error <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 37%] 2606s tests/test_client.py::test_pragmatic_move_small_data_to_large_data <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 37%] 2606s tests/test_client.py::test_get_with_non_list_key <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 37%] 2607s tests/test_client.py::test_get_with_error <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 37%] 2608s tests/test_client.py::test_get_with_error_sync <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 38%] 2608s tests/test_client.py::test_directed_scatter <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 38%] 2608s tests/test_client.py::test_scatter_direct <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 38%] 2608s tests/test_client.py::test_scatter_direct_2 <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 38%] 2608s tests/test_client.py::test_scatter_direct_numpy <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 38%] 2609s tests/test_client.py::test_scatter_direct_broadcast <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 38%] 2609s tests/test_client.py::test_scatter_direct_balanced <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 38%] 2609s tests/test_client.py::test_scatter_direct_broadcast_target <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 38%] 2609s tests/test_client.py::test_scatter_direct_empty <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 38%] 2609s tests/test_client.py::test_scatter_direct_spread_evenly <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 38%] 2610s tests/test_client.py::test_scatter_gather_sync[True-True] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 38%] 2612s tests/test_client.py::test_scatter_gather_sync[True-False] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 38%] 2613s tests/test_client.py::test_scatter_gather_sync[False-True] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 38%] 2615s tests/test_client.py::test_scatter_gather_sync[False-False] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 38%] 2615s tests/test_client.py::test_gather_direct <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 38%] 2615s tests/test_client.py::test_many_submits_spread_evenly <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 38%] 2615s tests/test_client.py::test_traceback <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 38%] 2615s tests/test_client.py::test_get_traceback <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 38%] 2615s tests/test_client.py::test_gather_traceback <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 38%] 2617s tests/test_client.py::test_traceback_sync <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 38%] 2617s tests/test_client.py::test_upload_file <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 38%] 2617s tests/test_client.py::test_upload_file_refresh_delayed <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 38%] 2617s tests/test_client.py::test_upload_file_no_extension <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 38%] 2617s tests/test_client.py::test_upload_file_zip <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py SKIPPEDues/8708 and 2617s https://github.com/python/cpython/issues/121342.) [ 38%] 2619s tests/test_client.py::test_upload_file_egg <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 38%] 2619s tests/test_client.py::test_upload_large_file <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 38%] 2620s tests/test_client.py::test_upload_file_sync <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 38%] 2620s tests/test_client.py::test_upload_file_exception <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 38%] 2622s tests/test_client.py::test_upload_file_exception_sync <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 38%] 2622s tests/test_client.py::test_upload_file_load <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 38%] 2622s tests/test_client.py::test_upload_file_new_worker <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 38%] 2622s tests/test_client.py::test_multiple_clients <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py SKIPPED [ 38%] 2622s tests/test_client.py::test_async_compute <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 38%] 2622s tests/test_client.py::test_async_compute_with_scatter <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 38%] 2624s tests/test_client.py::test_sync_compute <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 38%] 2624s tests/test_client.py::test_remote_scatter_gather <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 38%] 2624s tests/test_client.py::test_remote_submit_on_Future <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 39%] 2625s tests/test_client.py::test_start_is_idempotent <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 39%] 2625s tests/test_client.py::test_client_with_scheduler <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 39%] 2626s tests/test_client.py::test_allow_restrictions <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 39%] 2626s tests/test_client.py::test_bad_address <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 39%] 2626s tests/test_client.py::test_informative_error_on_cluster_type <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 39%] 2626s tests/test_client.py::test_long_error <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 39%] 2626s tests/test_client.py::test_map_on_futures_with_kwargs <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 39%] 2626s tests/test_client.py::test_badly_serialized_input_stderr <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py SKIPPED [ 39%] 2628s tests/test_client.py::test_repr[str] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 39%] 2629s tests/test_client.py::test_repr[repr] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 39%] 2631s tests/test_client.py::test_repr[func2] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 39%] 2631s tests/test_client.py::test_repr_async <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 39%] 2631s tests/test_client.py::test_repr_no_memory_limit <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 39%] 2631s tests/test_client.py::test_repr_localcluster <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 39%] 2632s tests/test_client.py::test_forget_simple <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 39%] 2632s tests/test_client.py::test_forget_complex <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 39%] 2632s tests/test_client.py::test_forget_in_flight <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 39%] 2632s tests/test_client.py::test_forget_errors <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 39%] 2633s tests/test_client.py::test_repr_sync <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 39%] 2633s tests/test_client.py::test_multi_client <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 39%] 2635s tests/test_client.py::test_cleanup_after_broken_client_connection <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 39%] 2635s tests/test_client.py::test_multi_garbage_collection <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 39%] 2635s tests/test_client.py::test__broadcast <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 39%] 2635s tests/test_client.py::test__broadcast_integer <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 39%] 2635s tests/test_client.py::test__broadcast_dict <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 39%] 2636s tests/test_client.py::test_proxy <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 39%] 2636s tests/test_client.py::test_cancel <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 39%] 2636s tests/test_client.py::test_cancel_tuple_key <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 39%] 2636s tests/test_client.py::test_cancel_multi_client <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 39%] 2636s tests/test_client.py::test_cancel_before_known_to_scheduler <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 39%] 2636s tests/test_client.py::test_cancel_collection <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 39%] 2638s tests/test_client.py::test_cancel_sync <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 39%] 2638s tests/test_client.py::test_future_type <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 39%] 2638s tests/test_client.py::test_traceback_clean <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 39%] 2638s tests/test_client.py::test_map_differnet_lengths <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 39%] 2639s tests/test_client.py::test_Future_exception_sync_2 <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 40%] 2640s tests/test_client.py::test_async_persist <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 40%] 2640s tests/test_client.py::test_persist_async <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 40%] 2641s tests/test_client.py::test_persist <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 40%] 2641s tests/test_client.py::test_long_traceback <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 40%] 2641s tests/test_client.py::test_wait_on_collections <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 40%] 2642s tests/test_client.py::test_futures_of_get <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 40%] 2642s tests/test_client.py::test_futures_of_class <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 40%] 2642s tests/test_client.py::test_futures_of_cancelled_raises <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 40%] 2642s tests/test_client.py::test_balance_tasks_by_stacks <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py SKIPPED [ 40%] 2642s tests/test_client.py::test_run <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 40%] 2642s tests/test_client.py::test_run_handles_picklable_data <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 40%] 2643s tests/test_client.py::test_run_sync <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 40%] 2643s tests/test_client.py::test_run_coroutine <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 40%] 2645s tests/test_client.py::test_run_coroutine_sync <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 40%] 2645s tests/test_client.py::test_run_exception <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 40%] 2646s tests/test_client.py::test_run_rpc_error <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 40%] 2647s tests/test_client.py::test_diagnostic_ui <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 40%] 2649s tests/test_client.py::test_diagnostic_nbytes_sync <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 40%] 2649s tests/test_client.py::test_diagnostic_nbytes <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 40%] 2649s tests/test_client.py::test_worker_aliases <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 40%] 2651s tests/test_client.py::test_persist_get_sync <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 40%] 2651s tests/test_client.py::test_persist_get[True] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 40%] 2651s tests/test_client.py::test_persist_get[False] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 40%] 2653s tests/test_client.py::test_client_num_fds <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 40%] 2653s tests/test_client.py::test_startup_close_startup <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 40%] 2655s tests/test_client.py::test_startup_close_startup_sync <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 40%] 2655s tests/test_client.py::test_badly_serialized_exceptions <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 40%] 2655s tests/test_client.py::test_rebalance <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 40%] 2655s tests/test_client.py::test_rebalance_workers_and_keys <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 40%] 2655s tests/test_client.py::test_rebalance_sync <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 40%] 2656s tests/test_client.py::test_rebalance_unprepared <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 40%] 2656s tests/test_client.py::test_receive_lost_key <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 40%] 2656s tests/test_client.py::test_unrunnable_task_runs <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 40%] 2657s tests/test_client.py::test_add_worker_after_tasks <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 40%] 2657s tests/test_client.py::test_workers_register_indirect_data <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 40%] 2658s tests/test_client.py::test_submit_on_cancelled_future <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 40%] 2658s tests/test_client.py::test_replicate <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 41%] 2658s tests/test_client.py::test_replicate_tuple_keys <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 41%] 2658s tests/test_client.py::test_replicate_workers <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 41%] 2659s tests/test_client.py::test_replicate_tree_branching <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 41%] 2659s tests/test_client.py::test_client_replicate <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 41%] 2659s tests/test_client.py::test_client_replicate_host <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 41%] 2660s tests/test_client.py::test_client_replicate_sync <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 41%] 2661s tests/test_client.py::test_task_load_adapts_quickly <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 41%] 2661s tests/test_client.py::test_even_load_after_fast_functions <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 41%] 2661s tests/test_client.py::test_even_load_on_startup <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 41%] 2661s tests/test_client.py::test_contiguous_load <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py SKIPPED [ 41%] 2661s tests/test_client.py::test_balanced_with_submit <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 41%] 2661s tests/test_client.py::test_balanced_with_submit_and_resident_data <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 41%] 2662s tests/test_client.py::test_scheduler_saturates_cores <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 41%] 2662s tests/test_client.py::test_scheduler_saturates_cores_random <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 41%] 2662s tests/test_client.py::test_cancel_clears_processing <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 41%] 2664s tests/test_client.py::test_default_get <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 41%] 2664s tests/test_client.py::test_get_scheduler_default_client_config_interleaving <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 41%] 2664s tests/test_client.py::test_ensure_default_client <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 41%] 2664s tests/test_client.py::test_set_as_default <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 41%] 2664s tests/test_client.py::test_get_foo <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 41%] 2664s tests/test_client.py::test_get_foo_lost_keys <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 41%] 2675s tests/test_client.py::test_bad_tasks_fail <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 41%] 2677s tests/test_client.py::test_get_processing_sync <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 41%] 2678s tests/test_client.py::test_close_idempotent <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 41%] 2680s tests/test_client.py::test_get_returns_early <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 41%] 2681s tests/test_client.py::test_Client_clears_references_after_restart <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 41%] 2683s tests/test_client.py::test_get_stops_work_after_error <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 41%] 2684s tests/test_client.py::test_as_completed_list <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 41%] 2686s tests/test_client.py::test_as_completed_results <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 41%] 2688s tests/test_client.py::test_as_completed_batches[True] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 41%] 2690s tests/test_client.py::test_as_completed_batches[False] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 41%] 2691s tests/test_client.py::test_as_completed_next_batch <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 41%] 2691s tests/test_client.py::test_status <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 41%] 2692s tests/test_client.py::test_persist_optimize_graph <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 41%] 2692s tests/test_client.py::test_scatter_raises_if_no_workers <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 41%] 2695s tests/test_client.py::test_reconnect <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 42%] 2696s tests/test_client.py::test_reconnect_timeout <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 42%] 2696s tests/test_client.py::test_idempotence <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 42%] 2697s tests/test_client.py::test_scheduler_info <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 42%] 2699s tests/test_client.py::test_write_scheduler_file <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 42%] 2701s tests/test_client.py::test_get_versions_sync <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 42%] 2701s tests/test_client.py::test_get_versions_async <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 42%] 2701s tests/test_client.py::test_get_versions_rpc_error <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 42%] 2703s tests/test_client.py::test_threaded_get_within_distributed <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 42%] 2703s tests/test_client.py::test_lose_scattered_data <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 42%] 2704s tests/test_client.py::test_partially_lose_scattered_data <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 42%] 2704s tests/test_client.py::test_scatter_compute_lose <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 42%] 2704s tests/test_client.py::test_scatter_compute_store_lose <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 42%] 2704s tests/test_client.py::test_scatter_compute_store_lose_processing <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 42%] 2704s tests/test_client.py::test_temp_default_client <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 42%] 2704s tests/test_client.py::test_as_current <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 42%] 2706s tests/test_client.py::test_as_current_is_thread_local <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 42%] 2706s tests/test_client.py::test_as_current_is_task_local <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 42%] 2706s tests/test_client.py::test_persist_workers_annotate <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 42%] 2706s tests/test_client.py::test_persist_workers_annotate2 <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 42%] 2706s tests/test_client.py::test_persist_workers <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 42%] 2707s tests/test_client.py::test_compute_workers_annotate <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 42%] 2707s tests/test_client.py::test_compute_workers <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 42%] 2707s tests/test_client.py::test_compute_nested_containers <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 42%] 2707s tests/test_client.py::test_scatter_type <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 42%] 2707s tests/test_client.py::test_retire_workers_2 <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 42%] 2707s tests/test_client.py::test_retire_many_workers <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 42%] 2707s tests/test_client.py::test_weight_occupancy_against_data_movement <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 42%] 2708s tests/test_client.py::test_distribute_tasks_by_nthreads <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 42%] 2708s tests/test_client.py::test_add_done_callback <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 42%] 2708s tests/test_client.py::test_normalize_collection <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 42%] 2708s tests/test_client.py::test_normalize_collection_dask_array <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 42%] 2717s tests/test_client.py::test_normalize_collection_with_released_futures <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 42%] 2717s tests/test_client.py::test_auto_normalize_collection <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py XPASS [ 42%] 2719s tests/test_client.py::test_auto_normalize_collection_sync <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py XPASS [ 42%] 2720s tests/test_client.py::test_interleave_computations <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 42%] 2720s tests/test_client.py::test_interleave_computations_map <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py SKIPPED [ 43%] 2720s tests/test_client.py::test_scatter_dict_workers <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 43%] 2723s tests/test_client.py::test_client_timeout <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 43%] 2724s tests/test_client.py::test_submit_list_kwargs <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 43%] 2724s tests/test_client.py::test_map_list_kwargs <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 43%] 2725s tests/test_client.py::test_recreate_error_sync <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 43%] 2727s tests/test_client.py::test_recreate_error_not_error <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 43%] 2729s tests/test_client.py::test_recreate_task_sync <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 43%] 2729s tests/test_client.py::test_retire_workers <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 43%] 2732s tests/test_client.py::test_restart_workers <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 43%] 2732s tests/test_client.py::test_restart_workers_no_nanny_raises <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 43%] 2736s tests/test_client.py::test_restart_workers_kill_timeout[True] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 43%] 2739s tests/test_client.py::test_restart_workers_kill_timeout[False] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 43%] 2743s tests/test_client.py::test_restart_workers_restart_timeout[True] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 43%] 2747s tests/test_client.py::test_restart_workers_restart_timeout[False] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 43%] 2751s tests/test_client.py::test_restart_workers_exception <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 43%] 2754s tests/test_client.py::test_restart_workers_by_name[True] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 43%] 2756s tests/test_client.py::test_restart_workers_by_name[False] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 43%] 2756s tests/test_client.py::test_robust_unserializable <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 43%] 2756s tests/test_client.py::test_robust_undeserializable <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 43%] 2756s tests/test_client.py::test_robust_undeserializable_function <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 43%] 2757s tests/test_client.py::test_fire_and_forget <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 43%] 2757s tests/test_client.py::test_fire_and_forget_err <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 43%] 2757s tests/test_client.py::test_quiet_client_close <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 43%] 2758s tests/test_client.py::test_quiet_client_close_when_cluster_is_closed_before_client <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 43%] 2758s tests/test_client.py::test_close <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 43%] 2760s tests/test_client.py::test_threadsafe <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 43%] 2772s tests/test_client.py::test_threadsafe_get <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 43%] 2782s tests/test_client.py::test_threadsafe_compute <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 43%] 2782s tests/test_client.py::test_identity <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 43%] 2783s tests/test_client.py::test_get_client <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 43%] 2783s tests/test_client.py::test_get_client_no_cluster <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 43%] 2783s tests/test_client.py::test_serialize_collections <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 43%] 2783s tests/test_client.py::test_secede_simple <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 43%] 2783s tests/test_client.py::test_secede_balances <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 43%] 2783s tests/test_client.py::test_long_running_not_in_occupancy[True] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 43%] 2783s tests/test_client.py::test_long_running_not_in_occupancy[False] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 44%] 2783s tests/test_client.py::test_long_running_removal_clean[True] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 44%] 2783s tests/test_client.py::test_long_running_removal_clean[False] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 44%] 2784s tests/test_client.py::test_sub_submit_priority <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 44%] 2786s tests/test_client.py::test_get_client_sync <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 44%] 2786s tests/test_client.py::test_serialize_collections_of_futures <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 44%] 2788s tests/test_client.py::test_serialize_collections_of_futures_sync <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 44%] 2791s tests/test_client.py::test_dynamic_workloads_sync <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 44%] 2796s tests/test_client.py::test_dynamic_workloads_sync_random <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 44%] 2796s tests/test_client.py::test_bytes_keys <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 44%] 2796s tests/test_client.py::test_unicode_ascii_keys <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 44%] 2796s tests/test_client.py::test_unicode_keys <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 44%] 2798s tests/test_client.py::test_use_synchronous_client_in_async_context <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 44%] 2799s tests/test_client.py::test_quiet_quit_when_cluster_leaves <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 44%] 2800s tests/test_client.py::test_call_stack_future <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 44%] 2801s tests/test_client.py::test_call_stack_all <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 44%] 2802s tests/test_client.py::test_call_stack_collections <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 44%] 2804s tests/test_client.py::test_call_stack_collections_all <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 44%] 2804s tests/test_client.py::test_profile <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 44%] 2805s tests/test_client.py::test_profile_disabled <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 44%] 2806s tests/test_client.py::test_profile_keys <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 44%] 2807s tests/test_client.py::test_client_with_name <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 44%] 2807s tests/test_client.py::test_client_async_before_loop_starts <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 44%] 2808s tests/test_client.py::test_nested_compute <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 44%] 2808s tests/test_client.py::test_task_metadata <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 44%] 2810s tests/test_client.py::test_logs <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 44%] 2811s tests/test_client.py::test_logs_from_worker_submodules <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 44%] 2812s tests/test_client.py::test_avoid_delayed_finalize <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 44%] 2812s tests/test_client.py::test_config_scheduler_address <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 44%] 2812s tests/test_client.py::test_warn_when_submitting_large_values <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 44%] 2812s tests/test_client.py::test_warn_when_submitting_large_values_memoryview <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 44%] 2812s tests/test_client.py::test_unhashable_function <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 44%] 2812s tests/test_client.py::test_client_name <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 44%] 2814s tests/test_client.py::test_client_doesnt_close_given_loop <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 44%] 2816s tests/test_client.py::test_quiet_scheduler_loss <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 44%] 2817s tests/test_client.py::test_dashboard_link <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 44%] 2817s tests/test_client.py::test_dashboard_link_inproc <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 44%] 2817s tests/test_client.py::test_client_timeout_2 <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 45%] 2818s tests/test_client.py::test_turn_off_pickle[True] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 45%] 2818s tests/test_client.py::test_turn_off_pickle[False] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 45%] 2818s tests/test_client.py::test_de_serialization <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 45%] 2818s tests/test_client.py::test_de_serialization_none <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 45%] 2818s tests/test_client.py::test_client_repr_closed <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 45%] 2818s tests/test_client.py::test_client_repr_closed_sync <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py SKIPPED [ 45%] 2818s tests/test_client.py::test_nested_prioritization <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py XPASS [ 45%] 2818s tests/test_client.py::test_scatter_error_cancel <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 45%] 2819s tests/test_client.py::test_scatter_and_replicate_avoid_paused_workers[False-False-False] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 45%] 2819s tests/test_client.py::test_scatter_and_replicate_avoid_paused_workers[False-False-True] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 45%] 2819s tests/test_client.py::test_scatter_and_replicate_avoid_paused_workers[False-True-False] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 45%] 2819s tests/test_client.py::test_scatter_and_replicate_avoid_paused_workers[False-True-True] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 45%] 2820s tests/test_client.py::test_scatter_and_replicate_avoid_paused_workers[True-False-False] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 45%] 2820s tests/test_client.py::test_scatter_and_replicate_avoid_paused_workers[True-False-True] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 45%] 2820s tests/test_client.py::test_scatter_and_replicate_avoid_paused_workers[True-True-False] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 45%] 2821s tests/test_client.py::test_scatter_and_replicate_avoid_paused_workers[True-True-True] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 45%] 2821s tests/test_client.py::test_scatter_and_replicate_avoid_paused_workers[10-False-False] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 45%] 2821s tests/test_client.py::test_scatter_and_replicate_avoid_paused_workers[10-False-True] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 45%] 2822s tests/test_client.py::test_scatter_and_replicate_avoid_paused_workers[10-True-False] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 45%] 2822s tests/test_client.py::test_scatter_and_replicate_avoid_paused_workers[10-True-True] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 45%] 2822s tests/test_client.py::test_no_threads_lingering <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py XPASS [ 45%] 2822s tests/test_client.py::test_direct_async <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 45%] 2824s tests/test_client.py::test_direct_sync <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 45%] 2824s tests/test_client.py::test_mixing_clients_same_scheduler <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 45%] 2824s tests/test_client.py::test_mixing_clients_different_scheduler <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 45%] 2824s tests/test_client.py::test_tuple_keys <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 45%] 2824s tests/test_client.py::test_multiple_scatter <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 45%] 2824s tests/test_client.py::test_map_large_kwargs_in_graph <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 45%] 2824s tests/test_client.py::test_retry <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 45%] 2825s tests/test_client.py::test_retry_dependencies <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 45%] 2825s tests/test_client.py::test_released_dependencies <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 45%] 2825s tests/test_client.py::test_profile_bokeh <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py SKIPPED [ 45%] 2825s tests/test_client.py::test_get_mix_futures_and_SubgraphCallable <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 45%] 2825s tests/test_client.py::test_get_mix_futures_and_SubgraphCallable_dask_dataframe <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 45%] 2827s tests/test_client.py::test_direct_to_workers <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 45%] 2827s tests/test_client.py::test_instances <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 46%] 2827s tests/test_client.py::test_wait_for_workers <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 46%] 2828s tests/test_client.py::test_file_descriptors_dont_leak[Worker] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 46%] 2831s tests/test_client.py::test_file_descriptors_dont_leak[Nanny] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 46%] 2831s tests/test_client.py::test_dashboard_link_cluster <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 46%] 2831s tests/test_client.py::test_shutdown <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 46%] 2831s tests/test_client.py::test_shutdown_localcluster <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 46%] 2831s tests/test_client.py::test_shutdown_stops_callbacks <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 46%] 2832s tests/test_client.py::test_shutdown_is_quiet_with_cluster <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 46%] 2832s tests/test_client.py::test_client_is_quiet_cluster_close <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 46%] 2833s tests/test_client.py::test_config_inherited_by_subprocess <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 46%] 2833s tests/test_client.py::test_futures_of_sorted <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 46%] 2835s tests/test_client.py::test_profile_server <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 46%] 2837s tests/test_client.py::test_profile_server_disabled <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 46%] 2837s tests/test_client.py::test_await_future <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 46%] 2837s tests/test_client.py::test_as_completed_async_for <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 46%] 2837s tests/test_client.py::test_as_completed_async_for_results <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 46%] 2837s tests/test_client.py::test_as_completed_async_for_cancel <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 46%] 2837s tests/test_client.py::test_async_with <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 46%] 2839s tests/test_client.py::test_client_sync_with_async_def <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 46%] 2839s tests/test_client.py::test_dont_hold_on_to_large_messages <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py SKIPPED [ 46%] 2839s tests/test_client.py::test_run_on_scheduler_async_def <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 46%] 2839s tests/test_client.py::test_run_on_scheduler_async_def_wait <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 46%] 2839s tests/test_client.py::test_performance_report[True] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py SKIPPED [ 46%] 2839s tests/test_client.py::test_performance_report[False] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py SKIPPED [ 46%] 2839s tests/test_client.py::test_as_completed_condition_loop <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 46%] 2842s tests/test_client.py::test_mixed_compression <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 46%] 2844s tests/test_client.py::test_futures_in_subgraphs <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 46%] 2844s tests/test_client.py::test_get_task_metadata <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 46%] 2844s tests/test_client.py::test_get_task_metadata_multiple <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 46%] 2844s tests/test_client.py::test_register_worker_plugin_instance_required <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 46%] 2845s tests/test_client.py::test_register_worker_plugin_exception <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 46%] 2845s tests/test_client.py::test_annotations_task_state <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 46%] 2845s tests/test_client.py::test_annotations_compute_time[compute] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 46%] 2845s tests/test_client.py::test_annotations_compute_time[persist] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 46%] 2845s tests/test_client.py::test_annotations_survive_optimization <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py XFAIL [ 46%] 2845s tests/test_client.py::test_annotations_priorities <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 47%] 2845s tests/test_client.py::test_annotations_workers <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 47%] 2845s tests/test_client.py::test_annotations_retries <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 47%] 2846s tests/test_client.py::test_annotations_blockwise_unpack <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 47%] 2846s tests/test_client.py::test_annotations_resources <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 47%] 2846s tests/test_client.py::test_annotations_resources_culled <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 47%] 2846s tests/test_client.py::test_annotations_loose_restrictions <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 47%] 2846s tests/test_client.py::test_annotations_submit_map <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 47%] 2846s tests/test_client.py::test_annotations_global_vs_local <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 47%] 2846s tests/test_client.py::test_workers_collection_restriction <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 47%] 2846s tests/test_client.py::test_get_client_functions_spawn_clusters <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py SKIPPED [ 47%] 2846s tests/test_client.py::test_computation_code_walk_frames <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 47%] 2849s tests/test_client.py::test_computation_ignore_ipython_frames[2] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 47%] 2852s tests/test_client.py::test_computation_ignore_ipython_frames[3] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 47%] 2852s tests/test_client.py::test_computation_store_annotations <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 47%] 2854s tests/test_client.py::test_computation_object_code_dask_compute <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 47%] 2855s tests/test_client.py::test_computation_object_code_dask_compute_no_frames_default <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 47%] 2857s tests/test_client.py::test_computation_object_code_not_available <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py SKIPPED [ 47%] 2857s tests/test_client.py::test_computation_object_code_dask_persist <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 47%] 2857s tests/test_client.py::test_computation_object_code_client_submit_simple <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 47%] 2857s tests/test_client.py::test_computation_object_code_client_submit_list_comp <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 47%] 2858s tests/test_client.py::test_computation_object_code_client_submit_dict_comp <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 47%] 2858s tests/test_client.py::test_computation_object_code_client_map <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 47%] 2858s tests/test_client.py::test_computation_object_code_client_compute <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 47%] 2861s tests/test_client.py::test_upload_directory <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 47%] 2861s tests/test_client.py::test_duck_typed_register_plugin_raises <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 47%] 2862s tests/test_client.py::test_exception_text <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 47%] 2862s tests/test_client.py::test_async_task <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 47%] 2862s tests/test_client.py::test_async_task_with_partial <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 47%] 2862s tests/test_client.py::test_warn_manual <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 47%] 2862s tests/test_client.py::test_warn_remote <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 47%] 2863s tests/test_client.py::test_print_remote <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 47%] 2865s tests/test_client.py::test_print_manual <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 47%] 2866s tests/test_client.py::test_print_manual_bad_args <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 47%] 2867s tests/test_client.py::test_print_non_msgpack_serializable <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 47%] 2867s tests/test_client.py::test_print_local <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 47%] 2869s tests/test_client.py::test_forward_logging <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 48%] 2871s tests/test_client.py::test_dump_cluster_state_write_from_scheduler <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 48%] 2872s tests/test_client.py::test_dump_cluster_state_sync[msgpack-True] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 48%] 2874s tests/test_client.py::test_dump_cluster_state_sync[msgpack-False] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 48%] 2876s tests/test_client.py::test_dump_cluster_state_sync[yaml-True] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 48%] 2878s tests/test_client.py::test_dump_cluster_state_sync[yaml-False] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 48%] 2878s tests/test_client.py::test_dump_cluster_state_async[msgpack-True] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 48%] 2878s tests/test_client.py::test_dump_cluster_state_async[msgpack-False] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 48%] 2878s tests/test_client.py::test_dump_cluster_state_async[yaml-True] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 48%] 2879s tests/test_client.py::test_dump_cluster_state_async[yaml-False] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 48%] 2879s tests/test_client.py::test_dump_cluster_state_json[True] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 48%] 2879s tests/test_client.py::test_dump_cluster_state_json[False] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 48%] 2880s tests/test_client.py::test_dump_cluster_state_exclude_default <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 48%] 2880s tests/test_client.py::TestClientSecurityLoader::test_security_loader <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 48%] 2880s tests/test_client.py::TestClientSecurityLoader::test_security_loader_ignored_if_explicit_security_provided <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 48%] 2880s tests/test_client.py::TestClientSecurityLoader::test_security_loader_ignored_if_returns_none <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 48%] 2880s tests/test_client.py::TestClientSecurityLoader::test_security_loader_import_failed <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 48%] 2880s tests/test_client.py::test_benchmark_hardware_no_workers <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 48%] 2880s tests/test_client.py::test_wait_for_workers_updates_info <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 48%] 2882s tests/test_client.py::test_quiet_close_process[True] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 48%] 2888s tests/test_client.py::test_quiet_close_process[False] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py RERUN [ 48%] 2889s tests/test_client.py::test_quiet_close_process[False] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 48%] 2889s tests/test_client.py::test_deprecated_loop_properties <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 48%] 2889s tests/test_client.py::test_fast_close_on_aexit_failure <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 48%] 2889s tests/test_client.py::test_wait_for_workers_n_workers_value_check[None-ValueError] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 48%] 2889s tests/test_client.py::test_wait_for_workers_n_workers_value_check[0-ValueError] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 48%] 2889s tests/test_client.py::test_wait_for_workers_n_workers_value_check[1.0-ValueError] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 48%] 2889s tests/test_client.py::test_wait_for_workers_n_workers_value_check[1-None] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 48%] 2889s tests/test_client.py::test_wait_for_workers_n_workers_value_check[2-None] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 48%] 2890s tests/test_client.py::test_unpacks_remotedata_namedtuple[PlainNamedTuple-args0-kwargs0] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 48%] 2890s tests/test_client.py::test_unpacks_remotedata_namedtuple[NewArgsNamedTuple-args1-kwargs1] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 48%] 2890s tests/test_client.py::test_unpacks_remotedata_namedtuple[NewArgsExNamedTuple-args2-kwargs2] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 48%] 2890s tests/test_client.py::test_resolves_future_in_namedtuple[PlainNamedTuple-args0-kwargs0] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 48%] 2890s tests/test_client.py::test_resolves_future_in_namedtuple[NewArgsNamedTuple-args1-kwargs1] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 48%] 2890s tests/test_client.py::test_resolves_future_in_namedtuple[NewArgsExNamedTuple-args2-kwargs2] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 48%] 2890s tests/test_client.py::test_resolves_future_in_dict <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 48%] 2890s tests/test_client.py::test_gather_race_vs_AMM[False] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 48%] 2891s tests/test_client.py::test_gather_race_vs_AMM[True] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 48%] 2893s tests/test_client.py::test_client_disconnect_exception_on_cancelled_futures <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 49%] 2896s tests/test_client.py::test_scheduler_restart_exception_on_cancelled_futures <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 49%] 2896s tests/test_client.py::test_release_persisted_collection <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 49%] 2897s tests/test_client.py::test_release_persisted_collection_sync <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 49%] 2899s tests/test_client.py::test_worker_clients_do_not_claim_ownership_of_serialize_futures[True] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 49%] 2901s tests/test_client.py::test_worker_clients_do_not_claim_ownership_of_serialize_futures[False] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 49%] 2902s tests/test_client_executor.py::test_submit <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client_executor.py PASSED [ 49%] 2904s tests/test_client_executor.py::test_as_completed <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client_executor.py PASSED [ 49%] 2905s tests/test_client_executor.py::test_wait <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client_executor.py PASSED [ 49%] 2907s tests/test_client_executor.py::test_cancellation <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client_executor.py PASSED [ 49%] 2909s tests/test_client_executor.py::test_cancellation_wait <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client_executor.py PASSED [ 49%] 2913s tests/test_client_executor.py::test_cancellation_as_completed <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client_executor.py PASSED [ 49%] 2915s tests/test_client_executor.py::test_map <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client_executor.py PASSED [ 49%] 2917s tests/test_client_executor.py::test_pure <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client_executor.py PASSED [ 49%] 2919s tests/test_client_executor.py::test_workers <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client_executor.py PASSED [ 49%] 2920s tests/test_client_executor.py::test_unsupported_arguments <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client_executor.py PASSED [ 49%] 2922s tests/test_client_executor.py::test_retries <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client_executor.py PASSED [ 49%] 2924s tests/test_client_executor.py::test_shutdown_wait <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client_executor.py PASSED [ 49%] 2926s tests/test_client_executor.py::test_shutdown_nowait <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client_executor.py PASSED [ 49%] 2926s tests/test_client_loop.py::test_close_loop_sync_start_new_loop <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client_loop.py PASSED [ 49%] 2926s tests/test_client_loop.py::test_close_loop_sync_use_running_loop <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_client_loop.py PASSED [ 49%] 2926s tests/test_cluster_dump.py::test_tuple_to_list[input0-expected0] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_cluster_dump.py PASSED [ 49%] 2926s tests/test_cluster_dump.py::test_tuple_to_list[input1-expected1] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_cluster_dump.py PASSED [ 49%] 2926s tests/test_cluster_dump.py::test_tuple_to_list[input2-expected2] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_cluster_dump.py PASSED [ 49%] 2926s tests/test_cluster_dump.py::test_tuple_to_list[foo-foo] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_cluster_dump.py PASSED [ 49%] 2926s tests/test_cluster_dump.py::test_write_state_msgpack <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_cluster_dump.py PASSED [ 49%] 2926s tests/test_cluster_dump.py::test_write_state_yaml <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_cluster_dump.py PASSED [ 49%] 2926s tests/test_cluster_dump.py::test_cluster_dump_state <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_cluster_dump.py PASSED [ 49%] 2926s tests/test_cluster_dump.py::test_cluster_dump_story <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_cluster_dump.py PASSED [ 49%] 2927s tests/test_cluster_dump.py::test_cluster_dump_to_yamls <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_cluster_dump.py PASSED [ 49%] 2927s tests/test_collections.py::test_lru <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_collections.py PASSED [ 49%] 2927s tests/test_collections.py::test_heapset <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_collections.py PASSED [ 49%] 2927s tests/test_collections.py::test_heapset_sorted_flag_left <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_collections.py PASSED [ 49%] 2927s tests/test_collections.py::test_heapset_sorted_flag_right <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_collections.py PASSED [ 49%] 2927s tests/test_collections.py::test_heapset_popright[False] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_collections.py PASSED [ 49%] 2927s tests/test_collections.py::test_heapset_popright[True] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_collections.py PASSED [ 49%] 2927s tests/test_collections.py::test_heapset_pickle <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_collections.py PASSED [ 50%] 2927s tests/test_collections.py::test_heapset_sort_duplicate <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_collections.py PASSED [ 50%] 2927s tests/test_collections.py::test_sum_mappings <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_collections.py PASSED [ 50%] 2927s tests/test_compatibility.py::test_randbytes <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_compatibility.py PASSED [ 50%] 2927s tests/test_compatibility.py::test_randbytes_seed <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_compatibility.py PASSED [ 50%] 2927s tests/test_computations.py::test_computations <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_computations.py PASSED [ 50%] 2927s tests/test_computations.py::test_computations_futures <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_computations.py PASSED [ 50%] 2927s tests/test_computations.py::test_computations_no_workers <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_computations.py PASSED [ 50%] 2927s tests/test_computations.py::test_computations_no_resources <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_computations.py PASSED [ 50%] 2927s tests/test_computations.py::test_computations_long_running <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_computations.py PASSED [ 50%] 2927s tests/test_config.py::test_logging_default[config0] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_config.py PASSED [ 50%] 2927s tests/test_config.py::test_logging_default[None] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_config.py PASSED [ 50%] 2928s tests/test_config.py::test_logging_simple_under_distributed <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_config.py PASSED [ 50%] 2929s tests/test_config.py::test_logging_simple <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_config.py PASSED [ 50%] 2931s tests/test_config.py::test_logging_extended <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_config.py PASSED [ 50%] 2931s tests/test_config.py::test_default_logging_does_not_override_basic_config <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_config.py PASSED [ 50%] 2932s tests/test_config.py::test_basic_config_does_not_override_default_logging <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_config.py PASSED [ 50%] 2932s tests/test_config.py::test_logging_mutual_exclusive <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_config.py PASSED [ 50%] 2932s tests/test_config.py::test_logging_file_config <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_config.py PASSED [ 50%] 2932s tests/test_config.py::test_schema <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_config.py PASSED [ 50%] 2932s tests/test_config.py::test_schema_is_complete <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_config.py PASSED [ 50%] 2933s tests/test_config.py::test_uvloop_event_loop <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_config.py SKIPPED [ 50%] 2933s tests/test_config.py::test_deprecations_on_set[args0-kwargs0] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_config.py PASSED [ 50%] 2933s tests/test_config.py::test_deprecations_on_set[args1-kwargs1] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_config.py PASSED [ 50%] 2933s tests/test_config.py::test_deprecations_on_set[args2-kwargs2] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_config.py PASSED [ 50%] 2933s tests/test_config.py::test_deprecations_on_env_variables <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_config.py PASSED [ 50%] 2933s tests/test_config.py::test_deprecations_on_yaml[allowed-failures] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_config.py PASSED [ 50%] 2933s tests/test_config.py::test_deprecations_on_yaml[allowed_failures] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_config.py PASSED [ 50%] 2933s tests/test_core.py::test_server_status_is_always_enum <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_core.py PASSED [ 50%] 2933s tests/test_core.py::test_server_assign_assign_enum_is_quiet <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_core.py PASSED [ 50%] 2933s tests/test_core.py::test_server_status_compare_enum_is_quiet <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_core.py PASSED [ 50%] 2933s tests/test_core.py::test_server_close_stops_gil_monitoring <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_core.py SKIPPED [ 50%] 2933s tests/test_core.py::test_server <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_core.py PASSED [ 50%] 2933s tests/test_core.py::test_server_raises_on_blocked_handlers <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_core.py PASSED [ 50%] 2934s tests/test_core.py::test_server_listen <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_core.py PASSED [ 50%] 2934s tests/test_core.py::test_rpc_default <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_core.py PASSED [ 50%] 2934s tests/test_core.py::test_rpc_tcp <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_core.py PASSED [ 51%] 2934s tests/test_core.py::test_rpc_tls <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_core.py PASSED [ 51%] 2934s tests/test_core.py::test_rpc_inproc <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_core.py PASSED [ 51%] 2934s tests/test_core.py::test_rpc_inputs <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_core.py PASSED [ 51%] 2934s tests/test_core.py::test_rpc_message_lifetime_default <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_core.py PASSED [ 51%] 2934s tests/test_core.py::test_rpc_message_lifetime_tcp <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_core.py PASSED [ 51%] 2934s tests/test_core.py::test_rpc_message_lifetime_inproc <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_core.py PASSED [ 51%] 2934s tests/test_core.py::test_rpc_with_many_connections_tcp <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_core.py PASSED [ 51%] 2934s tests/test_core.py::test_rpc_with_many_connections_inproc <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_core.py PASSED [ 51%] 2937s tests/test_core.py::test_large_packets_tcp <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_core.py PASSED [ 51%] 2937s tests/test_core.py::test_large_packets_inproc <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_core.py PASSED [ 51%] 2937s tests/test_core.py::test_identity_tcp <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_core.py PASSED [ 51%] 2937s tests/test_core.py::test_identity_inproc <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_core.py PASSED [ 51%] 2937s tests/test_core.py::test_ports <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_core.py PASSED [ 51%] 2937s tests/test_core.py::test_errors <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_core.py PASSED [ 51%] 2937s tests/test_core.py::test_connect_raises <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_core.py PASSED [ 51%] 2937s tests/test_core.py::test_send_recv_args <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_core.py PASSED [ 51%] 2937s tests/test_core.py::test_send_recv_cancelled <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_core.py PASSED [ 51%] 2937s tests/test_core.py::test_coerce_to_address <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_core.py PASSED [ 51%] 2938s tests/test_core.py::test_connection_pool <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_core.py PASSED [ 51%] 2938s tests/test_core.py::test_connection_pool_close_while_connecting <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_core.py PASSED [ 51%] 2938s tests/test_core.py::test_connection_pool_outside_cancellation <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_core.py PASSED [ 51%] 2944s tests/test_core.py::test_connection_pool_catch_all_cancellederrors <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_core.py PASSED [ 51%] 2944s tests/test_core.py::test_remove_cancels_connect_attempts <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_core.py PASSED [ 51%] 2944s tests/test_core.py::test_remove_cancels_connect_before_task_running <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_core.py PASSED [ 51%] 2944s tests/test_core.py::test_connection_pool_respects_limit <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_core.py PASSED [ 51%] 2944s tests/test_core.py::test_connection_pool_tls <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_core.py PASSED [ 51%] 2944s tests/test_core.py::test_connection_pool_remove <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_core.py PASSED [ 51%] 2944s tests/test_core.py::test_counters <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_core.py PASSED [ 51%] 2944s tests/test_core.py::test_ticks <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_core.py SKIPPED [ 51%] 2944s tests/test_core.py::test_tick_logging <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_core.py SKIPPED [ 51%] 2944s tests/test_core.py::test_compression[echo_serialize-None] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_core.py PASSED [ 51%] 2945s tests/test_core.py::test_compression[echo_serialize-False] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_core.py PASSED [ 51%] 2945s tests/test_core.py::test_compression[echo_serialize-auto] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_core.py PASSED [ 51%] 2945s tests/test_core.py::test_compression[echo_serialize-zlib] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_core.py PASSED [ 51%] 2945s tests/test_core.py::test_compression[echo_serialize-lz4] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_core.py PASSED [ 51%] 2945s tests/test_core.py::test_compression[echo_no_serialize-None] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_core.py PASSED [ 52%] 2945s tests/test_core.py::test_compression[echo_no_serialize-False] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_core.py PASSED [ 52%] 2945s tests/test_core.py::test_compression[echo_no_serialize-auto] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_core.py PASSED [ 52%] 2945s tests/test_core.py::test_compression[echo_no_serialize-zlib] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_core.py PASSED [ 52%] 2945s tests/test_core.py::test_compression[echo_no_serialize-lz4] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_core.py PASSED [ 52%] 2945s tests/test_core.py::test_rpc_serialization <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_core.py PASSED [ 52%] 2945s tests/test_core.py::test_rpc_closed_exception <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_core.py PASSED [ 52%] 2945s tests/test_core.py::test_thread_id <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_core.py PASSED [ 52%] 2945s tests/test_core.py::test_deserialize_error <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_core.py PASSED [ 52%] 2945s tests/test_core.py::test_connection_pool_detects_remote_close <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_core.py PASSED [ 52%] 2946s tests/test_core.py::test_close_properly <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_core.py PASSED [ 52%] 2946s tests/test_core.py::test_server_redundant_kwarg <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_core.py PASSED [ 52%] 2946s tests/test_core.py::test_server_comms_mark_active_handlers <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_core.py PASSED [ 52%] 2946s tests/test_core.py::test_server_sys_path_local_directory_cleanup <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_core.py PASSED [ 52%] 2946s tests/test_core.py::test_close_fast_without_active_handlers[True] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_core.py PASSED [ 52%] 2946s tests/test_core.py::test_close_fast_without_active_handlers[False] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_core.py PASSED [ 52%] 2947s tests/test_core.py::test_close_grace_period_for_handlers <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_core.py PASSED [ 52%] 2947s tests/test_core.py::test_expects_comm <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_core.py PASSED [ 52%] 2947s tests/test_core.py::test_async_listener_stop <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_core.py PASSED [ 52%] 2947s tests/test_core.py::test_messages_are_ordered_bsend <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_core.py PASSED [ 52%] 2948s tests/test_core.py::test_messages_are_ordered_raw <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_core.py PASSED [ 52%] 2959s tests/test_core.py::test_large_payload <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_core.py PASSED [ 52%] 2959s tests/test_counter.py::test_digest[Counter-] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_counter.py PASSED [ 52%] 2959s tests/test_counter.py::test_digest[None-] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_counter.py SKIPPED [ 52%] 2959s tests/test_counter.py::test_counter <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_counter.py PASSED [ 52%] 2960s tests/test_dask_collections.py::test_dataframes <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_dask_collections.py PASSED [ 52%] 2960s tests/test_dask_collections.py::test_dask_array_collections <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_dask_collections.py PASSED [ 52%] 2960s tests/test_dask_collections.py::test_bag_groupby_tasks_default <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_dask_collections.py PASSED [ 52%] 2963s tests/test_dask_collections.py::test_bag_groupby_key_hashing <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_dask_collections.py PASSED [ 52%] 2966s tests/test_dask_collections.py::test_dataframe_set_index_sync[wait] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_dask_collections.py PASSED [ 52%] 2968s tests/test_dask_collections.py::test_dataframe_set_index_sync[] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_dask_collections.py PASSED [ 52%] 2970s tests/test_dask_collections.py::test_loc_sync <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_dask_collections.py PASSED [ 52%] 2973s tests/test_dask_collections.py::test_rolling_sync <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_dask_collections.py PASSED [ 52%] 2973s tests/test_dask_collections.py::test_loc <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_dask_collections.py PASSED [ 52%] 2977s tests/test_dask_collections.py::test_dataframe_groupby_tasks <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_dask_collections.py PASSED [ 52%] 2977s tests/test_dask_collections.py::test_sparse_arrays <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_dask_collections.py SKIPPED [ 52%] 2977s tests/test_dask_collections.py::test_delayed_none <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_dask_collections.py PASSED [ 52%] 2979s tests/test_dask_collections.py::test_tuple_futures_arg[tuple] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_dask_collections.py PASSED [ 53%] 2981s tests/test_dask_collections.py::test_tuple_futures_arg[list] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_dask_collections.py PASSED [ 53%] 2981s tests/test_deadline.py::test_deadline <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_deadline.py PASSED [ 53%] 2981s tests/test_deadline.py::test_infinite_deadline <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_deadline.py PASSED [ 53%] 2981s tests/test_deadline.py::test_deadline_progress <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_deadline.py PASSED [ 53%] 2981s tests/test_deadline.py::test_deadline_expiration <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_deadline.py PASSED [ 53%] 2982s tests/test_deadline.py::test_deadline_expiration_async <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_deadline.py PASSED [ 53%] 2983s tests/test_diskutils.py::test_workdir_simple <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_diskutils.py PASSED [ 53%] 2985s tests/test_diskutils.py::test_two_workspaces_in_same_directory <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_diskutils.py PASSED [ 53%] 2986s tests/test_diskutils.py::test_workspace_process_crash <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_diskutils.py PASSED [ 53%] 2986s tests/test_diskutils.py::test_workspace_rmtree_failure <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_diskutils.py PASSED [ 53%] 2987s tests/test_diskutils.py::test_locking_disabled <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_diskutils.py PASSED [ 53%] 3003s tests/test_diskutils.py::test_workspace_concurrency <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_diskutils.py PASSED [ 53%] 3003s tests/test_diskutils.py::test_unwritable_base_dir <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_diskutils.py PASSED [ 53%] 3003s tests/test_event_logging.py::test_log_event <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_event_logging.py PASSED [ 53%] 3003s tests/test_event_logging.py::test_log_events <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_event_logging.py PASSED [ 53%] 3003s tests/test_event_logging.py::test_log_event_e2e <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_event_logging.py PASSED [ 53%] 3003s tests/test_event_logging.py::test_log_event_multiple_clients <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_event_logging.py PASSED [ 53%] 3003s tests/test_event_logging.py::test_events_subscribe_topic <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_event_logging.py PASSED [ 53%] 3003s tests/test_event_logging.py::test_events_subscribe_topic_cancelled <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_event_logging.py PASSED [ 53%] 3003s tests/test_event_logging.py::test_topic_subscribe_unsubscribe <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_event_logging.py PASSED [ 53%] 3004s tests/test_event_logging.py::test_events_all_servers_use_same_channel <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_event_logging.py PASSED [ 53%] 3004s tests/test_event_logging.py::test_events_unsubscribe_raises_if_unknown <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_event_logging.py PASSED [ 53%] 3006s tests/test_event_logging.py::test_log_event_msgpack <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_event_logging.py PASSED [ 53%] 3006s tests/test_event_logging.py::test_configurable_events_log_length <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_event_logging.py PASSED [ 53%] 3007s tests/test_event_logging.py::test_log_event_on_nanny <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_event_logging.py PASSED [ 53%] 3007s tests/test_event_logging.py::test_log_event_on_worker <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_event_logging.py PASSED [ 53%] 3007s tests/test_event_logging.py::test_log_event_plugin <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_event_logging.py PASSED [ 53%] 3007s tests/test_event_logging.py::test_log_event_plugin_multiple_topics <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_event_logging.py PASSED [ 53%] 3008s tests/test_events.py::test_event_on_workers <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_events.py PASSED [ 53%] 3008s tests/test_events.py::test_default_event <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_events.py PASSED [ 53%] 3008s tests/test_events.py::test_set_not_set <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_events.py PASSED [ 53%] 3008s tests/test_events.py::test_set_not_set_many_events <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_events.py PASSED [ 53%] 3008s tests/test_events.py::test_timeout <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_events.py PASSED [ 53%] 3010s tests/test_events.py::test_event_sync <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_events.py PASSED [ 53%] 3010s tests/test_events.py::test_event_types <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_events.py PASSED [ 53%] 3010s tests/test_events.py::test_serializable <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_events.py PASSED [ 54%] 3011s tests/test_events.py::test_two_events_on_workers <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_events.py PASSED [ 54%] 3011s tests/test_events.py::test_unpickle_without_client <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_events.py PASSED [ 54%] 3013s tests/test_failed_workers.py::test_submit_after_failed_worker_sync <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_failed_workers.py PASSED [ 54%] 3013s tests/test_failed_workers.py::test_submit_after_failed_worker_async[False-False-closing] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_failed_workers.py PASSED [ 54%] 3013s tests/test_failed_workers.py::test_submit_after_failed_worker_async[False-False-closed] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_failed_workers.py PASSED [ 54%] 3013s tests/test_failed_workers.py::test_submit_after_failed_worker_async[False-True-closing] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_failed_workers.py PASSED [ 54%] 3013s tests/test_failed_workers.py::test_submit_after_failed_worker_async[False-True-closed] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_failed_workers.py PASSED [ 54%] 3013s tests/test_failed_workers.py::test_submit_after_failed_worker_async[True-False-closing] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_failed_workers.py PASSED [ 54%] 3014s tests/test_failed_workers.py::test_submit_after_failed_worker_async[True-False-closed] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_failed_workers.py PASSED [ 54%] 3014s tests/test_failed_workers.py::test_submit_after_failed_worker_async[True-True-closing] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_failed_workers.py PASSED [ 54%] 3014s tests/test_failed_workers.py::test_submit_after_failed_worker_async[True-True-closed] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_failed_workers.py PASSED [ 54%] 3014s tests/test_failed_workers.py::test_submit_after_failed_worker <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_failed_workers.py PASSED [ 54%] 3016s tests/test_failed_workers.py::test_gather_after_failed_worker <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_failed_workers.py PASSED [ 54%] 3019s tests/test_failed_workers.py::test_gather_then_submit_after_failed_workers <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_failed_workers.py PASSED [ 54%] 3022s tests/test_failed_workers.py::test_restart <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_failed_workers.py PASSED [ 54%] 3025s tests/test_failed_workers.py::test_restart_cleared <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_failed_workers.py PASSED [ 54%] 3029s tests/test_failed_workers.py::test_restart_sync <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_failed_workers.py PASSED [ 54%] 3035s tests/test_failed_workers.py::test_worker_doesnt_await_task_completion <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_failed_workers.py PASSED [ 54%] 3039s tests/test_failed_workers.py::test_multiple_clients_restart <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_failed_workers.py PASSED [ 54%] 3041s tests/test_failed_workers.py::test_restart_scheduler <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_failed_workers.py PASSED [ 54%] 3044s tests/test_failed_workers.py::test_forgotten_futures_dont_clean_up_new_futures <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_failed_workers.py PASSED [ 54%] 3052s tests/test_failed_workers.py::test_broken_worker_during_computation <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_failed_workers.py PASSED [ 54%] 3055s tests/test_failed_workers.py::test_restart_during_computation <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_failed_workers.py PASSED [ 54%] 3058s tests/test_failed_workers.py::test_worker_who_has_clears_after_failed_connection <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_failed_workers.py PASSED [ 54%] 3058s tests/test_failed_workers.py::test_worker_same_host_replicas_missing <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_failed_workers.py PASSED [ 54%] 3065s tests/test_failed_workers.py::test_restart_timeout_on_long_running_task <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_failed_workers.py PASSED [ 54%] 3070s tests/test_failed_workers.py::test_worker_time_to_live <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_failed_workers.py PASSED [ 54%] 3078s tests/test_failed_workers.py::test_worker_ttl_restarts_worker[False] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_failed_workers.py PASSED [ 54%] 3089s tests/test_failed_workers.py::test_worker_ttl_restarts_worker[True] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_failed_workers.py PASSED [ 54%] 3096s tests/test_failed_workers.py::test_restart_hung_worker <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_failed_workers.py PASSED [ 54%] 3096s tests/test_failed_workers.py::test_forget_data_not_supposed_to_have <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_failed_workers.py PASSED [ 54%] 3098s tests/test_failed_workers.py::test_failing_worker_with_additional_replicas_on_cluster <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_failed_workers.py PASSED [ 54%] 3098s tests/test_gc.py::test_fractional_timer <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_gc.py PASSED [ 54%] 3117s tests/test_gc.py::test_gc_diagnosis_cpu_time <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_gc.py PASSED [ 54%] 3121s tests/test_gc.py::test_gc_diagnosis_rss_win <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_gc.py XFAIL [ 54%] 3122s tests/test_imports.py::test_can_import_distributed_in_background_thread <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_imports.py PASSED [ 55%] 3122s tests/test_init.py::test_version <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_init.py PASSED [ 55%] 3122s tests/test_itertools.py::test_ffill <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_itertools.py PASSED [ 55%] 3124s tests/test_jupyter.py::test_jupyter_cli <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_jupyter.py PASSED [ 55%] 3124s tests/test_locks.py::test_lock <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_locks.py PASSED [ 55%] 3125s tests/test_locks.py::test_timeout <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_locks.py PASSED [ 55%] 3125s tests/test_locks.py::test_acquires_with_zero_timeout <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_locks.py PASSED [ 55%] 3125s tests/test_locks.py::test_acquires_blocking <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_locks.py PASSED [ 55%] 3126s tests/test_locks.py::test_timeout_sync <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_locks.py PASSED [ 55%] 3127s tests/test_locks.py::test_errors <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_locks.py PASSED [ 55%] 3128s tests/test_locks.py::test_lock_sync <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_locks.py PASSED [ 55%] 3129s tests/test_locks.py::test_lock_types <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_locks.py PASSED [ 55%] 3129s tests/test_locks.py::test_serializable <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_locks.py PASSED [ 55%] 3129s tests/test_locks.py::test_serializable_no_ctx <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_locks.py PASSED [ 55%] 3129s tests/test_locks.py::test_locks <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_locks.py PASSED [ 55%] 3129s tests/test_locks.py::test_locks_inf_lease_timeout <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_locks.py PASSED [ 55%] 3129s tests/test_metrics.py::test_wall_clock[time] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_metrics.py PASSED [ 55%] 3129s tests/test_metrics.py::test_wall_clock[monotonic] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_metrics.py PASSED [ 55%] 3129s tests/test_metrics.py::test_monotonic <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_metrics.py SKIPPED [ 55%] 3129s tests/test_metrics.py::test_meter <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_metrics.py PASSED [ 55%] 3129s tests/test_metrics.py::test_meter_raise <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_metrics.py PASSED [ 55%] 3129s tests/test_metrics.py::test_meter_floor[kwargs0-0] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_metrics.py PASSED [ 55%] 3129s tests/test_metrics.py::test_meter_floor[kwargs1-0.1] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_metrics.py PASSED [ 55%] 3129s tests/test_metrics.py::test_meter_floor[kwargs2--1] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_metrics.py PASSED [ 55%] 3129s tests/test_metrics.py::test_context_meter <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_metrics.py PASSED [ 55%] 3129s tests/test_metrics.py::test_context_meter_raise <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_metrics.py PASSED [ 55%] 3129s tests/test_metrics.py::test_context_meter_nested <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_metrics.py PASSED [ 55%] 3129s tests/test_metrics.py::test_context_meter_decorator <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_metrics.py PASSED [ 55%] 3129s tests/test_metrics.py::test_context_meter_nested_floor <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_metrics.py PASSED [ 55%] 3129s tests/test_metrics.py::test_context_meter_pickle <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_metrics.py PASSED [ 55%] 3129s tests/test_metrics.py::test_context_meter_clear_callbacks <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_metrics.py PASSED [ 55%] 3129s tests/test_metrics.py::test_context_meter_clear_callbacks_raises <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_metrics.py PASSED [ 55%] 3129s tests/test_metrics.py::test_context_meter_allow_offload <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_metrics.py PASSED [ 55%] 3129s tests/test_metrics.py::test_delayed_metrics_ledger <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_metrics.py PASSED [ 55%] 3129s tests/test_metrics.py::test_context_meter_keyed <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_metrics.py PASSED [ 55%] 3129s tests/test_metrics.py::test_delayed_metrics_ledger_keyed <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_metrics.py PASSED [ 55%] 3130s tests/test_multi_locks.py::test_single_lock <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_multi_locks.py PASSED [ 56%] 3130s tests/test_multi_locks.py::test_timeout <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_multi_locks.py PASSED [ 56%] 3131s tests/test_multi_locks.py::test_timeout_wake_waiter <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_multi_locks.py PASSED [ 56%] 3131s tests/test_multi_locks.py::test_multiple_locks <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_multi_locks.py PASSED [ 56%] 3132s tests/test_multi_locks.py::test_num_locks <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_multi_locks.py PASSED [ 56%] 3133s tests/test_nanny.py::test_str <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 56%] 3135s tests/test_nanny.py::test_nanny_process_failure <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 56%] 3136s tests/test_nanny.py::test_run <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 56%] 3138s tests/test_nanny.py::test_no_hang_when_scheduler_closes <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 56%] 3141s tests/test_nanny.py::test_close_on_disconnect <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 56%] 3143s tests/test_nanny.py::test_nanny_worker_class <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 56%] 3144s tests/test_nanny.py::test_nanny_alt_worker_class <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 56%] 3145s tests/test_nanny.py::test_nanny_death_timeout <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 56%] 3147s tests/test_nanny.py::test_random_seed <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 56%] 3153s tests/test_nanny.py::test_num_fds <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 56%] 3155s tests/test_nanny.py::test_worker_uses_same_host_as_nanny <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 56%] 3156s tests/test_nanny.py::test_scheduler_file <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 56%] 3159s tests/test_nanny.py::test_nanny_restart <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 56%] 3161s tests/test_nanny.py::test_nanny_restart_timeout <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 56%] 3164s tests/test_nanny.py::test_nanny_restart_timeout_stress <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 56%] 3164s tests/test_nanny.py::test_throttle_outgoing_transfers <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 56%] 3165s tests/test_nanny.py::test_scheduler_address_config <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 56%] 3171s tests/test_nanny.py::test_wait_for_scheduler <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 56%] 3172s tests/test_nanny.py::test_environment_variable <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 56%] 3174s tests/test_nanny.py::test_environment_variable_by_config <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 56%] 3175s tests/test_nanny.py::test_environment_variable_config <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 56%] 3176s tests/test_nanny.py::test_environment_variable_pre_post_spawn <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 56%] 3177s tests/test_nanny.py::test_environment_variable_overlay <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 56%] 3178s tests/test_nanny.py::test_config_param_overlays <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 56%] 3179s tests/test_nanny.py::test_local_directory <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 56%] 3181s tests/test_nanny.py::test_unwriteable_dask_worker_space <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 56%] 3183s tests/test_nanny.py::test_mp_process_worker_no_daemon <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 56%] 3186s tests/test_nanny.py::test_mp_pool_worker_no_daemon <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 56%] 3187s tests/test_nanny.py::test_nanny_closes_cleanly <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 56%] 3193s tests/test_nanny.py::test_lifetime <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 56%] 3196s tests/test_nanny.py::test_nanny_closes_cleanly_if_worker_is_terminated <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 56%] 3198s tests/test_nanny.py::test_config <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 56%] 3200s tests/test_nanny.py::test_nanny_port_range <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 57%] 3200s tests/test_nanny.py::test_nanny_closed_by_keyboard_interrupt[tcp] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py SKIPPED [ 57%] 3200s tests/test_nanny.py::test_nanny_closed_by_keyboard_interrupt[ucx] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py SKIPPED [ 57%] 3201s tests/test_nanny.py::test_worker_start_exception <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 57%] 3202s tests/test_nanny.py::test_worker_start_exception_while_killing <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 57%] 3203s tests/test_nanny.py::test_failure_during_worker_initialization <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 57%] 3207s tests/test_nanny.py::test_environ_plugin <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 57%] 3208s tests/test_nanny.py::test_no_unnecessary_imports_on_worker[scipy] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 57%] 3209s tests/test_nanny.py::test_no_unnecessary_imports_on_worker[pandas] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py XFAIL [ 57%] 3215s tests/test_nanny.py::test_repeated_restarts <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 57%] 3219s tests/test_nanny.py::test_restart_memory <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 57%] 3225s tests/test_nanny.py::test_close_joins <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 57%] 3228s tests/test_nanny.py::test_scheduler_crash_doesnt_restart <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 57%] 3234s tests/test_nanny.py::test_malloc_trim_threshold <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 57%] 3235s tests/test_nanny.py::test_default_client_does_not_propagate_to_subprocess <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 57%] 3236s tests/test_nanny.py::test_worker_inherits_temp_config <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 57%] 3239s tests/test_nanny.py::test_nanny_plugin_simple <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 57%] 3241s tests/test_nanny.py::test_nanny_plugin_register_during_start_success[True] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 57%] 3242s tests/test_nanny.py::test_nanny_plugin_register_during_start_success[False] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 57%] 3242s tests/test_nanny.py::test_nanny_plugin_register_during_start_failure[True] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 57%] 3243s tests/test_nanny.py::test_nanny_plugin_register_during_start_failure[False] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 57%] 3244s tests/test_nanny.py::test_nanny_plugin_register_nanny_killed[True] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 57%] 3245s tests/test_nanny.py::test_nanny_plugin_register_nanny_killed[False] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 57%] 3247s tests/test_preload.py::test_worker_preload_file <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_preload.py PASSED [ 57%] 3247s tests/test_preload.py::test_worker_preload_text <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_preload.py PASSED [ 57%] 3247s tests/test_preload.py::test_preload_manager_sequence <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_preload.py PASSED [ 57%] 3248s tests/test_preload.py::test_worker_preload_config <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_preload.py PASSED [ 57%] 3250s tests/test_preload.py::test_worker_preload_module <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_preload.py PASSED [ 57%] 3250s tests/test_preload.py::test_worker_preload_click <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_preload.py PASSED [ 57%] 3250s tests/test_preload.py::test_worker_preload_click_async <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_preload.py PASSED [ 57%] 3251s tests/test_preload.py::test_preload_import_time <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_preload.py PASSED [ 57%] 3251s tests/test_preload.py::test_web_preload <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_preload.py PASSED [ 57%] 3251s tests/test_preload.py::test_scheduler_startup <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_preload.py PASSED [ 57%] 3252s tests/test_preload.py::test_scheduler_startup_nanny <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_preload.py PASSED [ 57%] 3254s tests/test_preload.py::test_web_preload_worker <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_preload.py PASSED [ 57%] 3254s tests/test_preload.py::test_client_preload_text <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_preload.py XFAIL [ 57%] 3254s tests/test_preload.py::test_client_preload_config <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_preload.py PASSED [ 58%] 3254s tests/test_preload.py::test_client_preload_click <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_preload.py XFAIL [ 58%] 3254s tests/test_preload.py::test_failure_doesnt_crash_scheduler <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_preload.py PASSED [ 58%] 3254s tests/test_preload.py::test_failure_doesnt_crash_worker <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_preload.py PASSED [ 58%] 3255s tests/test_preload.py::test_failure_doesnt_crash_nanny <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_preload.py PASSED [ 58%] 3255s tests/test_preload.py::test_failure_doesnt_crash_client <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_preload.py PASSED [ 58%] 3255s tests/test_preload.py::test_client_preload_config_click <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_preload.py PASSED [ 58%] 3256s tests/test_priorities.py::test_submit[queue on worker] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_priorities.py PASSED [ 58%] 3256s tests/test_priorities.py::test_submit[queue on scheduler] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_priorities.py PASSED [ 58%] 3256s tests/test_priorities.py::test_map[queue on worker] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_priorities.py PASSED [ 58%] 3256s tests/test_priorities.py::test_map[queue on scheduler] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_priorities.py PASSED [ 58%] 3256s tests/test_priorities.py::test_compute[queue on worker] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_priorities.py PASSED [ 58%] 3256s tests/test_priorities.py::test_compute[queue on scheduler] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_priorities.py PASSED [ 58%] 3256s tests/test_priorities.py::test_persist[queue on worker] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_priorities.py PASSED [ 58%] 3256s tests/test_priorities.py::test_persist[queue on scheduler] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_priorities.py PASSED [ 58%] 3256s tests/test_priorities.py::test_annotate_compute[queue on worker] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_priorities.py PASSED [ 58%] 3257s tests/test_priorities.py::test_annotate_compute[queue on scheduler] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_priorities.py PASSED [ 58%] 3257s tests/test_priorities.py::test_annotate_persist[queue on worker] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_priorities.py PASSED [ 58%] 3257s tests/test_priorities.py::test_annotate_persist[queue on scheduler] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_priorities.py PASSED [ 58%] 3257s tests/test_priorities.py::test_repeated_persists_same_priority[queue on worker] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_priorities.py PASSED [ 58%] 3258s tests/test_priorities.py::test_repeated_persists_same_priority[queue on scheduler] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_priorities.py PASSED [ 58%] 3258s tests/test_priorities.py::test_last_in_first_out[queue on worker] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_priorities.py PASSED [ 58%] 3259s tests/test_priorities.py::test_last_in_first_out[queue on scheduler] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_priorities.py PASSED [ 58%] 3261s tests/test_profile.py::test_basic <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py PASSED [ 58%] 3261s tests/test_profile.py::test_basic_low_level <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py SKIPPED [ 58%] 3261s tests/test_profile.py::test_merge <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py PASSED [ 58%] 3261s tests/test_profile.py::test_merge_empty <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py PASSED [ 58%] 3261s tests/test_profile.py::test_call_stack <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py PASSED [ 58%] 3261s tests/test_profile.py::test_identifier <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py PASSED [ 58%] 3261s tests/test_profile.py::test_watch <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py PASSED [ 58%] 3262s tests/test_profile.py::test_watch_requires_lock_to_run <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py PASSED [ 58%] 3262s tests/test_profile.py::test_info_frame_f_lineno[-1-1] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py PASSED [ 58%] 3262s tests/test_profile.py::test_info_frame_f_lineno[0-2] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py PASSED [ 58%] 3262s tests/test_profile.py::test_info_frame_f_lineno[1-2] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py PASSED [ 58%] 3262s tests/test_profile.py::test_info_frame_f_lineno[11-2] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py PASSED [ 58%] 3262s tests/test_profile.py::test_info_frame_f_lineno[12-3] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py PASSED [ 58%] 3262s tests/test_profile.py::test_info_frame_f_lineno[21-4] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py PASSED [ 59%] 3262s tests/test_profile.py::test_info_frame_f_lineno[22-4] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py PASSED [ 59%] 3262s tests/test_profile.py::test_info_frame_f_lineno[23-4] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py PASSED [ 59%] 3262s tests/test_profile.py::test_info_frame_f_lineno[24-2] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py PASSED [ 59%] 3262s tests/test_profile.py::test_info_frame_f_lineno[25-2] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py PASSED [ 59%] 3262s tests/test_profile.py::test_info_frame_f_lineno[26-2] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py PASSED [ 59%] 3262s tests/test_profile.py::test_info_frame_f_lineno[27-2] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py PASSED [ 59%] 3262s tests/test_profile.py::test_info_frame_f_lineno[100-2] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py PASSED [ 59%] 3262s tests/test_profile.py::test_call_stack_f_lineno[-1-1] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py PASSED [ 59%] 3262s tests/test_profile.py::test_call_stack_f_lineno[0-2] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py PASSED [ 59%] 3262s tests/test_profile.py::test_call_stack_f_lineno[1-2] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py PASSED [ 59%] 3262s tests/test_profile.py::test_call_stack_f_lineno[11-2] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py PASSED [ 59%] 3262s tests/test_profile.py::test_call_stack_f_lineno[12-3] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py PASSED [ 59%] 3262s tests/test_profile.py::test_call_stack_f_lineno[21-4] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py PASSED [ 59%] 3262s tests/test_profile.py::test_call_stack_f_lineno[22-4] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py PASSED [ 59%] 3262s tests/test_profile.py::test_call_stack_f_lineno[23-4] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py PASSED [ 59%] 3262s tests/test_profile.py::test_call_stack_f_lineno[24-2] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py PASSED [ 59%] 3262s tests/test_profile.py::test_call_stack_f_lineno[25-2] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py PASSED [ 59%] 3262s tests/test_profile.py::test_call_stack_f_lineno[26-2] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py PASSED [ 59%] 3262s tests/test_profile.py::test_call_stack_f_lineno[27-2] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py PASSED [ 59%] 3262s tests/test_profile.py::test_call_stack_f_lineno[100-2] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py PASSED [ 59%] 3262s tests/test_profile.py::test_builtin <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py PASSED [ 59%] 3262s tests/test_publish.py::test_publish_simple <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_publish.py PASSED [ 59%] 3262s tests/test_publish.py::test_publish_non_string_key <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_publish.py PASSED [ 59%] 3262s tests/test_publish.py::test_publish_roundtrip <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_publish.py PASSED [ 59%] 3262s tests/test_publish.py::test_unpublish <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_publish.py PASSED [ 59%] 3264s tests/test_publish.py::test_unpublish_sync <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_publish.py PASSED [ 59%] 3264s tests/test_publish.py::test_publish_multiple_datasets <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_publish.py PASSED [ 59%] 3266s tests/test_publish.py::test_unpublish_multiple_datasets_sync <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_publish.py PASSED [ 59%] 3266s tests/test_publish.py::test_publish_bag <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_publish.py PASSED [ 59%] 3268s tests/test_publish.py::test_datasets_setitem <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_publish.py PASSED [ 59%] 3270s tests/test_publish.py::test_datasets_getitem <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_publish.py PASSED [ 59%] 3271s tests/test_publish.py::test_datasets_getitem_default <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_publish.py PASSED [ 59%] 3273s tests/test_publish.py::test_datasets_delitem <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_publish.py PASSED [ 59%] 3274s tests/test_publish.py::test_datasets_keys <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_publish.py PASSED [ 59%] 3276s tests/test_publish.py::test_datasets_contains <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_publish.py PASSED [ 59%] 3278s tests/test_publish.py::test_datasets_republish <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_publish.py PASSED [ 60%] 3279s tests/test_publish.py::test_datasets_iter <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_publish.py PASSED [ 60%] 3280s tests/test_publish.py::test_datasets_async <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_publish.py PASSED [ 60%] 3280s tests/test_publish.py::test_pickle_safe <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_publish.py PASSED [ 60%] 3280s tests/test_publish.py::test_deserialize_client <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_publish.py PASSED [ 60%] 3280s tests/test_publish.py::test_publish_submit_ordering <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_publish.py PASSED [ 60%] 3280s tests/test_pubsub.py::test_speed <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_pubsub.py PASSED [ 60%] 3280s tests/test_pubsub.py::test_client <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_pubsub.py PASSED [ 60%] 3281s tests/test_pubsub.py::test_timeouts <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_pubsub.py PASSED [ 60%] 3281s tests/test_pubsub.py::test_repr <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_pubsub.py PASSED [ 60%] 3281s tests/test_pubsub.py::test_basic <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_pubsub.py XPASS [ 60%] 3281s tests/test_queues.py::test_queue <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_queues.py PASSED [ 60%] 3281s tests/test_queues.py::test_queue_with_data <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_queues.py PASSED [ 60%] 3283s tests/test_queues.py::test_sync <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_queues.py PASSED [ 60%] 3283s tests/test_queues.py::test_hold_futures <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_queues.py PASSED [ 60%] 3284s tests/test_queues.py::test_picklability <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_queues.py PASSED [ 60%] 3285s tests/test_queues.py::test_picklability_sync <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_queues.py PASSED [ 60%] 3290s tests/test_queues.py::test_race <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_queues.py PASSED [ 60%] 3291s tests/test_queues.py::test_same_futures <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_queues.py PASSED [ 60%] 3291s tests/test_queues.py::test_get_many <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_queues.py PASSED [ 60%] 3291s tests/test_queues.py::test_Future_knows_status_immediately <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_queues.py PASSED [ 60%] 3291s tests/test_queues.py::test_erred_future <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_queues.py PASSED [ 60%] 3292s tests/test_queues.py::test_close <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_queues.py PASSED [ 60%] 3292s tests/test_queues.py::test_timeout <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_queues.py PASSED [ 60%] 3292s tests/test_queues.py::test_2220 <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_queues.py PASSED [ 60%] 3292s tests/test_queues.py::test_unpickle_without_client <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_queues.py PASSED [ 60%] 3293s tests/test_queues.py::test_set_cancelled_future <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_queues.py PASSED [ 60%] 3293s tests/test_reschedule.py::test_scheduler_reschedule_warns <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_reschedule.py PASSED [ 60%] 3293s tests/test_reschedule.py::test_raise_reschedule[executing] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_reschedule.py PASSED [ 60%] 3294s tests/test_reschedule.py::test_raise_reschedule[long-running] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_reschedule.py PASSED [ 60%] 3294s tests/test_reschedule.py::test_cancelled_reschedule[executing] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_reschedule.py PASSED [ 60%] 3295s tests/test_reschedule.py::test_cancelled_reschedule[long-running] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_reschedule.py PASSED [ 60%] 3295s tests/test_reschedule.py::test_cancelled_reschedule_worker_state[executing] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_reschedule.py PASSED [ 60%] 3295s tests/test_reschedule.py::test_cancelled_reschedule_worker_state[long-running] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_reschedule.py PASSED [ 60%] 3295s tests/test_reschedule.py::test_reschedule_releases[executing] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_reschedule.py PASSED [ 60%] 3295s tests/test_reschedule.py::test_reschedule_releases[long-running] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_reschedule.py PASSED [ 60%] 3295s tests/test_reschedule.py::test_reschedule_cancelled[executing] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_reschedule.py PASSED [ 60%] 3295s tests/test_reschedule.py::test_reschedule_cancelled[long-running] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_reschedule.py PASSED [ 61%] 3295s tests/test_reschedule.py::test_reschedule_resumed[executing] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_reschedule.py PASSED [ 61%] 3295s tests/test_reschedule.py::test_reschedule_resumed[long-running] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_reschedule.py PASSED [ 61%] 3295s tests/test_resources.py::test_resource_submit <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 61%] 3295s tests/test_resources.py::test_submit_many_non_overlapping <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 61%] 3296s tests/test_resources.py::test_submit_many_non_overlapping_2 <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 61%] 3296s tests/test_resources.py::test_move <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 61%] 3297s tests/test_resources.py::test_dont_work_steal <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 61%] 3297s tests/test_resources.py::test_map <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 61%] 3297s tests/test_resources.py::test_persist <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 61%] 3297s tests/test_resources.py::test_compute <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 61%] 3297s tests/test_resources.py::test_get <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 61%] 3297s tests/test_resources.py::test_persist_multiple_collections <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 61%] 3297s tests/test_resources.py::test_resources_str <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 61%] 3298s tests/test_resources.py::test_minimum_resource <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 61%] 3298s tests/test_resources.py::test_constrained_vs_ready_priority_1[1-0-y-False] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 61%] 3298s tests/test_resources.py::test_constrained_vs_ready_priority_1[1-0-y-True] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 61%] 3298s tests/test_resources.py::test_constrained_vs_ready_priority_1[0-1-x-False] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 61%] 3298s tests/test_resources.py::test_constrained_vs_ready_priority_1[0-1-x-True] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 61%] 3298s tests/test_resources.py::test_constrained_vs_ready_priority_2[1-0-y-False] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 61%] 3298s tests/test_resources.py::test_constrained_vs_ready_priority_2[1-0-y-True] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 61%] 3298s tests/test_resources.py::test_constrained_vs_ready_priority_2[0-1-x-False] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 61%] 3298s tests/test_resources.py::test_constrained_vs_ready_priority_2[0-1-x-True] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 61%] 3298s tests/test_resources.py::test_constrained_tasks_respect_priority <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 61%] 3298s tests/test_resources.py::test_task_cancelled_and_readded_with_resources <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 61%] 3298s tests/test_resources.py::test_balance_resources <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py SKIPPED [ 61%] 3298s tests/test_resources.py::test_set_resources <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 61%] 3298s tests/test_resources.py::test_persist_collections <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 61%] 3298s tests/test_resources.py::test_dont_optimize_out <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py SKIPPED [ 61%] 3298s tests/test_resources.py::test_full_collections <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py SKIPPED [ 61%] 3300s tests/test_resources.py::test_collections_get[True] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py XFAIL [ 61%] 3302s tests/test_resources.py::test_collections_get[False] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 61%] 3302s tests/test_resources.py::test_resources_from_config <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 61%] 3302s tests/test_resources.py::test_resources_from_python_override_config <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 61%] 3302s tests/test_resources.py::test_cancelled_with_resources[executing-ExecuteSuccessEvent] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 61%] 3302s tests/test_resources.py::test_cancelled_with_resources[executing-ExecuteFailureEvent] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 61%] 3302s tests/test_resources.py::test_cancelled_with_resources[executing-RescheduleEvent] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 62%] 3302s tests/test_resources.py::test_cancelled_with_resources[long-running-ExecuteSuccessEvent] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 62%] 3302s tests/test_resources.py::test_cancelled_with_resources[long-running-ExecuteFailureEvent] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 62%] 3302s tests/test_resources.py::test_cancelled_with_resources[long-running-RescheduleEvent] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 62%] 3302s tests/test_resources.py::test_resumed_with_resources[executing-ExecuteSuccessEvent] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 62%] 3302s tests/test_resources.py::test_resumed_with_resources[executing-ExecuteFailureEvent] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 62%] 3302s tests/test_resources.py::test_resumed_with_resources[executing-RescheduleEvent] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 62%] 3302s tests/test_resources.py::test_resumed_with_resources[long-running-ExecuteSuccessEvent] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 62%] 3302s tests/test_resources.py::test_resumed_with_resources[long-running-ExecuteFailureEvent] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 62%] 3302s tests/test_resources.py::test_resumed_with_resources[long-running-RescheduleEvent] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 62%] 3302s tests/test_resources.py::test_resumed_with_different_resources[executing-ExecuteSuccessEvent] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 62%] 3302s tests/test_resources.py::test_resumed_with_different_resources[executing-ExecuteFailureEvent] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 62%] 3302s tests/test_resources.py::test_resumed_with_different_resources[executing-RescheduleEvent] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 62%] 3302s tests/test_resources.py::test_resumed_with_different_resources[long-running-ExecuteSuccessEvent] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 62%] 3302s tests/test_resources.py::test_resumed_with_different_resources[long-running-ExecuteFailureEvent] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 62%] 3302s tests/test_resources.py::test_resumed_with_different_resources[long-running-RescheduleEvent] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 62%] 3302s tests/test_scheduler.py::test_administration <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 62%] 3302s tests/test_scheduler.py::test_respect_data_in_memory <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 62%] 3302s tests/test_scheduler.py::test_recompute_released_results <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 62%] 3303s tests/test_scheduler.py::test_decide_worker_with_many_independent_leaves <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 62%] 3303s tests/test_scheduler.py::test_decide_worker_with_restrictions <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 62%] 3303s tests/test_scheduler.py::test_decide_worker_coschedule_order_neighbors[nthreads0-0] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 62%] 3304s tests/test_scheduler.py::test_decide_worker_coschedule_order_neighbors[nthreads0-1] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 62%] 3305s tests/test_scheduler.py::test_decide_worker_coschedule_order_neighbors[nthreads0-4] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 62%] 3305s tests/test_scheduler.py::test_decide_worker_coschedule_order_neighbors[nthreads1-0] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 62%] 3306s tests/test_scheduler.py::test_decide_worker_coschedule_order_neighbors[nthreads1-1] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 62%] 3306s tests/test_scheduler.py::test_decide_worker_coschedule_order_neighbors[nthreads1-4] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 62%] 3306s tests/test_scheduler.py::test_decide_worker_rootish_while_last_worker_is_retiring <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py SKIPPED [ 62%] 3307s tests/test_scheduler.py::test_graph_execution_width <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 62%] 3309s tests/test_scheduler.py::test_forget_tasks_while_processing <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 62%] 3313s tests/test_scheduler.py::test_restart_while_processing <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 62%] 3313s tests/test_scheduler.py::test_queued_release_multiple_workers <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 62%] 3313s tests/test_scheduler.py::test_queued_paused_new_worker <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 62%] 3314s tests/test_scheduler.py::test_queued_paused_unpaused[True] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 62%] 3314s tests/test_scheduler.py::test_queued_paused_unpaused[False] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 62%] 3314s tests/test_scheduler.py::test_queued_remove_add_worker <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 62%] 3315s tests/test_scheduler.py::test_secede_opens_slot <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 63%] 3315s tests/test_scheduler.py::test_saturation_factor[2.5-expected_task_counts0] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 63%] 3315s tests/test_scheduler.py::test_saturation_factor[2.0-expected_task_counts1] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 63%] 3315s tests/test_scheduler.py::test_saturation_factor[1.1-expected_task_counts2] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 63%] 3315s tests/test_scheduler.py::test_saturation_factor[1.0-expected_task_counts3] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 63%] 3316s tests/test_scheduler.py::test_saturation_factor[0.1-expected_task_counts4] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 63%] 3316s tests/test_scheduler.py::test_saturation_factor[inf-expected_task_counts5] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 63%] 3316s tests/test_scheduler.py::test_saturation_factor[inf-expected_task_counts6] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 63%] 3316s tests/test_scheduler.py::test_bad_saturation_factor <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 63%] 3316s tests/test_scheduler.py::test_move_data_over_break_restrictions <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 63%] 3316s tests/test_scheduler.py::test_balance_with_restrictions <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 63%] 3317s tests/test_scheduler.py::test_no_valid_workers <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 63%] 3317s tests/test_scheduler.py::test_no_valid_workers_loose_restrictions <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 63%] 3317s tests/test_scheduler.py::test_no_workers[False] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 63%] 3317s tests/test_scheduler.py::test_no_workers[True] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 63%] 3317s tests/test_scheduler.py::test_retire_workers_empty <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 63%] 3318s tests/test_scheduler.py::test_retire_workers_lock <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 63%] 3318s tests/test_scheduler.py::test_retire_workers_concurrently <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 63%] 3318s tests/test_scheduler.py::test_server_listens_to_other_ops <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 63%] 3318s tests/test_scheduler.py::test_remove_worker_from_scheduler <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 63%] 3318s tests/test_scheduler.py::test_remove_worker_from_scheduler_warns_on_safe <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 63%] 3318s tests/test_scheduler.py::test_remove_worker_by_name_from_scheduler <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 63%] 3319s tests/test_scheduler.py::test_clear_events_worker_removal <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 63%] 3319s tests/test_scheduler.py::test_clear_events_client_removal <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 63%] 3319s tests/test_scheduler.py::test_add_worker <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 63%] 3319s tests/test_scheduler.py::test_blocked_handlers_are_respected <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 63%] 3319s tests/test_scheduler.py::test_scheduler_init_pulls_blocked_handlers_from_config <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 63%] 3320s tests/test_scheduler.py::test_feed <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 63%] 3320s tests/test_scheduler.py::test_feed_setup_teardown <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 63%] 3320s tests/test_scheduler.py::test_feed_large_bytestring <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 63%] 3321s tests/test_scheduler.py::test_delete_data <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 63%] 3321s tests/test_scheduler.py::test_delete <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 63%] 3321s tests/test_scheduler.py::test_dumps_function <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 63%] 3321s tests/test_scheduler.py::test_ready_remove_worker[1.0] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 63%] 3321s tests/test_scheduler.py::test_ready_remove_worker[inf] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 63%] 3325s tests/test_scheduler.py::test_restart <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 63%] 3328s tests/test_scheduler.py::test_restart_waits_for_new_workers <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 64%] 3331s tests/test_scheduler.py::test_restart_nanny_timeout_exceeded <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 64%] 3332s tests/test_scheduler.py::test_restart_not_all_workers_return <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 64%] 3332s tests/test_scheduler.py::test_restart_worker_rejoins_after_timeout_expired <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 64%] 3332s tests/test_scheduler.py::test_restart_no_wait_for_workers <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 64%] 3354s tests/test_scheduler.py::test_restart_some_nannies_some_not <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 64%] 3357s tests/test_scheduler.py::test_restart_heartbeat_before_closing <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 64%] 3357s tests/test_scheduler.py::test_broadcast <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 64%] 3357s tests/test_scheduler.py::test_broadcast_tls <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 64%] 3359s tests/test_scheduler.py::test_broadcast_nanny <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 64%] 3360s tests/test_scheduler.py::test_broadcast_on_error <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 64%] 3360s tests/test_scheduler.py::test_broadcast_deprecation <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 64%] 3360s tests/test_scheduler.py::test_worker_name <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 64%] 3360s tests/test_scheduler.py::test_coerce_address <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 64%] 3360s tests/test_scheduler.py::test_config_stealing <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 64%] 3360s tests/test_scheduler.py::test_config_no_stealing <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 64%] 3360s tests/test_scheduler.py::test_file_descriptors_dont_leak <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 64%] 3360s tests/test_scheduler.py::test_update_graph_culls <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 64%] 3360s tests/test_scheduler.py::test_io_loop <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 64%] 3360s tests/test_scheduler.py::test_story <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 64%] 3361s tests/test_scheduler.py::test_scatter_no_workers[False] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 64%] 3361s tests/test_scheduler.py::test_scatter_no_workers[True] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 64%] 3361s tests/test_scheduler.py::test_scheduler_sees_memory_limits <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 64%] 3361s tests/test_scheduler.py::test_retire_workers <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 64%] 3362s tests/test_scheduler.py::test_retire_workers_n <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 64%] 3362s tests/test_scheduler.py::test_workers_to_close <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 64%] 3362s tests/test_scheduler.py::test_workers_to_close_grouped <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 64%] 3362s tests/test_scheduler.py::test_workers_to_close_never_close_long_running[True] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 64%] 3362s tests/test_scheduler.py::test_workers_to_close_never_close_long_running[False] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 64%] 3363s tests/test_scheduler.py::test_retire_workers_no_suspicious_tasks <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 64%] 3377s tests/test_scheduler.py::test_file_descriptors <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 64%] 3378s tests/test_scheduler.py::test_learn_occupancy <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 64%] 3378s tests/test_scheduler.py::test_learn_occupancy_2 <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 64%] 3380s tests/test_scheduler.py::test_balance_many_workers <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 64%] 3381s tests/test_scheduler.py::test_balance_many_workers_2 <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 64%] 3384s tests/test_scheduler.py::test_include_communication_in_occupancy <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 64%] 3384s tests/test_scheduler.py::test_nonempty_data_is_rejected <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 64%] 3385s tests/test_scheduler.py::test_worker_arrives_with_data_is_rejected <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 65%] 3387s tests/test_scheduler.py::test_run_on_scheduler_sync <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 65%] 3387s tests/test_scheduler.py::test_run_on_scheduler <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 65%] 3387s tests/test_scheduler.py::test_allow_pickle_false <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 65%] 3387s tests/test_scheduler.py::test_close_worker <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 65%] 3391s tests/test_scheduler.py::test_close_nanny <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 65%] 3392s tests/test_scheduler.py::test_retire_workers_close <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 65%] 3395s tests/test_scheduler.py::test_retire_nannies_close <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 65%] 3396s tests/test_scheduler.py::test_fifo_submission <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 65%] 3396s tests/test_scheduler.py::test_scheduler_file <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 65%] 3396s tests/test_scheduler.py::test_dashboard_host[None-expect0-tcp://0.0.0.0] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 65%] 3396s tests/test_scheduler.py::test_dashboard_host[None-expect0-tcp://127.0.0.1] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 65%] 3396s tests/test_scheduler.py::test_dashboard_host[None-expect0-tcp://127.0.0.1:38275] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 65%] 3396s tests/test_scheduler.py::test_dashboard_host[127.0.0.1:0-expect1-tcp://0.0.0.0] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 65%] 3396s tests/test_scheduler.py::test_dashboard_host[127.0.0.1:0-expect1-tcp://127.0.0.1] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 65%] 3396s tests/test_scheduler.py::test_dashboard_host[127.0.0.1:0-expect1-tcp://127.0.0.1:38275] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 65%] 3397s tests/test_scheduler.py::test_profile_metadata <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 65%] 3398s tests/test_scheduler.py::test_profile_metadata_timeout <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 65%] 3398s tests/test_scheduler.py::test_profile_metadata_keys <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 65%] 3399s tests/test_scheduler.py::test_statistical_profiling <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 65%] 3400s tests/test_scheduler.py::test_statistical_profiling_failure <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 65%] 3400s tests/test_scheduler.py::test_cancel_fire_and_forget <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 65%] 3411s tests/test_scheduler.py::test_log_tasks_during_restart <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 65%] 3411s tests/test_scheduler.py::test_get_task_status <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 65%] 3411s tests/test_scheduler.py::test_deque_handler <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 65%] 3411s tests/test_scheduler.py::test_retries <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 65%] 3412s tests/test_scheduler.py::test_missing_data_errant_worker <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 65%] 3412s tests/test_scheduler.py::test_dont_recompute_if_persisted <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 65%] 3412s tests/test_scheduler.py::test_dont_recompute_if_persisted_2 <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 65%] 3412s tests/test_scheduler.py::test_dont_recompute_if_persisted_3 <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 65%] 3412s tests/test_scheduler.py::test_dont_recompute_if_persisted_4 <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 65%] 3413s tests/test_scheduler.py::test_dont_forget_released_keys <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 65%] 3413s tests/test_scheduler.py::test_dont_recompute_if_erred <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 65%] 3413s tests/test_scheduler.py::test_closing_scheduler_closes_workers <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 65%] 3413s tests/test_scheduler.py::test_resources_reset_after_cancelled_task <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 65%] 3413s tests/test_scheduler.py::test_gh2187 <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 65%] 3413s tests/test_scheduler.py::test_collect_versions <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 66%] 3416s tests/test_scheduler.py::test_idle_timeout <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 66%] 3417s tests/test_scheduler.py::test_idle_during_update_graph <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 66%] 3417s tests/test_scheduler.py::test_idle_timeout_no_workers <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 66%] 3417s tests/test_scheduler.py::test_no_workers_timeout_disabled <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 66%] 3418s tests/test_scheduler.py::test_no_workers_timeout_without_workers <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 66%] 3418s tests/test_scheduler.py::test_no_workers_timeout_bad_restrictions <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 66%] 3419s tests/test_scheduler.py::test_no_workers_timeout_queued <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 66%] 3419s tests/test_scheduler.py::test_no_workers_timeout_processing <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 66%] 3419s tests/test_scheduler.py::test_bandwidth <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 66%] 3422s tests/test_scheduler.py::test_bandwidth_clear <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 66%] 3422s tests/test_scheduler.py::test_workerstate_clean <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 66%] 3422s tests/test_scheduler.py::test_result_type <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 66%] 3422s tests/test_scheduler.py::test_close_workers <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 66%] 3422s tests/test_scheduler.py::test_host_address <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 66%] 3422s tests/test_scheduler.py::test_dashboard_address <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py SKIPPED [ 66%] 3423s tests/test_scheduler.py::test_adaptive_target <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 66%] 3423s tests/test_scheduler.py::test_adaptive_target_empty_cluster[True] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 66%] 3423s tests/test_scheduler.py::test_adaptive_target_empty_cluster[False] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 66%] 3423s tests/test_scheduler.py::test_async_context_manager <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 66%] 3423s tests/test_scheduler.py::test_allowed_failures_config <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 66%] 3423s tests/test_scheduler.py::test_finished <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 66%] 3423s tests/test_scheduler.py::test_retire_names_str <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 66%] 3424s tests/test_scheduler.py::test_retire_workers_bad_params <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 66%] 3424s tests/test_scheduler.py::test_get_task_duration <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 66%] 3425s tests/test_scheduler.py::test_default_task_duration_splits <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 66%] 3425s tests/test_scheduler.py::test_no_dangling_asyncio_tasks <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 66%] 3425s tests/test_scheduler.py::test_task_group_and_prefix_statistics <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 66%] 3426s tests/test_scheduler.py::test_task_groups_update_start_stop <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 66%] 3426s tests/test_scheduler.py::test_task_group_done <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 66%] 3426s tests/test_scheduler.py::test_task_group_not_done_waiting <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 66%] 3426s tests/test_scheduler.py::test_task_group_not_done_noworker <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 66%] 3426s tests/test_scheduler.py::test_task_group_not_done_queued <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 66%] 3426s tests/test_scheduler.py::test_task_group_not_done_processing <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 66%] 3427s tests/test_scheduler.py::test_task_prefix <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 66%] 3431s tests/test_scheduler.py::test_failing_task_increments_suspicious <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 66%] 3431s tests/test_scheduler.py::test_task_group_non_tuple_key <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 67%] 3431s tests/test_scheduler.py::test_task_unique_groups <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 67%] 3432s tests/test_scheduler.py::test_task_group_on_fire_and_forget <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 67%] 3433s tests/test_scheduler.py::test_gather_failing_can_recover <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 67%] 3433s tests/test_scheduler.py::test_gather_failing_cnn_error <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 67%] 3434s tests/test_scheduler.py::test_gather_no_workers <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 67%] 3434s tests/test_scheduler.py::test_gather_bad_worker[False] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 67%] 3434s tests/test_scheduler.py::test_gather_bad_worker[True] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 67%] 3434s tests/test_scheduler.py::test_too_many_groups <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 67%] 3434s tests/test_scheduler.py::test_multiple_listeners[{scheme}://{host}:{port}/status-dashboard at:\\s*http://] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 67%] 3434s tests/test_scheduler.py::test_multiple_listeners[{ENV_VAR_MISSING}-dashboard at:\\s*:\\d*] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 67%] 3435s tests/test_scheduler.py::test_worker_name_collision <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 67%] 3435s tests/test_scheduler.py::test_unknown_task_duration_config <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 67%] 3435s tests/test_scheduler.py::test_unknown_task_duration_config_2 <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 67%] 3435s tests/test_scheduler.py::test_retire_state_change <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 67%] 3435s tests/test_scheduler.py::test_get_worker_monitor_info <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 67%] 3435s tests/test_scheduler.py::test_quiet_cluster_round_robin <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 67%] 3435s tests/test_scheduler.py::test_memorystate <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 67%] 3435s tests/test_scheduler.py::test_memorystate_sum <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 67%] 3435s tests/test_scheduler.py::test_memorystate_adds_up[0-0-0-0] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 67%] 3435s tests/test_scheduler.py::test_memorystate_adds_up[0-0-0-1] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 67%] 3435s tests/test_scheduler.py::test_memorystate_adds_up[0-0-0-2] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 67%] 3435s tests/test_scheduler.py::test_memorystate_adds_up[0-0-0-3] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 67%] 3435s tests/test_scheduler.py::test_memorystate_adds_up[0-0-1-0] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 67%] 3435s tests/test_scheduler.py::test_memorystate_adds_up[0-0-1-1] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 67%] 3435s tests/test_scheduler.py::test_memorystate_adds_up[0-0-1-2] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 67%] 3435s tests/test_scheduler.py::test_memorystate_adds_up[0-0-1-3] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 67%] 3435s tests/test_scheduler.py::test_memorystate_adds_up[0-0-2-0] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 67%] 3435s tests/test_scheduler.py::test_memorystate_adds_up[0-0-2-1] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 67%] 3435s tests/test_scheduler.py::test_memorystate_adds_up[0-0-2-2] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 67%] 3435s tests/test_scheduler.py::test_memorystate_adds_up[0-0-2-3] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 67%] 3435s tests/test_scheduler.py::test_memorystate_adds_up[0-0-3-0] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 67%] 3435s tests/test_scheduler.py::test_memorystate_adds_up[0-0-3-1] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 67%] 3435s tests/test_scheduler.py::test_memorystate_adds_up[0-0-3-2] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 67%] 3435s tests/test_scheduler.py::test_memorystate_adds_up[0-0-3-3] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 67%] 3435s tests/test_scheduler.py::test_memorystate_adds_up[0-1-0-0] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 67%] 3435s tests/test_scheduler.py::test_memorystate_adds_up[0-1-0-1] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 68%] 3435s tests/test_scheduler.py::test_memorystate_adds_up[0-1-0-2] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 68%] 3435s tests/test_scheduler.py::test_memorystate_adds_up[0-1-0-3] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 68%] 3435s tests/test_scheduler.py::test_memorystate_adds_up[0-1-1-0] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 68%] 3435s tests/test_scheduler.py::test_memorystate_adds_up[0-1-1-1] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 68%] 3435s tests/test_scheduler.py::test_memorystate_adds_up[0-1-1-2] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 68%] 3435s tests/test_scheduler.py::test_memorystate_adds_up[0-1-1-3] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 68%] 3435s tests/test_scheduler.py::test_memorystate_adds_up[0-1-2-0] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 68%] 3435s tests/test_scheduler.py::test_memorystate_adds_up[0-1-2-1] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 68%] 3435s tests/test_scheduler.py::test_memorystate_adds_up[0-1-2-2] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 68%] 3435s tests/test_scheduler.py::test_memorystate_adds_up[0-1-2-3] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 68%] 3435s tests/test_scheduler.py::test_memorystate_adds_up[0-1-3-0] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 68%] 3435s tests/test_scheduler.py::test_memorystate_adds_up[0-1-3-1] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 68%] 3435s tests/test_scheduler.py::test_memorystate_adds_up[0-1-3-2] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 68%] 3435s tests/test_scheduler.py::test_memorystate_adds_up[0-1-3-3] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 68%] 3435s tests/test_scheduler.py::test_memorystate_adds_up[0-2-0-0] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 68%] 3435s tests/test_scheduler.py::test_memorystate_adds_up[0-2-0-1] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 68%] 3435s tests/test_scheduler.py::test_memorystate_adds_up[0-2-0-2] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 68%] 3435s tests/test_scheduler.py::test_memorystate_adds_up[0-2-0-3] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 68%] 3435s tests/test_scheduler.py::test_memorystate_adds_up[0-2-1-0] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 68%] 3435s tests/test_scheduler.py::test_memorystate_adds_up[0-2-1-1] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 68%] 3435s tests/test_scheduler.py::test_memorystate_adds_up[0-2-1-2] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 68%] 3435s tests/test_scheduler.py::test_memorystate_adds_up[0-2-1-3] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 68%] 3435s tests/test_scheduler.py::test_memorystate_adds_up[0-2-2-0] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 68%] 3435s tests/test_scheduler.py::test_memorystate_adds_up[0-2-2-1] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 68%] 3435s tests/test_scheduler.py::test_memorystate_adds_up[0-2-2-2] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 68%] 3435s tests/test_scheduler.py::test_memorystate_adds_up[0-2-2-3] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 68%] 3435s tests/test_scheduler.py::test_memorystate_adds_up[0-2-3-0] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 68%] 3435s tests/test_scheduler.py::test_memorystate_adds_up[0-2-3-1] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 68%] 3435s tests/test_scheduler.py::test_memorystate_adds_up[0-2-3-2] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 68%] 3435s tests/test_scheduler.py::test_memorystate_adds_up[0-2-3-3] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 68%] 3435s tests/test_scheduler.py::test_memorystate_adds_up[0-3-0-0] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 68%] 3435s tests/test_scheduler.py::test_memorystate_adds_up[0-3-0-1] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 68%] 3435s tests/test_scheduler.py::test_memorystate_adds_up[0-3-0-2] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 68%] 3435s tests/test_scheduler.py::test_memorystate_adds_up[0-3-0-3] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 68%] 3435s tests/test_scheduler.py::test_memorystate_adds_up[0-3-1-0] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 68%] 3435s tests/test_scheduler.py::test_memorystate_adds_up[0-3-1-1] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 68%] 3435s tests/test_scheduler.py::test_memorystate_adds_up[0-3-1-2] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 69%] 3435s tests/test_scheduler.py::test_memorystate_adds_up[0-3-1-3] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 69%] 3435s tests/test_scheduler.py::test_memorystate_adds_up[0-3-2-0] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 69%] 3435s tests/test_scheduler.py::test_memorystate_adds_up[0-3-2-1] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 69%] 3435s tests/test_scheduler.py::test_memorystate_adds_up[0-3-2-2] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 69%] 3435s tests/test_scheduler.py::test_memorystate_adds_up[0-3-2-3] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 69%] 3435s tests/test_scheduler.py::test_memorystate_adds_up[0-3-3-0] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 69%] 3435s tests/test_scheduler.py::test_memorystate_adds_up[0-3-3-1] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 69%] 3435s tests/test_scheduler.py::test_memorystate_adds_up[0-3-3-2] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 69%] 3435s tests/test_scheduler.py::test_memorystate_adds_up[0-3-3-3] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 69%] 3435s tests/test_scheduler.py::test_memorystate_adds_up[1-0-0-0] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 69%] 3435s tests/test_scheduler.py::test_memorystate_adds_up[1-0-0-1] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 69%] 3435s tests/test_scheduler.py::test_memorystate_adds_up[1-0-0-2] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 69%] 3435s tests/test_scheduler.py::test_memorystate_adds_up[1-0-0-3] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 69%] 3435s tests/test_scheduler.py::test_memorystate_adds_up[1-0-1-0] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 69%] 3435s tests/test_scheduler.py::test_memorystate_adds_up[1-0-1-1] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 69%] 3435s tests/test_scheduler.py::test_memorystate_adds_up[1-0-1-2] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 69%] 3435s tests/test_scheduler.py::test_memorystate_adds_up[1-0-1-3] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 69%] 3435s tests/test_scheduler.py::test_memorystate_adds_up[1-0-2-0] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 69%] 3435s tests/test_scheduler.py::test_memorystate_adds_up[1-0-2-1] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 69%] 3435s tests/test_scheduler.py::test_memorystate_adds_up[1-0-2-2] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 69%] 3435s tests/test_scheduler.py::test_memorystate_adds_up[1-0-2-3] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 69%] 3435s tests/test_scheduler.py::test_memorystate_adds_up[1-0-3-0] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 69%] 3435s tests/test_scheduler.py::test_memorystate_adds_up[1-0-3-1] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 69%] 3435s tests/test_scheduler.py::test_memorystate_adds_up[1-0-3-2] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 69%] 3435s tests/test_scheduler.py::test_memorystate_adds_up[1-0-3-3] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 69%] 3435s tests/test_scheduler.py::test_memorystate_adds_up[1-1-0-0] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 69%] 3435s tests/test_scheduler.py::test_memorystate_adds_up[1-1-0-1] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 69%] 3435s tests/test_scheduler.py::test_memorystate_adds_up[1-1-0-2] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 69%] 3435s tests/test_scheduler.py::test_memorystate_adds_up[1-1-0-3] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 69%] 3435s tests/test_scheduler.py::test_memorystate_adds_up[1-1-1-0] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 69%] 3435s tests/test_scheduler.py::test_memorystate_adds_up[1-1-1-1] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 69%] 3435s tests/test_scheduler.py::test_memorystate_adds_up[1-1-1-2] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 69%] 3435s tests/test_scheduler.py::test_memorystate_adds_up[1-1-1-3] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 69%] 3435s tests/test_scheduler.py::test_memorystate_adds_up[1-1-2-0] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 69%] 3435s tests/test_scheduler.py::test_memorystate_adds_up[1-1-2-1] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 69%] 3435s tests/test_scheduler.py::test_memorystate_adds_up[1-1-2-2] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 70%] 3435s tests/test_scheduler.py::test_memorystate_adds_up[1-1-2-3] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 70%] 3435s tests/test_scheduler.py::test_memorystate_adds_up[1-1-3-0] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 70%] 3435s tests/test_scheduler.py::test_memorystate_adds_up[1-1-3-1] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 70%] 3435s tests/test_scheduler.py::test_memorystate_adds_up[1-1-3-2] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 70%] 3435s tests/test_scheduler.py::test_memorystate_adds_up[1-1-3-3] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 70%] 3435s tests/test_scheduler.py::test_memorystate_adds_up[1-2-0-0] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 70%] 3435s tests/test_scheduler.py::test_memorystate_adds_up[1-2-0-1] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 70%] 3435s tests/test_scheduler.py::test_memorystate_adds_up[1-2-0-2] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 70%] 3435s tests/test_scheduler.py::test_memorystate_adds_up[1-2-0-3] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 70%] 3435s tests/test_scheduler.py::test_memorystate_adds_up[1-2-1-0] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 70%] 3435s tests/test_scheduler.py::test_memorystate_adds_up[1-2-1-1] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 70%] 3435s tests/test_scheduler.py::test_memorystate_adds_up[1-2-1-2] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 70%] 3435s tests/test_scheduler.py::test_memorystate_adds_up[1-2-1-3] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 70%] 3435s tests/test_scheduler.py::test_memorystate_adds_up[1-2-2-0] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 70%] 3435s tests/test_scheduler.py::test_memorystate_adds_up[1-2-2-1] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 70%] 3435s tests/test_scheduler.py::test_memorystate_adds_up[1-2-2-2] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 70%] 3435s tests/test_scheduler.py::test_memorystate_adds_up[1-2-2-3] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 70%] 3435s tests/test_scheduler.py::test_memorystate_adds_up[1-2-3-0] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 70%] 3435s tests/test_scheduler.py::test_memorystate_adds_up[1-2-3-1] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 70%] 3435s tests/test_scheduler.py::test_memorystate_adds_up[1-2-3-2] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 70%] 3435s tests/test_scheduler.py::test_memorystate_adds_up[1-2-3-3] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 70%] 3435s tests/test_scheduler.py::test_memorystate_adds_up[1-3-0-0] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 70%] 3435s tests/test_scheduler.py::test_memorystate_adds_up[1-3-0-1] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 70%] 3435s tests/test_scheduler.py::test_memorystate_adds_up[1-3-0-2] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 70%] 3435s tests/test_scheduler.py::test_memorystate_adds_up[1-3-0-3] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 70%] 3435s tests/test_scheduler.py::test_memorystate_adds_up[1-3-1-0] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 70%] 3435s tests/test_scheduler.py::test_memorystate_adds_up[1-3-1-1] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 70%] 3435s tests/test_scheduler.py::test_memorystate_adds_up[1-3-1-2] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 70%] 3435s tests/test_scheduler.py::test_memorystate_adds_up[1-3-1-3] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 70%] 3435s tests/test_scheduler.py::test_memorystate_adds_up[1-3-2-0] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 70%] 3435s tests/test_scheduler.py::test_memorystate_adds_up[1-3-2-1] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 70%] 3435s tests/test_scheduler.py::test_memorystate_adds_up[1-3-2-2] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 70%] 3435s tests/test_scheduler.py::test_memorystate_adds_up[1-3-2-3] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 70%] 3435s tests/test_scheduler.py::test_memorystate_adds_up[1-3-3-0] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 70%] 3435s tests/test_scheduler.py::test_memorystate_adds_up[1-3-3-1] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 70%] 3435s tests/test_scheduler.py::test_memorystate_adds_up[1-3-3-2] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 71%] 3435s tests/test_scheduler.py::test_memorystate_adds_up[1-3-3-3] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 71%] 3435s tests/test_scheduler.py::test_memorystate_adds_up[2-0-0-0] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 71%] 3435s tests/test_scheduler.py::test_memorystate_adds_up[2-0-0-1] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 71%] 3435s tests/test_scheduler.py::test_memorystate_adds_up[2-0-0-2] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 71%] 3435s tests/test_scheduler.py::test_memorystate_adds_up[2-0-0-3] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 71%] 3435s tests/test_scheduler.py::test_memorystate_adds_up[2-0-1-0] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 71%] 3435s tests/test_scheduler.py::test_memorystate_adds_up[2-0-1-1] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 71%] 3435s tests/test_scheduler.py::test_memorystate_adds_up[2-0-1-2] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 71%] 3435s tests/test_scheduler.py::test_memorystate_adds_up[2-0-1-3] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 71%] 3435s tests/test_scheduler.py::test_memorystate_adds_up[2-0-2-0] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 71%] 3435s tests/test_scheduler.py::test_memorystate_adds_up[2-0-2-1] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 71%] 3435s tests/test_scheduler.py::test_memorystate_adds_up[2-0-2-2] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 71%] 3435s tests/test_scheduler.py::test_memorystate_adds_up[2-0-2-3] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 71%] 3435s tests/test_scheduler.py::test_memorystate_adds_up[2-0-3-0] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 71%] 3435s tests/test_scheduler.py::test_memorystate_adds_up[2-0-3-1] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 71%] 3435s tests/test_scheduler.py::test_memorystate_adds_up[2-0-3-2] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 71%] 3435s tests/test_scheduler.py::test_memorystate_adds_up[2-0-3-3] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 71%] 3435s tests/test_scheduler.py::test_memorystate_adds_up[2-1-0-0] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 71%] 3435s tests/test_scheduler.py::test_memorystate_adds_up[2-1-0-1] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 71%] 3435s tests/test_scheduler.py::test_memorystate_adds_up[2-1-0-2] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 71%] 3435s tests/test_scheduler.py::test_memorystate_adds_up[2-1-0-3] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 71%] 3435s tests/test_scheduler.py::test_memorystate_adds_up[2-1-1-0] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 71%] 3435s tests/test_scheduler.py::test_memorystate_adds_up[2-1-1-1] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 71%] 3435s tests/test_scheduler.py::test_memorystate_adds_up[2-1-1-2] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 71%] 3435s tests/test_scheduler.py::test_memorystate_adds_up[2-1-1-3] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 71%] 3435s tests/test_scheduler.py::test_memorystate_adds_up[2-1-2-0] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 71%] 3435s tests/test_scheduler.py::test_memorystate_adds_up[2-1-2-1] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 71%] 3435s tests/test_scheduler.py::test_memorystate_adds_up[2-1-2-2] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 71%] 3435s tests/test_scheduler.py::test_memorystate_adds_up[2-1-2-3] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 71%] 3435s tests/test_scheduler.py::test_memorystate_adds_up[2-1-3-0] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 71%] 3435s tests/test_scheduler.py::test_memorystate_adds_up[2-1-3-1] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 71%] 3435s tests/test_scheduler.py::test_memorystate_adds_up[2-1-3-2] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 71%] 3435s tests/test_scheduler.py::test_memorystate_adds_up[2-1-3-3] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 71%] 3435s tests/test_scheduler.py::test_memorystate_adds_up[2-2-0-0] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 71%] 3435s tests/test_scheduler.py::test_memorystate_adds_up[2-2-0-1] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 71%] 3435s tests/test_scheduler.py::test_memorystate_adds_up[2-2-0-2] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 72%] 3435s tests/test_scheduler.py::test_memorystate_adds_up[2-2-0-3] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 72%] 3435s tests/test_scheduler.py::test_memorystate_adds_up[2-2-1-0] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 72%] 3435s tests/test_scheduler.py::test_memorystate_adds_up[2-2-1-1] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 72%] 3435s tests/test_scheduler.py::test_memorystate_adds_up[2-2-1-2] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 72%] 3435s tests/test_scheduler.py::test_memorystate_adds_up[2-2-1-3] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 72%] 3435s tests/test_scheduler.py::test_memorystate_adds_up[2-2-2-0] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 72%] 3435s tests/test_scheduler.py::test_memorystate_adds_up[2-2-2-1] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 72%] 3435s tests/test_scheduler.py::test_memorystate_adds_up[2-2-2-2] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 72%] 3435s tests/test_scheduler.py::test_memorystate_adds_up[2-2-2-3] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 72%] 3435s tests/test_scheduler.py::test_memorystate_adds_up[2-2-3-0] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 72%] 3435s tests/test_scheduler.py::test_memorystate_adds_up[2-2-3-1] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 72%] 3435s tests/test_scheduler.py::test_memorystate_adds_up[2-2-3-2] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 72%] 3435s tests/test_scheduler.py::test_memorystate_adds_up[2-2-3-3] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 72%] 3435s tests/test_scheduler.py::test_memorystate_adds_up[2-3-0-0] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 72%] 3435s tests/test_scheduler.py::test_memorystate_adds_up[2-3-0-1] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 72%] 3435s tests/test_scheduler.py::test_memorystate_adds_up[2-3-0-2] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 72%] 3435s tests/test_scheduler.py::test_memorystate_adds_up[2-3-0-3] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 72%] 3435s tests/test_scheduler.py::test_memorystate_adds_up[2-3-1-0] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 72%] 3435s tests/test_scheduler.py::test_memorystate_adds_up[2-3-1-1] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 72%] 3435s tests/test_scheduler.py::test_memorystate_adds_up[2-3-1-2] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 72%] 3435s tests/test_scheduler.py::test_memorystate_adds_up[2-3-1-3] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 72%] 3435s tests/test_scheduler.py::test_memorystate_adds_up[2-3-2-0] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 72%] 3435s tests/test_scheduler.py::test_memorystate_adds_up[2-3-2-1] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 72%] 3435s tests/test_scheduler.py::test_memorystate_adds_up[2-3-2-2] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 72%] 3435s tests/test_scheduler.py::test_memorystate_adds_up[2-3-2-3] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 72%] 3435s tests/test_scheduler.py::test_memorystate_adds_up[2-3-3-0] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 72%] 3435s tests/test_scheduler.py::test_memorystate_adds_up[2-3-3-1] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 72%] 3435s tests/test_scheduler.py::test_memorystate_adds_up[2-3-3-2] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 72%] 3435s tests/test_scheduler.py::test_memorystate_adds_up[2-3-3-3] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 72%] 3435s tests/test_scheduler.py::test_memorystate_adds_up[3-0-0-0] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 72%] 3435s tests/test_scheduler.py::test_memorystate_adds_up[3-0-0-1] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 72%] 3435s tests/test_scheduler.py::test_memorystate_adds_up[3-0-0-2] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 72%] 3435s tests/test_scheduler.py::test_memorystate_adds_up[3-0-0-3] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 72%] 3435s tests/test_scheduler.py::test_memorystate_adds_up[3-0-1-0] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 72%] 3435s tests/test_scheduler.py::test_memorystate_adds_up[3-0-1-1] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 72%] 3435s tests/test_scheduler.py::test_memorystate_adds_up[3-0-1-2] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 72%] 3435s tests/test_scheduler.py::test_memorystate_adds_up[3-0-1-3] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 73%] 3435s tests/test_scheduler.py::test_memorystate_adds_up[3-0-2-0] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 73%] 3436s tests/test_scheduler.py::test_memorystate_adds_up[3-0-2-1] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 73%] 3436s tests/test_scheduler.py::test_memorystate_adds_up[3-0-2-2] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 73%] 3436s tests/test_scheduler.py::test_memorystate_adds_up[3-0-2-3] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 73%] 3436s tests/test_scheduler.py::test_memorystate_adds_up[3-0-3-0] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 73%] 3436s tests/test_scheduler.py::test_memorystate_adds_up[3-0-3-1] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 73%] 3436s tests/test_scheduler.py::test_memorystate_adds_up[3-0-3-2] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 73%] 3436s tests/test_scheduler.py::test_memorystate_adds_up[3-0-3-3] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 73%] 3436s tests/test_scheduler.py::test_memorystate_adds_up[3-1-0-0] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 73%] 3436s tests/test_scheduler.py::test_memorystate_adds_up[3-1-0-1] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 73%] 3436s tests/test_scheduler.py::test_memorystate_adds_up[3-1-0-2] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 73%] 3436s tests/test_scheduler.py::test_memorystate_adds_up[3-1-0-3] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 73%] 3436s tests/test_scheduler.py::test_memorystate_adds_up[3-1-1-0] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 73%] 3436s tests/test_scheduler.py::test_memorystate_adds_up[3-1-1-1] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 73%] 3436s tests/test_scheduler.py::test_memorystate_adds_up[3-1-1-2] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 73%] 3436s tests/test_scheduler.py::test_memorystate_adds_up[3-1-1-3] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 73%] 3436s tests/test_scheduler.py::test_memorystate_adds_up[3-1-2-0] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 73%] 3436s tests/test_scheduler.py::test_memorystate_adds_up[3-1-2-1] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 73%] 3436s tests/test_scheduler.py::test_memorystate_adds_up[3-1-2-2] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 73%] 3436s tests/test_scheduler.py::test_memorystate_adds_up[3-1-2-3] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 73%] 3436s tests/test_scheduler.py::test_memorystate_adds_up[3-1-3-0] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 73%] 3436s tests/test_scheduler.py::test_memorystate_adds_up[3-1-3-1] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 73%] 3436s tests/test_scheduler.py::test_memorystate_adds_up[3-1-3-2] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 73%] 3436s tests/test_scheduler.py::test_memorystate_adds_up[3-1-3-3] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 73%] 3436s tests/test_scheduler.py::test_memorystate_adds_up[3-2-0-0] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 73%] 3436s tests/test_scheduler.py::test_memorystate_adds_up[3-2-0-1] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 73%] 3436s tests/test_scheduler.py::test_memorystate_adds_up[3-2-0-2] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 73%] 3436s tests/test_scheduler.py::test_memorystate_adds_up[3-2-0-3] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 73%] 3436s tests/test_scheduler.py::test_memorystate_adds_up[3-2-1-0] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 73%] 3436s tests/test_scheduler.py::test_memorystate_adds_up[3-2-1-1] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 73%] 3436s tests/test_scheduler.py::test_memorystate_adds_up[3-2-1-2] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 73%] 3436s tests/test_scheduler.py::test_memorystate_adds_up[3-2-1-3] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 73%] 3436s tests/test_scheduler.py::test_memorystate_adds_up[3-2-2-0] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 73%] 3436s tests/test_scheduler.py::test_memorystate_adds_up[3-2-2-1] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 73%] 3436s tests/test_scheduler.py::test_memorystate_adds_up[3-2-2-2] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 73%] 3436s tests/test_scheduler.py::test_memorystate_adds_up[3-2-2-3] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 74%] 3436s tests/test_scheduler.py::test_memorystate_adds_up[3-2-3-0] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 74%] 3436s tests/test_scheduler.py::test_memorystate_adds_up[3-2-3-1] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 74%] 3436s tests/test_scheduler.py::test_memorystate_adds_up[3-2-3-2] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 74%] 3436s tests/test_scheduler.py::test_memorystate_adds_up[3-2-3-3] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 74%] 3436s tests/test_scheduler.py::test_memorystate_adds_up[3-3-0-0] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 74%] 3436s tests/test_scheduler.py::test_memorystate_adds_up[3-3-0-1] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 74%] 3436s tests/test_scheduler.py::test_memorystate_adds_up[3-3-0-2] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 74%] 3436s tests/test_scheduler.py::test_memorystate_adds_up[3-3-0-3] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 74%] 3436s tests/test_scheduler.py::test_memorystate_adds_up[3-3-1-0] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 74%] 3436s tests/test_scheduler.py::test_memorystate_adds_up[3-3-1-1] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 74%] 3436s tests/test_scheduler.py::test_memorystate_adds_up[3-3-1-2] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 74%] 3436s tests/test_scheduler.py::test_memorystate_adds_up[3-3-1-3] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 74%] 3436s tests/test_scheduler.py::test_memorystate_adds_up[3-3-2-0] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 74%] 3436s tests/test_scheduler.py::test_memorystate_adds_up[3-3-2-1] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 74%] 3436s tests/test_scheduler.py::test_memorystate_adds_up[3-3-2-2] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 74%] 3436s tests/test_scheduler.py::test_memorystate_adds_up[3-3-2-3] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 74%] 3436s tests/test_scheduler.py::test_memorystate_adds_up[3-3-3-0] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 74%] 3436s tests/test_scheduler.py::test_memorystate_adds_up[3-3-3-1] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 74%] 3436s tests/test_scheduler.py::test_memorystate_adds_up[3-3-3-2] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 74%] 3436s tests/test_scheduler.py::test_memorystate_adds_up[3-3-3-3] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 74%] 3436s tests/test_scheduler.py::test_memorystate__to_dict <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 74%] 3448s tests/test_scheduler.py::test_memory <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 74%] 3449s tests/test_scheduler.py::test_memory_no_zict <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 74%] 3449s tests/test_scheduler.py::test_memory_no_workers <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 74%] 3449s tests/test_scheduler.py::test_infrequent_sysmon <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 74%] 3449s tests/test_scheduler.py::test_close_scheduler__close_workers_Worker <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 74%] 3452s tests/test_scheduler.py::test_close_scheduler__close_workers_Nanny <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 74%] 3456s tests/test_scheduler.py::test_rebalance <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 74%] 3456s tests/test_scheduler.py::test_rebalance_managed_memory <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 74%] 3456s tests/test_scheduler.py::test_rebalance_workers_and_keys <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 74%] 3456s tests/test_scheduler.py::test_rebalance_missing_data1 <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 74%] 3456s tests/test_scheduler.py::test_rebalance_missing_data2 <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 74%] 3456s tests/test_scheduler.py::test_rebalance_raises_missing_data3[False] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 74%] 3457s tests/test_scheduler.py::test_rebalance_raises_missing_data3[True] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py XFAIL subject to a race 3457s condition. This test assumes that the data is freed before 3457s the rebalance get_data requests come in but merely deleting 3457s the futures is not sufficient to guarantee this) [ 74%] 3457s tests/test_scheduler.py::test_rebalance_no_workers <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 74%] 3457s tests/test_scheduler.py::test_rebalance_no_limit <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 75%] 3459s tests/test_scheduler.py::test_rebalance_no_recipients <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 75%] 3459s tests/test_scheduler.py::test_rebalance_skip_recipient <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 75%] 3459s tests/test_scheduler.py::test_rebalance_skip_all_recipients <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 75%] 3462s tests/test_scheduler.py::test_rebalance_sender_below_mean <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 75%] 3464s tests/test_scheduler.py::test_rebalance_least_recently_inserted_sender_min <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 75%] 3464s tests/test_scheduler.py::test_gather_on_worker <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 75%] 3465s tests/test_scheduler.py::test_gather_on_worker_bad_recipient <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 75%] 3465s tests/test_scheduler.py::test_gather_on_worker_bad_sender <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 75%] 3465s tests/test_scheduler.py::test_gather_on_worker_bad_sender_replicated[False] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 75%] 3465s tests/test_scheduler.py::test_gather_on_worker_bad_sender_replicated[True] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 75%] 3465s tests/test_scheduler.py::test_gather_on_worker_key_not_on_sender <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 75%] 3465s tests/test_scheduler.py::test_gather_on_worker_key_not_on_sender_replicated[False] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 75%] 3466s tests/test_scheduler.py::test_gather_on_worker_key_not_on_sender_replicated[True] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 75%] 3466s tests/test_scheduler.py::test_gather_on_worker_duplicate_task <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 75%] 3466s tests/test_scheduler.py::test_rebalance_dead_recipient <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 75%] 3466s tests/test_scheduler.py::test_delete_worker_data <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 75%] 3466s tests/test_scheduler.py::test_delete_worker_data_double_delete <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 75%] 3466s tests/test_scheduler.py::test_delete_worker_data_bad_worker <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 75%] 3467s tests/test_scheduler.py::test_delete_worker_data_bad_task[False] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 75%] 3467s tests/test_scheduler.py::test_delete_worker_data_bad_task[True] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 75%] 3467s tests/test_scheduler.py::test_transition_counter <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 75%] 3467s tests/test_scheduler.py::test_transition_counter_max_scheduler <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 75%] 3467s tests/test_scheduler.py::test_transition_counter_max_worker <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 75%] 3469s tests/test_scheduler.py::test_disable_transition_counter_max <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 75%] 3469s tests/test_scheduler.py::test_worker_heartbeat_after_cancel <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 75%] 3470s tests/test_scheduler.py::test_set_restrictions <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 75%] 3470s tests/test_scheduler.py::test_avoid_paused_workers <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 75%] 3470s tests/test_scheduler.py::test_Scheduler__to_dict <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 75%] 3470s tests/test_scheduler.py::test_TaskState__to_dict <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 75%] 3470s tests/test_scheduler.py::test_get_cluster_state <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 75%] 3471s tests/test_scheduler.py::test_get_cluster_state_worker_error <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 75%] 3471s tests/test_scheduler.py::test_dump_cluster_state[msgpack] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 75%] 3471s tests/test_scheduler.py::test_dump_cluster_state[yaml] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 75%] 3471s tests/test_scheduler.py::test_repr <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 75%] 3472s tests/test_scheduler.py::test_ensure_events_dont_include_taskstate_objects <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 75%] 3472s tests/test_scheduler.py::test_worker_state_unique_regardless_of_address <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 76%] 3472s tests/test_scheduler.py::test_scheduler_close_fast_deprecated <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 76%] 3474s tests/test_scheduler.py::test_runspec_regression_sync <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 76%] 3474s tests/test_scheduler.py::test_KilledWorker_informative_message <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 76%] 3474s tests/test_scheduler.py::test_count_task_prefix <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 76%] 3474s tests/test_scheduler.py::test_transition_waiting_memory <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 76%] 3475s tests/test_scheduler.py::test_deadlock_resubmit_queued_tasks_fast[True] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 76%] 3475s tests/test_scheduler.py::test_deadlock_resubmit_queued_tasks_fast[False] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 76%] 3475s tests/test_scheduler.py::test_transition_failure_triggers_log_event <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 76%] 3475s tests/test_scheduler.py::test_deadlock_dependency_of_queued_released_when_worker_replaced[True] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 76%] 3476s tests/test_scheduler.py::test_deadlock_dependency_of_queued_released_when_worker_replaced[False] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 76%] 3476s tests/test_scheduler.py::test_deadlock_dependency_of_queued_released_when_worker_removed[True] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 76%] 3476s tests/test_scheduler.py::test_deadlock_dependency_of_queued_released_when_worker_removed[False] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 76%] 3476s tests/test_scheduler.py::test_submit_dependency_of_erred_task <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 76%] 3476s tests/test_scheduler.py::test_tell_workers_when_peers_have_left <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 76%] 3476s tests/test_scheduler.py::test_scatter_creates_ts <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 76%] 3477s tests/test_scheduler.py::test_refuse_to_schedule_huge_task[False] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 76%] 3477s tests/test_scheduler.py::test_refuse_to_schedule_huge_task[True] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 76%] 3477s tests/test_scheduler.py::test_html_repr <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 76%] 3478s tests/test_scheduler.py::test_resubmit_different_task_same_key_before_previous_is_done[same] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 76%] 3478s tests/test_scheduler.py::test_resubmit_different_task_same_key_before_previous_is_done[less] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 76%] 3478s tests/test_scheduler.py::test_resubmit_different_task_same_key_before_previous_is_done[more] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 76%] 3478s tests/test_scheduler.py::test_resubmit_different_task_same_key_after_previous_is_done[False-same] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 76%] 3478s tests/test_scheduler.py::test_resubmit_different_task_same_key_after_previous_is_done[False-less] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 76%] 3478s tests/test_scheduler.py::test_resubmit_different_task_same_key_after_previous_is_done[False-more] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 76%] 3479s tests/test_scheduler.py::test_resubmit_different_task_same_key_after_previous_is_done[True-same] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 76%] 3479s tests/test_scheduler.py::test_resubmit_different_task_same_key_after_previous_is_done[True-less] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 76%] 3479s tests/test_scheduler.py::test_resubmit_different_task_same_key_after_previous_is_done[True-more] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 76%] 3479s tests/test_scheduler.py::test_resubmit_different_task_same_key_many_clients <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 76%] 3479s tests/test_scheduler.py::test_resubmit_nondeterministic_task_same_deps[before0-123-True] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 76%] 3479s tests/test_scheduler.py::test_resubmit_nondeterministic_task_same_deps[123-after1-True] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 76%] 3480s tests/test_scheduler.py::test_resubmit_nondeterministic_task_same_deps[before2-after2-False] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 76%] 3480s tests/test_scheduler.py::test_resubmit_nondeterministic_task_different_deps[False] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 76%] 3480s tests/test_scheduler.py::test_resubmit_nondeterministic_task_different_deps[True] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 76%] 3480s tests/test_scheduler.py::test_resubmit_different_task_same_key_warns_only_once[10-2] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 76%] 3480s tests/test_scheduler.py::test_resubmit_different_task_same_key_warns_only_once[30-1] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 76%] 3480s tests/test_scheduler.py::test_fan_out_pattern_deadlock <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 76%] 3481s tests/test_scheduler.py::test_stimulus_from_erred_task <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 77%] 3483s tests/test_scheduler.py::test_concurrent_close_requests <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 77%] 3483s tests/test_scheduler.py::test_rootish_taskgroup_configuration <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 77%] 3483s tests/test_scheduler.py::test_alias_resolving_break_queuing <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 77%] 3483s tests/test_security.py::test_defaults <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_security.py PASSED [ 77%] 3483s tests/test_security.py::test_constructor_errors <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_security.py PASSED [ 77%] 3483s tests/test_security.py::test_attribute_error <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_security.py PASSED [ 77%] 3483s tests/test_security.py::test_from_config <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_security.py PASSED [ 77%] 3483s tests/test_security.py::test_min_max_version_from_config[None-None] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_security.py PASSED [ 77%] 3483s tests/test_security.py::test_min_max_version_from_config[None-1.2] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_security.py PASSED [ 77%] 3483s tests/test_security.py::test_min_max_version_from_config[None-1.3] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_security.py PASSED [ 77%] 3483s tests/test_security.py::test_min_max_version_from_config[1.2-None] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_security.py PASSED [ 77%] 3483s tests/test_security.py::test_min_max_version_from_config[1.2-1.2] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_security.py PASSED [ 77%] 3483s tests/test_security.py::test_min_max_version_from_config[1.2-1.3] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_security.py PASSED [ 77%] 3483s tests/test_security.py::test_min_max_version_from_config[1.3-None] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_security.py PASSED [ 77%] 3483s tests/test_security.py::test_min_max_version_from_config[1.3-1.2] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_security.py PASSED [ 77%] 3483s tests/test_security.py::test_min_max_version_from_config[1.3-1.3] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_security.py PASSED [ 77%] 3483s tests/test_security.py::test_min_max_version_config_errors[min-version] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_security.py PASSED [ 77%] 3483s tests/test_security.py::test_min_max_version_config_errors[max-version] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_security.py PASSED [ 77%] 3483s tests/test_security.py::test_invalid_min_version_from_config_errors <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_security.py PASSED [ 77%] 3483s tests/test_security.py::test_kwargs <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_security.py PASSED [ 77%] 3483s tests/test_security.py::test_min_max_version_kwarg_errors[tls_min_version] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_security.py PASSED [ 77%] 3483s tests/test_security.py::test_min_max_version_kwarg_errors[tls_max_version] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_security.py PASSED [ 77%] 3483s tests/test_security.py::test_repr_temp_keys <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_security.py PASSED [ 77%] 3483s tests/test_security.py::test_repr_local_keys <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_security.py PASSED [ 77%] 3483s tests/test_security.py::test_tls_config_for_role <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_security.py PASSED [ 77%] 3483s tests/test_security.py::test_connection_args <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_security.py PASSED [ 77%] 3483s tests/test_security.py::test_extra_conn_args_connection_args <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_security.py PASSED [ 77%] 3483s tests/test_security.py::test_listen_args <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_security.py PASSED [ 77%] 3483s tests/test_security.py::test_tls_listen_connect <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_security.py PASSED [ 77%] 3483s tests/test_security.py::test_require_encryption <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_security.py PASSED [ 77%] 3483s tests/test_security.py::test_temporary_credentials <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_security.py PASSED [ 77%] 3483s tests/test_security.py::test_extra_conn_args_in_temporary_credentials <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_security.py PASSED [ 77%] 3484s tests/test_security.py::test_tls_temporary_credentials_functional <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_security.py PASSED [ 77%] 3484s tests/test_semaphore.py::test_semaphore_trivial <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_semaphore.py PASSED [ 77%] 3484s tests/test_semaphore.py::test_serializable <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_semaphore.py PASSED [ 77%] 3484s tests/test_semaphore.py::test_release_simple <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_semaphore.py PASSED [ 78%] 3484s tests/test_semaphore.py::test_acquires_with_timeout <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_semaphore.py PASSED [ 78%] 3486s tests/test_semaphore.py::test_timeout_sync <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_semaphore.py PASSED [ 78%] 3486s tests/test_semaphore.py::test_release_semaphore_after_timeout <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_semaphore.py PASSED [ 78%] 3487s tests/test_semaphore.py::test_async_ctx <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_semaphore.py PASSED [ 78%] 3488s tests/test_semaphore.py::test_worker_dies <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_semaphore.py PASSED [ 78%] 3489s tests/test_semaphore.py::test_access_semaphore_by_name <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_semaphore.py PASSED [ 78%] 3490s tests/test_semaphore.py::test_close_async <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_semaphore.py PASSED [ 78%] 3490s tests/test_semaphore.py::test_release_once_too_many <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_semaphore.py PASSED [ 78%] 3490s tests/test_semaphore.py::test_release_once_too_many_resilience <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_semaphore.py PASSED [ 78%] 3490s tests/test_semaphore.py::test_retry_acquire <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_semaphore.py PASSED [ 78%] 3491s tests/test_semaphore.py::test_oversubscribing_leases <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_semaphore.py PASSED [ 78%] 3491s tests/test_semaphore.py::test_timeout_zero <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_semaphore.py PASSED [ 78%] 3491s tests/test_semaphore.py::test_getvalue <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_semaphore.py PASSED [ 78%] 3491s tests/test_semaphore.py::test_metrics <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_semaphore.py PASSED [ 78%] 3491s tests/test_semaphore.py::test_threadpoolworkers_pick_correct_ioloop <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_semaphore.py PASSED [ 78%] 3491s tests/test_semaphore.py::test_release_retry <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_semaphore.py PASSED [ 78%] 3492s tests/test_semaphore.py::test_release_failure <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_semaphore.py PASSED [ 78%] 3492s tests/test_semaphore.py::test_unpickle_without_client <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_semaphore.py PASSED [ 78%] 3492s tests/test_sizeof.py::test_safe_sizeof[obj0] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_sizeof.py PASSED [ 78%] 3492s tests/test_sizeof.py::test_safe_sizeof[obj1] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_sizeof.py PASSED [ 78%] 3492s tests/test_sizeof.py::test_safe_sizeof[obj2] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_sizeof.py PASSED [ 78%] 3492s tests/test_sizeof.py::test_safe_sizeof_logs_on_failure <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_sizeof.py PASSED [ 78%] 3492s tests/test_spans.py::test_spans <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_spans.py PASSED [ 78%] 3492s tests/test_spans.py::test_submit <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_spans.py PASSED [ 78%] 3492s tests/test_spans.py::test_multiple_tags <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_spans.py PASSED [ 78%] 3492s tests/test_spans.py::test_repeat_span <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_spans.py PASSED [ 78%] 3493s tests/test_spans.py::test_default_span <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_spans.py PASSED [ 78%] 3494s tests/test_spans.py::test_no_extension <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_spans.py PASSED [ 78%] 3495s tests/test_spans.py::test_task_groups[False] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_spans.py PASSED [ 78%] 3495s tests/test_spans.py::test_task_groups[True] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_spans.py PASSED [ 78%] 3495s tests/test_spans.py::test_before_first_task_finished <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_spans.py PASSED [ 78%] 3496s tests/test_spans.py::test_duplicate_task_group <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_spans.py PASSED [ 78%] 3496s tests/test_spans.py::test_mismatched_span[False] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_spans.py PASSED [ 78%] 3496s tests/test_spans.py::test_mismatched_span[True] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_spans.py PASSED [ 78%] 3496s tests/test_spans.py::test_no_tags <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_spans.py PASSED [ 78%] 3496s tests/test_spans.py::test_scatter_creates_ts <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_spans.py PASSED [ 79%] 3496s tests/test_spans.py::test_scatter_creates_tg <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_spans.py PASSED [ 79%] 3497s tests/test_spans.py::test_worker_metrics <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_spans.py PASSED [ 79%] 3497s tests/test_spans.py::test_merge_by_tags <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_spans.py PASSED [ 79%] 3497s tests/test_spans.py::test_merge_by_tags_metrics <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_spans.py PASSED [ 79%] 3497s tests/test_spans.py::test_code <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_spans.py PASSED [ 79%] 3498s tests/test_spans.py::test_no_code_by_default <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_spans.py PASSED [ 79%] 3498s tests/test_spans.py::test_merge_all <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_spans.py PASSED [ 79%] 3498s tests/test_spans.py::test_merge_nothing <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_spans.py PASSED [ 79%] 3498s tests/test_spans.py::test_active_cpu_seconds_trivial <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_spans.py PASSED [ 79%] 3498s tests/test_spans.py::test_active_cpu_seconds_not_done[False] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_spans.py PASSED [ 79%] 3499s tests/test_spans.py::test_active_cpu_seconds_not_done[True] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_spans.py PASSED [ 79%] 3499s tests/test_spans.py::test_active_cpu_seconds_change_nthreads <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_spans.py PASSED [ 79%] 3499s tests/test_spans.py::test_active_cpu_seconds_merged <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_spans.py PASSED [ 79%] 3500s tests/test_spans.py::test_spans_are_visible_from_tasks <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_spans.py PASSED [ 79%] 3500s tests/test_spans.py::test_span_on_persist <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_spans.py PASSED [ 79%] 3500s tests/test_spans.py::test_collections_metadata <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_spans.py XPASS [ 79%] 3500s tests/test_spec.py::test_address_default_none <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_spec.py PASSED [ 79%] 3500s tests/test_spec.py::test_child_address_persists <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_spec.py PASSED [ 79%] 3500s tests/test_spill.py::test_psize <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_spill.py PASSED [ 79%] 3500s tests/test_spill.py::test_spillbuffer <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_spill.py PASSED [ 79%] 3500s tests/test_spill.py::test_disk_size_calculation <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_spill.py PASSED [ 79%] 3500s tests/test_spill.py::test_spillbuffer_maxlim <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_spill.py PASSED [ 79%] 3500s tests/test_spill.py::test_spillbuffer_fail_to_serialize <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_spill.py PASSED [ 79%] 3500s tests/test_spill.py::test_spillbuffer_evict <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_spill.py PASSED [ 79%] 3500s tests/test_spill.py::test_no_pop <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_spill.py PASSED [ 79%] 3500s tests/test_spill.py::test_weakref_cache[60-SupportsWeakRef-True] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_spill.py PASSED [ 79%] 3500s tests/test_spill.py::test_weakref_cache[60-NoWeakRef-False] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_spill.py PASSED [ 79%] 3500s tests/test_spill.py::test_weakref_cache[110-SupportsWeakRef-True] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_spill.py PASSED [ 79%] 3500s tests/test_spill.py::test_weakref_cache[110-NoWeakRef-False] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_spill.py PASSED [ 79%] 3500s tests/test_spill.py::test_metrics <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_spill.py PASSED [ 79%] 3500s tests/test_spill.py::test_compression_settings[zlib-100-500] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_spill.py PASSED [ 79%] 3500s tests/test_spill.py::test_compression_settings[None-20000-20500] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_spill.py PASSED [ 79%] 3500s tests/test_spill.py::test_str_collision <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_spill.py PASSED [ 79%] 3500s tests/test_steal.py::test_work_stealing <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 79%] 3501s tests/test_steal.py::test_dont_steal_expensive_data_fast_computation <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 79%] 3502s tests/test_steal.py::test_steal_cheap_data_slow_computation <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 80%] 3503s tests/test_steal.py::test_steal_expensive_data_slow_computation <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 80%] 3505s tests/test_steal.py::test_worksteal_many_thieves <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 80%] 3505s tests/test_steal.py::test_stop_plugin <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 80%] 3506s tests/test_steal.py::test_stop_in_flight <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 80%] 3507s tests/test_steal.py::test_allow_tasks_stolen_before_first_completes <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 80%] 3507s tests/test_steal.py::test_eventually_steal_unknown_functions <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 80%] 3507s tests/test_steal.py::test_steal_related_tasks <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py SKIPPED [ 80%] 3508s tests/test_steal.py::test_dont_steal_fast_tasks_compute_time <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 80%] 3509s tests/test_steal.py::test_dont_steal_fast_tasks_blocklist <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 80%] 3512s tests/test_steal.py::test_new_worker_steals <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 80%] 3514s tests/test_steal.py::test_work_steal_allow_other_workers <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 80%] 3514s tests/test_steal.py::test_dont_steal_worker_restrictions <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 80%] 3514s tests/test_steal.py::test_steal_worker_restrictions <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 80%] 3515s tests/test_steal.py::test_dont_steal_host_restrictions <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 80%] 3515s tests/test_steal.py::test_steal_host_restrictions <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 80%] 3515s tests/test_steal.py::test_dont_steal_resource_restrictions <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 80%] 3516s tests/test_steal.py::test_steal_resource_restrictions <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 80%] 3516s tests/test_steal.py::test_steal_resource_restrictions_asym_diff <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 80%] 3518s tests/test_steal.py::test_balance_without_dependencies <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 80%] 3518s tests/test_steal.py::test_dont_steal_executing_tasks <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 80%] 3518s tests/test_steal.py::test_dont_steal_executing_tasks_2 <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 80%] 3519s tests/test_steal.py::test_dont_steal_few_saturated_tasks_many_workers <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 80%] 3520s tests/test_steal.py::test_steal_when_more_tasks <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 80%] 3520s tests/test_steal.py::test_steal_more_attractive_tasks <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 80%] 3521s tests/test_steal.py::test_balance[don't move unnecessarily] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 80%] 3521s tests/test_steal.py::test_balance[balance] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 80%] 3521s tests/test_steal.py::test_balance[balance even if results in even] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 80%] 3521s tests/test_steal.py::test_balance[don't over balance] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 80%] 3521s tests/test_steal.py::test_balance[move from larger] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 80%] 3521s tests/test_steal.py::test_balance[move to smaller] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 80%] 3522s tests/test_steal.py::test_balance[choose easier first] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 80%] 3522s tests/test_steal.py::test_balance[spread evenly] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 80%] 3522s tests/test_steal.py::test_balance[move easier] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 80%] 3522s tests/test_steal.py::test_balance[be willing to move costly items] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 80%] 3522s tests/test_steal.py::test_balance[but don't move too many] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 80%] 3523s tests/test_steal.py::test_balance[no one clearly saturated] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 80%] 3523s tests/test_steal.py::test_balance[balance multiple saturated workers] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 81%] 3526s tests/test_steal.py::test_restart <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 81%] 3526s tests/test_steal.py::test_paused_workers_must_not_steal <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 81%] 3527s tests/test_steal.py::test_dont_steal_already_released <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 81%] 3528s tests/test_steal.py::test_dont_steal_long_running_tasks <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 81%] 3528s tests/test_steal.py::test_cleanup_repeated_tasks <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 81%] 3530s tests/test_steal.py::test_lose_task <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 81%] 3530s tests/test_steal.py::test_parse_stealing_interval[None-100] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 81%] 3530s tests/test_steal.py::test_parse_stealing_interval[500ms-500] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 81%] 3530s tests/test_steal.py::test_parse_stealing_interval[2-2] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 81%] 3535s tests/test_steal.py::test_balance_with_longer_task <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 81%] 3536s tests/test_steal.py::test_blocklist_shuffle_split <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 81%] 3536s tests/test_steal.py::test_steal_concurrent_simple <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 81%] 3536s tests/test_steal.py::test_steal_reschedule_reset_in_flight_occupancy <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 81%] 3537s tests/test_steal.py::test_get_story <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 81%] 3538s tests/test_steal.py::test_steal_worker_dies_same_ip <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 81%] 3538s tests/test_steal.py::test_reschedule_concurrent_requests_deadlock <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 81%] 3538s tests/test_steal.py::test_correct_bad_time_estimate <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py SKIPPED [ 81%] 3540s tests/test_steal.py::test_steal_stimulus_id_unique <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 81%] 3540s tests/test_steal.py::test_steal_worker_state[executing] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 81%] 3540s tests/test_steal.py::test_steal_worker_state[long-running] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 81%] 3543s tests/test_steal.py::test_steal_very_fast_tasks <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 81%] 3543s tests/test_steal.py::test_balance_expensive_tasks[not enough work to steal] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 81%] 3543s tests/test_steal.py::test_balance_expensive_tasks[enough work to steal] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 81%] 3544s tests/test_steal.py::test_balance_expensive_tasks[not enough work for increased cost] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 81%] 3544s tests/test_steal.py::test_balance_uneven_without_replica <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 81%] 3544s tests/test_steal.py::test_balance_eventually_steals_large_dependency_without_replica <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 81%] 3545s tests/test_steal.py::test_balance_even_with_replica <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 81%] 3546s tests/test_steal.py::test_balance_to_replica <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 81%] 3547s tests/test_steal.py::test_balance_multiple_to_replica <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 81%] 3548s tests/test_steal.py::test_balance_to_larger_dependency <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 81%] 3550s tests/test_steal.py::test_balance_prefers_busier_with_dependency <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 81%] 3552s tests/test_steal.py::test_trivial_workload_should_not_cause_work_stealing <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 81%] 3552s tests/test_stories.py::test_scheduler_story_stimulus_success <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_stories.py PASSED [ 81%] 3553s tests/test_stories.py::test_scheduler_story_stimulus_retry <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_stories.py PASSED [ 81%] 3553s tests/test_stories.py::test_client_story <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_stories.py PASSED [ 81%] 3553s tests/test_stories.py::test_client_story_failed_worker[ignore] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_stories.py PASSED [ 82%] 3553s tests/test_stories.py::test_client_story_failed_worker[raise] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_stories.py PASSED [ 82%] 3553s tests/test_stories.py::test_worker_story_with_deps <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_stories.py PASSED [ 82%] 3554s tests/test_stress.py::test_stress_1 <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_stress.py PASSED [ 82%] 3558s tests/test_stress.py::test_stress_gc[slowinc-100] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_stress.py PASSED [ 82%] 3566s tests/test_stress.py::test_stress_gc[inc-1000] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_stress.py PASSED [ 82%] 3571s tests/test_stress.py::test_cancel_stress <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_stress.py PASSED [ 82%] 3577s tests/test_stress.py::test_cancel_stress_sync <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_stress.py PASSED [ 82%] 3588s tests/test_stress.py::test_stress_creation_and_deletion <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_stress.py PASSED [ 82%] 3590s tests/test_stress.py::test_stress_scatter_death <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_stress.py PASSED [ 82%] 3590s tests/test_stress.py::test_stress_steal <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_stress.py SKIPPED [ 82%] 3602s tests/test_stress.py::test_close_connections <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_stress.py PASSED [ 82%] 3603s tests/test_stress.py::test_no_delay_during_large_transfer <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_stress.py SKIPPED [ 82%] 3619s tests/test_stress.py::test_chaos_rechunk <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_stress.py PASSED [ 82%] 3619s tests/test_system.py::test_memory_limit <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_system.py PASSED [ 82%] 3619s tests/test_system.py::test_hard_memory_limit_cgroups <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_system.py PASSED [ 82%] 3619s tests/test_system.py::test_soft_memory_limit_cgroups <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_system.py PASSED [ 82%] 3619s tests/test_system.py::test_hard_memory_limit_cgroups2 <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_system.py PASSED [ 82%] 3619s tests/test_system.py::test_soft_memory_limit_cgroups2 <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_system.py PASSED [ 82%] 3619s tests/test_system.py::test_softest_memory_limit_cgroups2 <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_system.py PASSED [ 82%] 3619s tests/test_system.py::test_rlimit <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_system.py PASSED [ 82%] 3619s tests/test_system_monitor.py::test_SystemMonitor <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_system_monitor.py PASSED [ 82%] 3619s tests/test_system_monitor.py::test_maxlen_zero <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_system_monitor.py PASSED [ 82%] 3619s tests/test_system_monitor.py::test_count <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_system_monitor.py PASSED [ 82%] 3619s tests/test_system_monitor.py::test_range_query <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_system_monitor.py PASSED [ 82%] 3619s tests/test_system_monitor.py::test_disk_config <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_system_monitor.py PASSED [ 82%] 3619s tests/test_system_monitor.py::test_host_cpu <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_system_monitor.py PASSED [ 82%] 3619s tests/test_system_monitor.py::test_gil_contention <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_system_monitor.py SKIPPED [ 82%] 3619s tests/test_threadpoolexecutor.py::test_tpe <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_threadpoolexecutor.py PASSED [ 82%] 3619s tests/test_threadpoolexecutor.py::test_shutdown_timeout <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_threadpoolexecutor.py PASSED [ 82%] 3619s tests/test_threadpoolexecutor.py::test_shutdown_timeout_raises <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_threadpoolexecutor.py PASSED [ 82%] 3619s tests/test_threadpoolexecutor.py::test_shutdown_wait <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_threadpoolexecutor.py PASSED [ 82%] 3621s tests/test_threadpoolexecutor.py::test_secede_rejoin_busy <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_threadpoolexecutor.py PASSED [ 82%] 3621s tests/test_threadpoolexecutor.py::test_secede_rejoin_quiet <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_threadpoolexecutor.py PASSED [ 82%] 3621s tests/test_threadpoolexecutor.py::test_rejoin_idempotent <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_threadpoolexecutor.py PASSED [ 82%] 3621s tests/test_threadpoolexecutor.py::test_thread_name <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_threadpoolexecutor.py PASSED [ 82%] 3621s tests/test_tls_functional.py::test_basic <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_tls_functional.py PASSED [ 83%] 3621s tests/test_tls_functional.py::test_Queue <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_tls_functional.py PASSED [ 83%] 3621s tests/test_tls_functional.py::test_client_submit <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_tls_functional.py PASSED [ 83%] 3622s tests/test_tls_functional.py::test_gather <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_tls_functional.py PASSED [ 83%] 3622s tests/test_tls_functional.py::test_scatter <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_tls_functional.py PASSED [ 83%] 3682s tests/test_tls_functional.py::test_nanny <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_tls_functional.py FAILED [ 83%] 3682s tests/test_tls_functional.py::test_rebalance <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_tls_functional.py PASSED [ 83%] 3684s tests/test_tls_functional.py::test_work_stealing <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_tls_functional.py PASSED [ 83%] 3684s tests/test_tls_functional.py::test_worker_client <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_tls_functional.py PASSED [ 83%] 3684s tests/test_tls_functional.py::test_worker_client_gather <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_tls_functional.py PASSED [ 83%] 3685s tests/test_tls_functional.py::test_worker_client_executor <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_tls_functional.py PASSED [ 83%] 3745s tests/test_tls_functional.py::test_retire_workers <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_tls_functional.py FAILED [ 83%] 3745s tests/test_tls_functional.py::test_security_dict_input_no_security <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_tls_functional.py PASSED [ 83%] 3745s tests/test_tls_functional.py::test_security_dict_input <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_tls_functional.py PASSED [ 83%] 3745s tests/test_utils.py::test_All <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 83%] 3745s tests/test_utils.py::test_sync <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 83%] 3745s tests/test_utils.py::test_sync_error <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 83%] 3745s tests/test_utils.py::test_sync_timeout <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 83%] 3745s tests/test_utils.py::test_sync_closed_loop <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 83%] 3745s tests/test_utils.py::test_sync_contextvars <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 83%] 3745s tests/test_utils.py::test_is_kernel <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 83%] 3745s tests/test_utils.py::test_ensure_ip <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 83%] 3745s tests/test_utils.py::test_get_ip_interface <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 83%] 3745s tests/test_utils.py::test_get_mp_context <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 83%] 3745s tests/test_utils.py::test_truncate_exception <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 83%] 3745s tests/test_utils.py::test_get_traceback <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 83%] 3745s tests/test_utils.py::test_read_block <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 83%] 3745s tests/test_utils.py::test_seek_delimiter_endline <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 83%] 3745s tests/test_utils.py::test_ensure_memoryview[] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 83%] 3745s tests/test_utils.py::test_ensure_memoryview[data1] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 83%] 3745s tests/test_utils.py::test_ensure_memoryview[1] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 83%] 3745s tests/test_utils.py::test_ensure_memoryview[data3] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 83%] 3745s tests/test_utils.py::test_ensure_memoryview[data4] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 83%] 3745s tests/test_utils.py::test_ensure_memoryview[data5] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 83%] 3745s tests/test_utils.py::test_ensure_memoryview[data6] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 83%] 3745s tests/test_utils.py::test_ensure_memoryview[data7] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 83%] 3745s tests/test_utils.py::test_ensure_memoryview[data8] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 84%] 3745s tests/test_utils.py::test_ensure_memoryview[data9] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 84%] 3745s tests/test_utils.py::test_ensure_memoryview[data10] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 84%] 3746s tests/test_utils.py::test_ensure_memoryview[data11] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 84%] 3746s tests/test_utils.py::test_ensure_memoryview[data12] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 84%] 3746s tests/test_utils.py::test_ensure_memoryview[data13] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 84%] 3746s tests/test_utils.py::test_ensure_memoryview[data14] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 84%] 3746s tests/test_utils.py::test_ensure_memoryview_ndarray[i8-12-shape0-strides0] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 84%] 3746s tests/test_utils.py::test_ensure_memoryview_ndarray[i8-12-shape1-strides1] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 84%] 3746s tests/test_utils.py::test_ensure_memoryview_ndarray[i8-12-shape2-strides2] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 84%] 3746s tests/test_utils.py::test_ensure_memoryview_ndarray[i8-12-shape3-strides3] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 84%] 3746s tests/test_utils.py::test_ensure_memoryview_ndarray[i8-12-shape4-strides4] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 84%] 3746s tests/test_utils.py::test_ensure_memoryview_pyarrow_buffer <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py SKIPPED [ 84%] 3746s tests/test_utils.py::test_nbytes <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 84%] 3746s tests/test_utils.py::test_open_port <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 84%] 3746s tests/test_utils.py::test_set_thread_state <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 84%] 3746s tests/test_utils.py::test_loop_runner <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 84%] 3746s tests/test_utils.py::test_two_loop_runners <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 84%] 3746s tests/test_utils.py::test_loop_runner_gen <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 84%] 3746s tests/test_utils.py::test_loop_runner_exception_in_start <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 84%] 3746s tests/test_utils.py::test_loop_runner_exception_in_teardown <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 84%] 3746s tests/test_utils.py::test_all_quiet_exceptions <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 84%] 3746s tests/test_utils.py::test_warn_on_duration <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 84%] 3746s tests/test_utils.py::test_logs <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 84%] 3746s tests/test_utils.py::test_is_valid_xml <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 84%] 3746s tests/test_utils.py::test_format_dashboard_link <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 84%] 3746s tests/test_utils.py::test_parse_ports <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 84%] 3746s tests/test_utils.py::test_run_in_executor_with_context <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 84%] 3746s tests/test_utils.py::test_run_in_executor_with_context_preserves_contextvars <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 84%] 3746s tests/test_utils.py::test_offload <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 84%] 3746s tests/test_utils.py::test_offload_preserves_contextvars <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 84%] 3746s tests/test_utils.py::test_no_default_deprecated <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 84%] 3746s tests/test_utils.py::test_iscoroutinefunction_unhashable_input <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 84%] 3746s tests/test_utils.py::test_iscoroutinefunction_nested_partial <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 84%] 3746s tests/test_utils.py::test_recursive_to_dict <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 84%] 3746s tests/test_utils.py::test_recursive_to_dict_no_nest <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 84%] 3746s tests/test_utils.py::test_log_errors <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 84%] 3746s tests/test_utils.py::test_log_errors_unroll_stack[0-test_utils] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 85%] 3746s tests/test_utils.py::test_log_errors_unroll_stack[1-a.b.c] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 85%] 3746s tests/test_utils.py::test_load_json_robust_timeout <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 85%] 3746s tests/test_utils.py::test_rate_limiter_filter <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 85%] 3746s tests/test_utils.py::test_tuple_comparable_lt[obj10-obj20-False] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 85%] 3746s tests/test_utils.py::test_tuple_comparable_lt[obj11-obj21-True] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 85%] 3746s tests/test_utils.py::test_tuple_comparable_lt[1-1-False] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 85%] 3746s tests/test_utils.py::test_tuple_comparable_lt[1-2-True] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 85%] 3746s tests/test_utils.py::test_tuple_comparable_lt[None-0-False] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 85%] 3746s tests/test_utils.py::test_tuple_comparable_lt[None-obj25-True] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 85%] 3746s tests/test_utils.py::test_tuple_comparable_eq[obj10-obj20-True] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 85%] 3746s tests/test_utils.py::test_tuple_comparable_eq[obj11-obj21-False] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 85%] 3746s tests/test_utils.py::test_tuple_comparable_eq[1-1-True] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 85%] 3746s tests/test_utils.py::test_tuple_comparable_eq[1-2-False] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 85%] 3746s tests/test_utils.py::test_tuple_comparable_eq[None-0-True] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 85%] 3746s tests/test_utils.py::test_tuple_comparable_eq[None-obj25-False] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 85%] 3746s tests/test_utils.py::test_tuple_comparable_error <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 85%] 3746s tests/test_utils_comm.py::test_pack_data <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_comm.py PASSED [ 85%] 3746s tests/test_utils_comm.py::test_subs_multiple <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_comm.py PASSED [ 85%] 3747s tests/test_utils_comm.py::test_gather_from_workers_missing_replicas <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_comm.py PASSED [ 85%] 3747s tests/test_utils_comm.py::test_gather_from_workers_permissive <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_comm.py PASSED [ 85%] 3747s tests/test_utils_comm.py::test_gather_from_workers_permissive_flaky <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_comm.py PASSED [ 85%] 3747s tests/test_utils_comm.py::test_gather_from_workers_busy <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_comm.py PASSED [ 85%] 3747s tests/test_utils_comm.py::test_gather_from_workers_serialization_error[pickle] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_comm.py PASSED [ 85%] 3748s tests/test_utils_comm.py::test_gather_from_workers_serialization_error[unpickle] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_comm.py PASSED [ 85%] 3748s tests/test_utils_comm.py::test_retry_no_exception <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_comm.py PASSED [ 85%] 3748s tests/test_utils_comm.py::test_retry0_raises_immediately <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_comm.py PASSED [ 85%] 3748s tests/test_utils_comm.py::test_retry_does_retry_and_sleep <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_comm.py PASSED [ 85%] 3748s tests/test_utils_comm.py::test_unpack_remotedata <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_comm.py PASSED [ 85%] 3752s tests/test_utils_test.py::test_bare_cluster <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 85%] 3752s tests/test_utils_test.py::test_gen_cluster <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 85%] 3753s tests/test_utils_test.py::test_gen_cluster_pytest_fixture <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 85%] 3753s tests/test_utils_test.py::test_gen_cluster_parametrized[True] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 85%] 3753s tests/test_utils_test.py::test_gen_cluster_multi_parametrized[a-True] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 85%] 3753s tests/test_utils_test.py::test_gen_cluster_multi_parametrized[b-True] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 85%] 3753s tests/test_utils_test.py::test_gen_cluster_parametrized_variadic_workers[True] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 85%] 3755s tests/test_utils_test.py::test_gen_cluster_set_config_nanny <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 86%] 3755s tests/test_utils_test.py::test_gen_cluster_cleans_up_client <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py SKIPPED [ 86%] 3755s tests/test_utils_test.py::test_gen_cluster_without_client <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 86%] 3755s tests/test_utils_test.py::test_gen_cluster_tls <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 86%] 3755s tests/test_utils_test.py::test_gen_cluster_validate <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 86%] 3755s tests/test_utils_test.py::test_gen_cluster_validate_override <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 86%] 3755s tests/test_utils_test.py::test_gen_test <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py XFAILn) [ 86%] 3755s tests/test_utils_test.py::test_gen_test_legacy_implicit <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py XFAIL [ 86%] 3755s tests/test_utils_test.py::test_gen_test_legacy_explicit <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py XFAIL [ 86%] 3755s tests/test_utils_test.py::test_gen_test_parametrized[True] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 86%] 3755s tests/test_utils_test.py::test_gen_test_double_parametrized[False-True] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 86%] 3755s tests/test_utils_test.py::test_gen_test_pytest_fixture <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 86%] 3755s tests/test_utils_test.py::test_gen_test_config <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 86%] 3755s tests/test_utils_test.py::test_gen_test_config_default <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 86%] 3755s tests/test_utils_test.py::test_new_config <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 86%] 3756s tests/test_utils_test.py::test_lingering_client <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 86%] 3758s tests/test_utils_test.py::test_lingering_client_2 <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 86%] 3759s tests/test_utils_test.py::test_tls_cluster <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 86%] 3760s tests/test_utils_test.py::test_tls_scheduler <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 86%] 3760s tests/test_utils_test.py::test__UnhashableCallable <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 86%] 3760s tests/test_utils_test.py::test_locked_comm_drop_in_replacement <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 86%] 3760s tests/test_utils_test.py::test_locked_comm_intercept_read <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 86%] 3760s tests/test_utils_test.py::test_locked_comm_intercept_write <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 86%] 3760s tests/test_utils_test.py::test_assert_story <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 86%] 3760s tests/test_utils_test.py::test_assert_story_malformed_story[Missing payload, stimulus_id, ts] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 86%] 3760s tests/test_utils_test.py::test_assert_story_malformed_story[Missing (stimulus_id, ts)] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 86%] 3760s tests/test_utils_test.py::test_assert_story_malformed_story[Missing ts] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 86%] 3760s tests/test_utils_test.py::test_assert_story_malformed_story[ts is not a float] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 86%] 3760s tests/test_utils_test.py::test_assert_story_malformed_story[ts is in the future] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 86%] 3760s tests/test_utils_test.py::test_assert_story_malformed_story[ts is too old] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 86%] 3760s tests/test_utils_test.py::test_assert_story_malformed_story[stimulus_id is not a str] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 86%] 3760s tests/test_utils_test.py::test_assert_story_malformed_story[stimulus_id is an empty str] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 86%] 3760s tests/test_utils_test.py::test_assert_story_malformed_story[no payload] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 86%] 3760s tests/test_utils_test.py::test_assert_story_malformed_story[timestamps out of order] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 86%] 3760s tests/test_utils_test.py::test_assert_story_identity[True] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 86%] 3760s tests/test_utils_test.py::test_assert_story_identity[False] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 86%] 3761s tests/test_utils_test.py::test_check_process_leak <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 87%] 3762s tests/test_utils_test.py::test_check_process_leak_slow_cleanup <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 87%] 3763s tests/test_utils_test.py::test_check_process_leak_pre_cleanup[False] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 87%] 3765s tests/test_utils_test.py::test_check_process_leak_pre_cleanup[True] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 87%] 3766s tests/test_utils_test.py::test_check_process_leak_post_cleanup[False] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 87%] 3767s tests/test_utils_test.py::test_check_process_leak_post_cleanup[True] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 87%] 3769s tests/test_utils_test.py::test_start_failure_worker[True] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 87%] 3770s tests/test_utils_test.py::test_start_failure_worker[False] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 87%] 3771s tests/test_utils_test.py::test_start_failure_scheduler <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 87%] 3772s tests/test_utils_test.py::test_invalid_transitions <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 87%] 3772s tests/test_utils_test.py::test_invalid_worker_state <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 87%] 3772s tests/test_utils_test.py::test_raises_with_cause <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 87%] 3777s tests/test_utils_test.py::test_check_thread_leak <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 87%] 3777s tests/test_utils_test.py::test_fail_hard[True] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 87%] 3777s tests/test_utils_test.py::test_fail_hard[False] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 87%] 3777s tests/test_utils_test.py::test_popen_write_during_terminate_deadlock <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 87%] 3787s tests/test_utils_test.py::test_popen_timeout <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 87%] 3787s tests/test_utils_test.py::test_popen_always_prints_output <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 87%] 3787s tests/test_utils_test.py::test_freeze_batched_send <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 87%] 3787s tests/test_utils_test.py::test_wait_for_state <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 87%] 3787s tests/test_utils_test.py::test_wait_for_stimulus <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 87%] 3787s tests/test_utils_test.py::test_ws_with_running_task[executing] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 87%] 3787s tests/test_utils_test.py::test_ws_with_running_task[long-running] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 87%] 3787s tests/test_utils_test.py::test_sizeof <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 87%] 3787s tests/test_utils_test.py::test_sizeof_error[12345.0-TypeError-Expected integer] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 87%] 3787s tests/test_utils_test.py::test_sizeof_error[-1-ValueError-larger than] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 87%] 3788s tests/test_utils_test.py::test_sizeof_error[0-ValueError-larger than] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 87%] 3788s tests/test_utils_test.py::test_sizeof_error[10-ValueError-larger than] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 87%] 3788s tests/test_utils_test.py::test_ensure_no_new_clients <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 87%] 3788s tests/test_utils_test.py::test_captured_logger <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 87%] 3788s tests/test_utils_test.py::test_captured_context_meter <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 87%] 3788s tests/test_variable.py::test_variable <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_variable.py PASSED [ 87%] 3788s tests/test_variable.py::test_delete_unset_variable <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_variable.py PASSED [ 87%] 3788s tests/test_variable.py::test_queue_with_data <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_variable.py PASSED [ 87%] 3790s tests/test_variable.py::test_sync <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_variable.py PASSED [ 87%] 3790s tests/test_variable.py::test_hold_futures <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_variable.py PASSED [ 87%] 3791s tests/test_variable.py::test_timeout <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_variable.py PASSED [ 88%] 3793s tests/test_variable.py::test_timeout_sync <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_variable.py PASSED [ 88%] 3793s tests/test_variable.py::test_cleanup <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_variable.py PASSED [ 88%] 3795s tests/test_variable.py::test_pickleable <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_variable.py PASSED [ 88%] 3795s tests/test_variable.py::test_timeout_get <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_variable.py PASSED [ 88%] 3799s tests/test_variable.py::test_race <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_variable.py PASSED [ 88%] 3799s tests/test_variable.py::test_Future_knows_status_immediately <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_variable.py PASSED [ 88%] 3800s tests/test_variable.py::test_erred_future <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_variable.py PASSED [ 88%] 3802s tests/test_variable.py::test_future_erred_sync <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_variable.py PASSED [ 88%] 3802s tests/test_variable.py::test_variables_do_not_leak_client <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_variable.py PASSED [ 88%] 3802s tests/test_variable.py::test_unpickle_without_client <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_variable.py PASSED [ 88%] 3802s tests/test_variable.py::test_set_cancelled_future <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_variable.py PASSED [ 88%] 3802s tests/test_versions.py::test_versions_match <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_versions.py PASSED [ 88%] 3802s tests/test_versions.py::test_version_mismatch[source-MISMATCHED] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_versions.py PASSED [ 88%] 3802s tests/test_versions.py::test_version_mismatch[source-MISSING] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_versions.py PASSED [ 88%] 3802s tests/test_versions.py::test_version_mismatch[source-KEY_ERROR] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_versions.py PASSED [ 88%] 3802s tests/test_versions.py::test_version_mismatch[source-NONE] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_versions.py PASSED [ 88%] 3802s tests/test_versions.py::test_version_mismatch[scheduler-MISMATCHED] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_versions.py PASSED [ 88%] 3802s tests/test_versions.py::test_version_mismatch[scheduler-MISSING] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_versions.py PASSED [ 88%] 3802s tests/test_versions.py::test_version_mismatch[scheduler-KEY_ERROR] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_versions.py PASSED [ 88%] 3802s tests/test_versions.py::test_version_mismatch[scheduler-NONE] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_versions.py PASSED [ 88%] 3802s tests/test_versions.py::test_version_mismatch[worker-1-MISMATCHED] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_versions.py PASSED [ 88%] 3802s tests/test_versions.py::test_version_mismatch[worker-1-MISSING] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_versions.py PASSED [ 88%] 3802s tests/test_versions.py::test_version_mismatch[worker-1-KEY_ERROR] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_versions.py PASSED [ 88%] 3802s tests/test_versions.py::test_version_mismatch[worker-1-NONE] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_versions.py PASSED [ 88%] 3802s tests/test_versions.py::test_scheduler_mismatched_irrelevant_package <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_versions.py PASSED [ 88%] 3802s tests/test_versions.py::test_scheduler_additional_irrelevant_package <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_versions.py PASSED [ 88%] 3802s tests/test_versions.py::test_python_mismatch[source] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_versions.py PASSED [ 88%] 3802s tests/test_versions.py::test_python_mismatch[scheduler] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_versions.py PASSED [ 88%] 3802s tests/test_versions.py::test_python_mismatch[worker-1] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_versions.py PASSED [ 88%] 3802s tests/test_versions.py::test_version_warning_in_cluster <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_versions.py PASSED [ 88%] 3802s tests/test_versions.py::test_python_version <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_versions.py PASSED [ 88%] 3802s tests/test_versions.py::test_version_custom_pkgs <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_versions.py PASSED [ 88%] 3802s tests/test_worker.py::test_worker_nthreads <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 88%] 3802s tests/test_worker.py::test_str <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 88%] 3802s tests/test_worker.py::test_identity <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 88%] 3803s tests/test_worker.py::test_worker_bad_args <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 88%] 3805s tests/test_worker.py::test_upload_file <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 89%] 3805s tests/test_worker.py::test_upload_file_pyc <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py SKIPPED [ 89%] 3805s tests/test_worker.py::test_upload_egg <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 89%] 3805s tests/test_worker.py::test_upload_pyz <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 89%] 3805s tests/test_worker.py::test_upload_large_file <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py SKIPPED [ 89%] 3806s tests/test_worker.py::test_broadcast <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 89%] 3806s tests/test_worker.py::test_worker_with_port_zero <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 89%] 3806s tests/test_worker.py::test_worker_port_range <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 89%] 3809s tests/test_worker.py::test_worker_waits_for_scheduler <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 89%] 3809s tests/test_worker.py::test_worker_task_data <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 89%] 3809s tests/test_worker.py::test_error_message <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 89%] 3809s tests/test_worker.py::test_chained_error_message <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 89%] 3811s tests/test_worker.py::test_base_exception_in_task[BaseException-True] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 89%] 3812s tests/test_worker.py::test_base_exception_in_task[BaseException-False] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 89%] 3817s tests/test_worker.py::test_base_exception_in_task[SystemExit-True] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 89%] 3821s tests/test_worker.py::test_base_exception_in_task[SystemExit-False] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 89%] 3826s tests/test_worker.py::test_base_exception_in_task[KeyboardInterrupt-True] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 89%] 3831s tests/test_worker.py::test_base_exception_in_task[KeyboardInterrupt-False] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 89%] 3832s tests/test_worker.py::test_base_exception_in_task[CancelledError-True] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 89%] 3833s tests/test_worker.py::test_base_exception_in_task[CancelledError-False] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 89%] 3833s tests/test_worker.py::test_plugin_exception <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 89%] 3833s tests/test_worker.py::test_plugin_multiple_exceptions <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 89%] 3834s tests/test_worker.py::test_plugin_internal_exception <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 89%] 3834s tests/test_worker.py::test_gather <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 89%] 3834s tests/test_worker.py::test_gather_missing_keys <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 89%] 3834s tests/test_worker.py::test_gather_missing_workers <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 89%] 3835s tests/test_worker.py::test_gather_missing_workers_replicated[False] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 89%] 3836s tests/test_worker.py::test_gather_missing_workers_replicated[True0] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 89%] 3836s tests/test_worker.py::test_gather_missing_workers_replicated[True1] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 89%] 3837s tests/test_worker.py::test_gather_missing_workers_replicated[True2] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 89%] 3837s tests/test_worker.py::test_gather_missing_workers_replicated[True3] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 89%] 3837s tests/test_worker.py::test_io_loop <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 89%] 3837s tests/test_worker.py::test_io_loop_alternate_loop <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 89%] 3837s tests/test_worker.py::test_access_key <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 89%] 3837s tests/test_worker.py::test_run_dask_worker <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 89%] 3838s tests/test_worker.py::test_run_dask_worker_kwonlyarg <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 89%] 3838s tests/test_worker.py::test_run_coroutine_dask_worker <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 90%] 3838s tests/test_worker.py::test_Executor <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 90%] 3838s tests/test_worker.py::test_close_on_disconnect <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 90%] 3838s tests/test_worker.py::test_memory_limit_auto <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 90%] 3838s tests/test_worker.py::test_inter_worker_communication <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 90%] 3838s tests/test_worker.py::test_clean <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 90%] 3839s tests/test_worker.py::test_message_breakup <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 90%] 3839s tests/test_worker.py::test_types <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 90%] 3839s tests/test_worker.py::test_system_monitor <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 90%] 3839s tests/test_worker.py::test_restrictions <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 90%] 3840s tests/test_worker.py::test_clean_nbytes <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 90%] 3841s tests/test_worker.py::test_gather_many_small[True] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 90%] 3842s tests/test_worker.py::test_gather_many_small[False] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 90%] 3842s tests/test_worker.py::test_multiple_transfers <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 90%] 3843s tests/test_worker.py::test_share_communication <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py XFAIL [ 90%] 3843s tests/test_worker.py::test_dont_overlap_communications_to_same_worker <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py XFAIL [ 90%] 3843s tests/test_worker.py::test_log_exception_on_failed_task <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 90%] 3843s tests/test_worker.py::test_clean_up_dependencies <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 90%] 3844s tests/test_worker.py::test_hold_onto_dependents <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 90%] 3844s tests/test_worker.py::test_worker_death_timeout <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py XPASS [ 90%] 3844s tests/test_worker.py::test_stop_doing_unnecessary_work <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 90%] 3844s tests/test_worker.py::test_priorities <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 90%] 3846s tests/test_worker.py::test_heartbeats <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 90%] 3846s tests/test_worker.py::test_worker_dir[Worker] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 90%] 3846s tests/test_worker.py::test_worker_dir[Nanny] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 90%] 3847s tests/test_worker.py::test_default_worker_dir <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 90%] 3847s tests/test_worker.py::test_dataframe_attribute_error <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 90%] 3847s tests/test_worker.py::test_pid <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 90%] 3848s tests/test_worker.py::test_get_client <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 90%] 3850s tests/test_worker.py::test_get_client_sync <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 90%] 3850s tests/test_worker.py::test_get_client_coroutine <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 90%] 3852s tests/test_worker.py::test_get_client_coroutine_sync <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py XFAIL/distributed/pull/7339) [ 90%] 3852s tests/test_worker.py::test_global_workers <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 90%] 3852s tests/test_worker.py::test_worker_fds <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 90%] 3852s tests/test_worker.py::test_service_hosts_match_worker <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 90%] 3852s tests/test_worker.py::test_start_services <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 90%] 3853s tests/test_worker.py::test_scheduler_file <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 91%] 3854s tests/test_worker.py::test_scheduler_delay <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 91%] 3855s tests/test_worker.py::test_statistical_profiling <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 91%] 3856s tests/test_worker.py::test_statistical_profiling_2 <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 91%] 3856s tests/test_worker.py::test_statistical_profiling_cycle <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 91%] 3856s tests/test_worker.py::test_get_current_task <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 91%] 3856s tests/test_worker.py::test_deque_handler <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 91%] 3856s tests/test_worker.py::test_scheduler_address_config <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 91%] 3857s tests/test_worker.py::test_wait_for_outgoing <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py XFAIL [ 91%] 3857s tests/test_worker.py::test_prefer_gather_from_local_address <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 91%] 3858s tests/test_worker.py::test_avoid_oversubscription <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 91%] 3858s tests/test_worker.py::test_custom_metrics <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 91%] 3859s tests/test_worker.py::test_register_worker_callbacks <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 91%] 3859s tests/test_worker.py::test_register_worker_callbacks_err <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 91%] 3859s tests/test_worker.py::test_local_directory <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 91%] 3859s tests/test_worker.py::test_local_directory_make_new_directory <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 91%] 3860s tests/test_worker.py::test_host_address <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 91%] 3860s tests/test_worker.py::test_interface_async[Worker] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 91%] 3862s tests/test_worker.py::test_interface_async[Nanny] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 91%] 3862s tests/test_worker.py::test_protocol_from_scheduler_address[Worker] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py SKIPPED [ 91%] 3862s tests/test_worker.py::test_protocol_from_scheduler_address[Nanny] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py SKIPPED [ 91%] 3862s tests/test_worker.py::test_host_uses_scheduler_protocol <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 91%] 3862s tests/test_worker.py::test_worker_listens_on_same_interface_by_default[Worker] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 91%] 3863s tests/test_worker.py::test_worker_listens_on_same_interface_by_default[Nanny] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 91%] 3864s tests/test_worker.py::test_close_gracefully <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 91%] 3866s tests/test_worker.py::test_close_gracefully_no_suspicious_tasks <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 91%] 3866s tests/test_worker.py::test_close_while_executing[False] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 91%] 3868s tests/test_worker.py::test_close_while_executing[True] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 91%] 3869s tests/test_worker.py::test_close_async_task_handles_cancellation <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 91%] 3873s tests/test_worker.py::test_lifetime <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 91%] 3873s tests/test_worker.py::test_lifetime_stagger <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 91%] 3873s tests/test_worker.py::test_bad_metrics <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 91%] 3873s tests/test_worker.py::test_bad_startup <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 91%] 3873s tests/test_worker.py::test_update_latency <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 91%] 3876s tests/test_worker.py::test_workerstate_executing <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 91%] 3877s tests/test_worker.py::test_shutdown_on_scheduler_comm_closed <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 91%] 3877s tests/test_worker.py::test_heartbeat_comm_closed <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 92%] 3877s tests/test_worker.py::test_heartbeat_missing <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 92%] 3877s tests/test_worker.py::test_heartbeat_missing_real_cluster <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 92%] 3881s tests/test_worker.py::test_heartbeat_missing_doesnt_restart <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 92%] 3881s tests/test_worker.py::test_bad_local_directory <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 92%] 3881s tests/test_worker.py::test_taskstate_metadata <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 92%] 3881s tests/test_worker.py::test_executor_offload <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 92%] 3881s tests/test_worker.py::test_story <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 92%] 3881s tests/test_worker.py::test_stimulus_story <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 92%] 3884s tests/test_worker.py::test_worker_descopes_data <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 92%] 3885s tests/test_worker.py::test_gather_dep_one_worker_always_busy <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 92%] 3885s tests/test_worker.py::test_gather_dep_local_workers_first <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 92%] 3886s tests/test_worker.py::test_gather_dep_from_remote_workers_if_all_local_workers_are_busy <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 92%] 3886s tests/test_worker.py::test_worker_client_uses_default_no_close <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 92%] 3886s tests/test_worker.py::test_worker_client_closes_if_created_on_worker_one_worker <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 92%] 3886s tests/test_worker.py::test_worker_client_closes_if_created_on_worker_last_worker_alive <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 92%] 3887s tests/test_worker.py::test_multiple_executors <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 92%] 3887s tests/test_worker.py::test_bad_executor_annotation <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 92%] 3888s tests/test_worker.py::test_process_executor <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 92%] 3890s tests/test_worker.py::test_process_executor_raise_exception <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 92%] 3890s tests/test_worker.py::test_worker_state_error_release_error_last <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 92%] 3890s tests/test_worker.py::test_worker_state_error_release_error_first <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 92%] 3890s tests/test_worker.py::test_worker_state_error_release_error_int <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 92%] 3891s tests/test_worker.py::test_worker_state_error_long_chain <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 92%] 3891s tests/test_worker.py::test_hold_on_to_replicas <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 92%] 3891s tests/test_worker.py::test_forget_dependents_after_release <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 92%] 3891s tests/test_worker.py::test_acquire_replicas <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 92%] 3892s tests/test_worker.py::test_acquire_replicas_same_channel <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 92%] 3892s tests/test_worker.py::test_acquire_replicas_many <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 92%] 3892s tests/test_worker.py::test_acquire_replicas_already_in_flight <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 92%] 3894s tests/test_worker.py::test_forget_acquire_replicas <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 92%] 3894s tests/test_worker.py::test_remove_replicas_simple <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 92%] 3894s tests/test_worker.py::test_who_has_consistent_remove_replicas <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 92%] 3894s tests/test_worker.py::test_acquire_replicas_with_no_priority <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 92%] 3894s tests/test_worker.py::test_acquire_replicas_large_data <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 92%] 3895s tests/test_worker.py::test_missing_released_zombie_tasks <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 92%] 3895s tests/test_worker.py::test_missing_released_zombie_tasks_2 <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 92%] 3895s tests/test_worker.py::test_worker_status_sync <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 93%] 3895s tests/test_worker.py::test_log_remove_worker <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 93%] 3896s tests/test_worker.py::test_task_flight_compute_oserror <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 93%] 3896s tests/test_worker.py::test_gather_dep_cancelled_rescheduled <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 93%] 3896s tests/test_worker.py::test_gather_dep_do_not_handle_response_of_not_requested_tasks <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 93%] 3896s tests/test_worker.py::test_gather_dep_no_longer_in_flight_tasks <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 93%] 3898s tests/test_worker.py::test_get_data_cancelled_error <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 93%] 3898s tests/test_worker.py::test_Worker__to_dict <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 93%] 3898s tests/test_worker.py::test_extension_methods <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 93%] 3898s tests/test_worker.py::test_benchmark_hardware <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 93%] 3901s tests/test_worker.py::test_tick_interval <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 93%] 3902s tests/test_worker.py::test_broken_comm <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 93%] 3902s tests/test_worker.py::test_do_not_block_event_loop_during_shutdown <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 93%] 3903s tests/test_worker.py::test_reconnect_argument_deprecated <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 93%] 3903s tests/test_worker.py::test_worker_running_before_running_plugins <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 93%] 3903s tests/test_worker.py::test_execute_preamble_abort_retirement <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 93%] 3903s tests/test_worker.py::test_deprecation_of_renamed_worker_attributes <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 93%] 3905s tests/test_worker.py::test_forward_output <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 93%] 3905s tests/test_worker.py::test_offload_getdata <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 93%] 3905s tests/test_worker.py::test_startstops <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 93%] 3905s tests/test_worker.py::test_suppress_keyerror_for_cancelled_tasks[cancelled] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 93%] 3906s tests/test_worker.py::test_suppress_keyerror_for_cancelled_tasks[resumed] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 93%] 3906s tests/test_worker.py::test_suppress_compute_failure_for_cancelled_tasks <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 93%] 3906s tests/test_worker_client.py::test_submit_from_worker <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_client.py PASSED [ 93%] 3907s tests/test_worker_client.py::test_submit_from_worker_async <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_client.py PASSED [ 93%] 3908s tests/test_worker_client.py::test_scatter_from_worker <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_client.py PASSED [ 93%] 3908s tests/test_worker_client.py::test_scatter_singleton <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_client.py PASSED [ 93%] 3908s tests/test_worker_client.py::test_gather_multi_machine <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_client.py PASSED [ 93%] 3908s tests/test_worker_client.py::test_same_loop <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_client.py PASSED [ 93%] 3910s tests/test_worker_client.py::test_sync <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_client.py PASSED [ 93%] 3911s tests/test_worker_client.py::test_async <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_client.py PASSED [ 93%] 3911s tests/test_worker_client.py::test_separate_thread_false <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_client.py PASSED [ 93%] 3911s tests/test_worker_client.py::test_client_executor <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_client.py PASSED [ 93%] 3912s tests/test_worker_client.py::test_dont_override_default_get <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_client.py PASSED [ 93%] 3912s tests/test_worker_client.py::test_local_client_warning <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_client.py PASSED [ 93%] 3912s tests/test_worker_client.py::test_closing_worker_doesnt_close_client <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_client.py PASSED [ 93%] 3914s tests/test_worker_client.py::test_timeout <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_client.py PASSED [ 94%] 3914s tests/test_worker_client.py::test_secede_without_stealing_issue_1262 <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_client.py PASSED [ 94%] 3914s tests/test_worker_client.py::test_compute_within_worker_client <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_client.py PASSED [ 94%] 3914s tests/test_worker_client.py::test_worker_client_rejoins <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_client.py PASSED [ 94%] 3914s tests/test_worker_client.py::test_submit_different_names <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_client.py XPASS [ 94%] 3915s tests/test_worker_client.py::test_secede_does_not_claim_worker <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_client.py PASSED [ 94%] 3915s tests/test_worker_client.py::test_log_event <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_client.py PASSED [ 94%] 3916s tests/test_worker_client.py::test_log_event_implicit <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_client.py PASSED [ 94%] 3916s tests/test_worker_memory.py::test_parse_memory_limit_zero <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 94%] 3916s tests/test_worker_memory.py::test_resource_limit <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 94%] 3916s tests/test_worker_memory.py::test_parse_memory_limit_worker <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 94%] 3916s tests/test_worker_memory.py::test_parse_memory_limit_worker_relative <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 94%] 3917s tests/test_worker_memory.py::test_parse_memory_limit_nanny <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 94%] 3917s tests/test_worker_memory.py::test_dict_data_if_no_spill_to_disk <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 94%] 3917s tests/test_worker_memory.py::test_worker_data_callable_local_directory <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 94%] 3917s tests/test_worker_memory.py::test_worker_data_callable_local_directory_kwargs <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 94%] 3917s tests/test_worker_memory.py::test_worker_data_callable_kwargs <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 94%] 3917s tests/test_worker_memory.py::test_workerstate_fail_to_pickle_execute_1[executing] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 94%] 3917s tests/test_worker_memory.py::test_workerstate_fail_to_pickle_execute_1[long-running] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 94%] 3917s tests/test_worker_memory.py::test_workerstate_fail_to_pickle_flight <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 94%] 3918s tests/test_worker_memory.py::test_fail_to_pickle_execute_2 <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 94%] 3918s tests/test_worker_memory.py::test_fail_to_pickle_spill <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 94%] 3918s tests/test_worker_memory.py::test_spill_target_threshold <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 94%] 3918s tests/test_worker_memory.py::test_spill_constrained <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 94%] 3918s tests/test_worker_memory.py::test_spill_spill_threshold <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 94%] 3919s tests/test_worker_memory.py::test_spill_hysteresis[False-10000000000-1] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 94%] 3919s tests/test_worker_memory.py::test_spill_hysteresis[0.7-0-1] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 94%] 3919s tests/test_worker_memory.py::test_spill_hysteresis[0.4-0-7] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 94%] 3919s tests/test_worker_memory.py::test_pause_executor_manual <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 94%] 3922s tests/test_worker_memory.py::test_pause_executor_with_memory_monitor <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 94%] 3922s tests/test_worker_memory.py::test_pause_prevents_deps_fetch <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 94%] 3922s tests/test_worker_memory.py::test_avoid_memory_monitor_if_zero_limit_worker <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 94%] 3924s tests/test_worker_memory.py::test_avoid_memory_monitor_if_zero_limit_nanny <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 94%] 3924s tests/test_worker_memory.py::test_override_data_worker <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 94%] 3925s tests/test_worker_memory.py::test_override_data_nanny <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 94%] 3928s tests/test_worker_memory.py::test_override_data_vs_memory_monitor <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 94%] 3928s tests/test_worker_memory.py::test_manual_evict_proto <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 95%] 3931s tests/test_worker_memory.py::test_nanny_terminate <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 95%] 3935s tests/test_worker_memory.py::test_disk_cleanup_on_terminate[False] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 95%] 3940s tests/test_worker_memory.py::test_disk_cleanup_on_terminate[True] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 95%] 3942s tests/test_worker_memory.py::test_pause_while_spilling <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 95%] 3946s tests/test_worker_memory.py::test_release_evloop_while_spilling <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 95%] 3946s tests/test_worker_memory.py::test_deprecated_attributes[Worker-memory_limit-123000000000.0] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 95%] 3946s tests/test_worker_memory.py::test_deprecated_attributes[Worker-memory_target_fraction-0.789] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 95%] 3946s tests/test_worker_memory.py::test_deprecated_attributes[Worker-memory_spill_fraction-0.789] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 95%] 3946s tests/test_worker_memory.py::test_deprecated_attributes[Worker-memory_pause_fraction-0.789] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 95%] 3947s tests/test_worker_memory.py::test_deprecated_attributes[Nanny-memory_limit-123000000000.0] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 95%] 3949s tests/test_worker_memory.py::test_deprecated_attributes[Nanny-memory_terminate_fraction-0.789] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 95%] 3949s tests/test_worker_memory.py::test_deprecated_memory_monitor_method_worker <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 95%] 3950s tests/test_worker_memory.py::test_deprecated_memory_monitor_method_nanny <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 95%] 3950s tests/test_worker_memory.py::test_deprecated_params[memory_target_fraction] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 95%] 3950s tests/test_worker_memory.py::test_deprecated_params[memory_spill_fraction] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 95%] 3950s tests/test_worker_memory.py::test_deprecated_params[memory_pause_fraction] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 95%] 3953s tests/test_worker_memory.py::test_pause_while_idle <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 95%] 3955s tests/test_worker_memory.py::test_pause_while_saturated <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 95%] 3956s tests/test_worker_memory.py::test_worker_log_memory_limit_too_high <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 95%] 3956s tests/test_worker_memory.py::test_high_unmanaged_memory_warning <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 95%] 3956s tests/test_worker_memory.py::test_delete_spilled_keys <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 95%] 3956s tests/test_worker_metrics.py::test_task_lifecycle <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_metrics.py PASSED [ 95%] 3956s tests/test_worker_metrics.py::test_async_task <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_metrics.py PASSED [ 95%] 3958s tests/test_worker_metrics.py::test_custom_executor <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_metrics.py PASSED [ 95%] 3958s tests/test_worker_metrics.py::test_offload <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_metrics.py PASSED [ 95%] 3958s tests/test_worker_metrics.py::test_execute_failed <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_metrics.py PASSED [ 95%] 3958s tests/test_worker_metrics.py::test_cancelled_execute <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_metrics.py PASSED [ 95%] 3959s tests/test_worker_metrics.py::test_cancelled_flight <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_metrics.py PASSED [ 95%] 3959s tests/test_worker_metrics.py::test_gather_dep_busy <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_metrics.py PASSED [ 95%] 3960s tests/test_worker_metrics.py::test_gather_dep_no_task <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_metrics.py PASSED [ 95%] 3961s tests/test_worker_metrics.py::test_gather_dep_failed <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_metrics.py PASSED [ 95%] 3961s tests/test_worker_metrics.py::test_gather_dep_network_error <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_metrics.py PASSED [ 95%] 3962s tests/test_worker_metrics.py::test_memory_monitor <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_metrics.py PASSED [ 95%] 3962s tests/test_worker_metrics.py::test_user_metrics_sync <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_metrics.py PASSED [ 95%] 3962s tests/test_worker_metrics.py::test_user_metrics_async <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_metrics.py PASSED [ 95%] 3962s tests/test_worker_metrics.py::test_user_metrics_fail <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_metrics.py PASSED [ 96%] 3962s tests/test_worker_metrics.py::test_user_metrics_weird <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_metrics.py PASSED [ 96%] 3965s tests/test_worker_metrics.py::test_do_not_leak_metrics <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_metrics.py PASSED [ 96%] 3966s tests/test_worker_metrics.py::test_reschedule <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_metrics.py PASSED [ 96%] 3966s tests/test_worker_metrics.py::test_send_metrics_to_scheduler <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_metrics.py PASSED [ 96%] 3966s tests/test_worker_metrics.py::test_no_spans_extension <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_metrics.py PASSED [ 96%] 3966s tests/test_worker_metrics.py::test_new_metrics_during_heartbeat <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_metrics.py PASSED [ 96%] 3968s tests/test_worker_metrics.py::test_delayed_ledger_is_not_reentrant <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_metrics.py PASSED [ 96%] 3968s tests/test_worker_metrics.py::test_int_metrics <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_metrics.py PASSED [ 96%] 3968s tests/test_worker_state_machine.py::test_instruction_match <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 96%] 3970s tests/test_worker_state_machine.py::test_TaskState_tracking <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 96%] 3970s tests/test_worker_state_machine.py::test_TaskState_get_nbytes <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 96%] 3970s tests/test_worker_state_machine.py::test_TaskState_eq <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 96%] 3970s tests/test_worker_state_machine.py::test_TaskState__to_dict <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 96%] 3970s tests/test_worker_state_machine.py::test_TaskState_repr <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 96%] 3970s tests/test_worker_state_machine.py::test_WorkerState__to_dict <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 96%] 3970s tests/test_worker_state_machine.py::test_WorkerState_pickle <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 96%] 3970s tests/test_worker_state_machine.py::test_pickle_exceptions[False-InvalidTransition-kwargs0] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 96%] 3970s tests/test_worker_state_machine.py::test_pickle_exceptions[False-TransitionCounterMaxExceeded-kwargs1] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 96%] 3970s tests/test_worker_state_machine.py::test_pickle_exceptions[False-InvalidTaskState-kwargs2] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 96%] 3970s tests/test_worker_state_machine.py::test_pickle_exceptions[True-InvalidTransition-kwargs0] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 96%] 3970s tests/test_worker_state_machine.py::test_pickle_exceptions[True-TransitionCounterMaxExceeded-kwargs1] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 96%] 3970s tests/test_worker_state_machine.py::test_pickle_exceptions[True-InvalidTaskState-kwargs2] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 96%] 3970s tests/test_worker_state_machine.py::test_slots[TaskState] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 96%] 3970s tests/test_worker_state_machine.py::test_slots[Instruction] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 96%] 3970s tests/test_worker_state_machine.py::test_slots[GatherDep] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 96%] 3970s tests/test_worker_state_machine.py::test_slots[Execute] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 96%] 3970s tests/test_worker_state_machine.py::test_slots[RetryBusyWorkerLater] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 96%] 3970s tests/test_worker_state_machine.py::test_slots[SendMessageToScheduler] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 96%] 3970s tests/test_worker_state_machine.py::test_slots[TaskFinishedMsg] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 96%] 3970s tests/test_worker_state_machine.py::test_slots[TaskErredMsg] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 96%] 3970s tests/test_worker_state_machine.py::test_slots[ReleaseWorkerDataMsg] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 96%] 3970s tests/test_worker_state_machine.py::test_slots[RescheduleMsg] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 96%] 3970s tests/test_worker_state_machine.py::test_slots[LongRunningMsg] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 96%] 3970s tests/test_worker_state_machine.py::test_slots[AddKeysMsg] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 96%] 3970s tests/test_worker_state_machine.py::test_slots[RequestRefreshWhoHasMsg] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 96%] 3970s tests/test_worker_state_machine.py::test_slots[StealResponseMsg] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 96%] 3970s tests/test_worker_state_machine.py::test_slots[StateMachineEvent] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 97%] 3970s tests/test_worker_state_machine.py::test_slots[PauseEvent] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 97%] 3970s tests/test_worker_state_machine.py::test_slots[UnpauseEvent] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 97%] 3970s tests/test_worker_state_machine.py::test_slots[RetryBusyWorkerEvent] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 97%] 3970s tests/test_worker_state_machine.py::test_slots[GatherDepDoneEvent] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 97%] 3970s tests/test_worker_state_machine.py::test_slots[GatherDepSuccessEvent] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 97%] 3970s tests/test_worker_state_machine.py::test_slots[GatherDepBusyEvent] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 97%] 3970s tests/test_worker_state_machine.py::test_slots[GatherDepNetworkFailureEvent] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 97%] 3970s tests/test_worker_state_machine.py::test_slots[GatherDepFailureEvent] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 97%] 3970s tests/test_worker_state_machine.py::test_slots[RemoveWorkerEvent] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 97%] 3970s tests/test_worker_state_machine.py::test_slots[ComputeTaskEvent] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 97%] 3970s tests/test_worker_state_machine.py::test_slots[ExecuteDoneEvent] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 97%] 3970s tests/test_worker_state_machine.py::test_slots[ExecuteSuccessEvent] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 97%] 3970s tests/test_worker_state_machine.py::test_slots[ExecuteFailureEvent] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 97%] 3970s tests/test_worker_state_machine.py::test_slots[RescheduleEvent] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 97%] 3970s tests/test_worker_state_machine.py::test_slots[CancelComputeEvent] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 97%] 3970s tests/test_worker_state_machine.py::test_slots[FindMissingEvent] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 97%] 3970s tests/test_worker_state_machine.py::test_slots[RefreshWhoHasEvent] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 97%] 3970s tests/test_worker_state_machine.py::test_slots[AcquireReplicasEvent] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 97%] 3970s tests/test_worker_state_machine.py::test_slots[RemoveReplicasEvent] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 97%] 3970s tests/test_worker_state_machine.py::test_slots[FreeKeysEvent] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 97%] 3970s tests/test_worker_state_machine.py::test_slots[StealRequestEvent] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 97%] 3970s tests/test_worker_state_machine.py::test_slots[UpdateDataEvent] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 97%] 3970s tests/test_worker_state_machine.py::test_slots[SecedeEvent] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 97%] 3970s tests/test_worker_state_machine.py::test_sendmsg_to_dict <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 97%] 3970s tests/test_worker_state_machine.py::test_merge_recs_instructions <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 97%] 3970s tests/test_worker_state_machine.py::test_event_to_dict_with_annotations <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 97%] 3970s tests/test_worker_state_machine.py::test_event_to_dict_without_annotations <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 97%] 3970s tests/test_worker_state_machine.py::test_computetask_to_dict <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 97%] 3970s tests/test_worker_state_machine.py::test_computetask_dummy <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 97%] 3970s tests/test_worker_state_machine.py::test_updatedata_to_dict <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 97%] 3970s tests/test_worker_state_machine.py::test_executesuccess_to_dict <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 97%] 3970s tests/test_worker_state_machine.py::test_executesuccess_dummy <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 97%] 3970s tests/test_worker_state_machine.py::test_executefailure_to_dict <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 97%] 3970s tests/test_worker_state_machine.py::test_executefailure_dummy <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 97%] 3970s tests/test_worker_state_machine.py::test_fetch_to_compute <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 97%] 3970s tests/test_worker_state_machine.py::test_fetch_via_amm_to_compute <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 98%] 3971s tests/test_worker_state_machine.py::test_lose_replica_during_fetch[False] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 98%] 3971s tests/test_worker_state_machine.py::test_lose_replica_during_fetch[True] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 98%] 3971s tests/test_worker_state_machine.py::test_fetch_to_missing_on_busy <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 98%] 3971s tests/test_worker_state_machine.py::test_new_replica_while_all_workers_in_flight <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 98%] 3971s tests/test_worker_state_machine.py::test_cancelled_while_in_flight <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 98%] 3971s tests/test_worker_state_machine.py::test_in_memory_while_in_flight <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 98%] 3972s tests/test_worker_state_machine.py::test_forget_data_needed <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 98%] 3972s tests/test_worker_state_machine.py::test_missing_handle_compute_dependency <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 98%] 3972s tests/test_worker_state_machine.py::test_missing_to_waiting <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 98%] 3972s tests/test_worker_state_machine.py::test_fetch_to_missing_on_refresh_who_has <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 98%] 3973s tests/test_worker_state_machine.py::test_fetch_to_missing_on_network_failure <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 98%] 3973s tests/test_worker_state_machine.py::test_deprecated_worker_attributes <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 98%] 3973s tests/test_worker_state_machine.py::test_aggregate_gather_deps[10000000-3-1] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 98%] 3973s tests/test_worker_state_machine.py::test_aggregate_gather_deps[10000000-3-2] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 98%] 3973s tests/test_worker_state_machine.py::test_aggregate_gather_deps[20000000-2-1] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 98%] 3973s tests/test_worker_state_machine.py::test_aggregate_gather_deps[20000000-2-2] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 98%] 3973s tests/test_worker_state_machine.py::test_aggregate_gather_deps[30000000-1-1] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 98%] 3973s tests/test_worker_state_machine.py::test_aggregate_gather_deps[30000000-1-2] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 98%] 3973s tests/test_worker_state_machine.py::test_aggregate_gather_deps[60000000-1-1] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 98%] 3973s tests/test_worker_state_machine.py::test_aggregate_gather_deps[60000000-1-2] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 98%] 3973s tests/test_worker_state_machine.py::test_gather_priority <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 98%] 3973s tests/test_worker_state_machine.py::test_task_acquires_resources[executing] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 98%] 3973s tests/test_worker_state_machine.py::test_task_acquires_resources[long-running] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 98%] 3973s tests/test_worker_state_machine.py::test_task_releases_resources[executing-ExecuteSuccessEvent] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 98%] 3973s tests/test_worker_state_machine.py::test_task_releases_resources[executing-ExecuteFailureEvent] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 98%] 3973s tests/test_worker_state_machine.py::test_task_releases_resources[executing-RescheduleEvent] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 98%] 3973s tests/test_worker_state_machine.py::test_task_releases_resources[long-running-ExecuteSuccessEvent] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 98%] 3973s tests/test_worker_state_machine.py::test_task_releases_resources[long-running-ExecuteFailureEvent] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 98%] 3973s tests/test_worker_state_machine.py::test_task_releases_resources[long-running-RescheduleEvent] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 98%] 3973s tests/test_worker_state_machine.py::test_task_with_dependencies_acquires_resources <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 98%] 3973s tests/test_worker_state_machine.py::test_resumed_task_releases_resources[executing-ExecuteSuccessEvent] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 98%] 3973s tests/test_worker_state_machine.py::test_resumed_task_releases_resources[executing-ExecuteFailureEvent] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 98%] 3973s tests/test_worker_state_machine.py::test_resumed_task_releases_resources[executing-RescheduleEvent] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 98%] 3973s tests/test_worker_state_machine.py::test_resumed_task_releases_resources[long-running-ExecuteSuccessEvent] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 98%] 3973s tests/test_worker_state_machine.py::test_resumed_task_releases_resources[long-running-ExecuteFailureEvent] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 98%] 3973s tests/test_worker_state_machine.py::test_resumed_task_releases_resources[long-running-RescheduleEvent] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 99%] 3973s tests/test_worker_state_machine.py::test_clean_log <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 99%] 3973s tests/test_worker_state_machine.py::test_running_task_in_all_running_tasks[executing] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 99%] 3973s tests/test_worker_state_machine.py::test_running_task_in_all_running_tasks[long-running] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 99%] 3973s tests/test_worker_state_machine.py::test_done_task_not_in_all_running_tasks[executing-ExecuteSuccessEvent] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 99%] 3973s tests/test_worker_state_machine.py::test_done_task_not_in_all_running_tasks[executing-ExecuteFailureEvent] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 99%] 3973s tests/test_worker_state_machine.py::test_done_task_not_in_all_running_tasks[executing-RescheduleEvent] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 99%] 3973s tests/test_worker_state_machine.py::test_done_task_not_in_all_running_tasks[long-running-ExecuteSuccessEvent] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 99%] 3973s tests/test_worker_state_machine.py::test_done_task_not_in_all_running_tasks[long-running-ExecuteFailureEvent] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 99%] 3973s tests/test_worker_state_machine.py::test_done_task_not_in_all_running_tasks[long-running-RescheduleEvent] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 99%] 3973s tests/test_worker_state_machine.py::test_done_resumed_task_not_in_all_running_tasks[executing-ExecuteSuccessEvent] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 99%] 3973s tests/test_worker_state_machine.py::test_done_resumed_task_not_in_all_running_tasks[executing-ExecuteFailureEvent] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 99%] 3973s tests/test_worker_state_machine.py::test_done_resumed_task_not_in_all_running_tasks[executing-RescheduleEvent] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 99%] 3973s tests/test_worker_state_machine.py::test_done_resumed_task_not_in_all_running_tasks[long-running-ExecuteSuccessEvent] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 99%] 3973s tests/test_worker_state_machine.py::test_done_resumed_task_not_in_all_running_tasks[long-running-ExecuteFailureEvent] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 99%] 3973s tests/test_worker_state_machine.py::test_done_resumed_task_not_in_all_running_tasks[long-running-RescheduleEvent] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 99%] 3973s tests/test_worker_state_machine.py::test_gather_dep_failure <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 99%] 3973s tests/test_worker_state_machine.py::test_recompute_erred_task <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 99%] 3973s tests/test_worker_state_machine.py::test_transfer_incoming_metrics <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 99%] 3973s tests/test_worker_state_machine.py::test_throttling_does_not_affect_first_transfer <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 99%] 3973s tests/test_worker_state_machine.py::test_message_target_does_not_affect_first_transfer_on_different_worker <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 99%] 3973s tests/test_worker_state_machine.py::test_throttle_incoming_transfers_on_count_limit <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 99%] 3973s tests/test_worker_state_machine.py::test_throttling_incoming_transfer_on_transfer_bytes_same_worker <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 99%] 3973s tests/test_worker_state_machine.py::test_throttling_incoming_transfer_on_transfer_bytes_different_workers <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 99%] 3973s tests/test_worker_state_machine.py::test_do_not_throttle_connections_while_below_threshold <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 99%] 3973s tests/test_worker_state_machine.py::test_throttle_on_transfer_bytes_regardless_of_threshold <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 99%] 3973s tests/test_worker_state_machine.py::test_worker_nbytes[executing] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 99%] 3973s tests/test_worker_state_machine.py::test_worker_nbytes[long-running] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 99%] 3973s tests/test_worker_state_machine.py::test_fetch_count <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 99%] 3973s tests/test_worker_state_machine.py::test_task_counter <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 99%] 3973s tests/test_worker_state_machine.py::test_remove_worker_while_in_flight[fail] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 99%] 3973s tests/test_worker_state_machine.py::test_remove_worker_while_in_flight[success] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 99%] 3973s tests/test_worker_state_machine.py::test_remove_worker_while_in_flight[no-key] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 99%] 3973s tests/test_worker_state_machine.py::test_remove_worker_while_in_flight[busy] <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 99%] 3973s tests/test_worker_state_machine.py::test_remove_worker_while_in_flight_unused_peer <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 99%] 3973s tests/test_worker_state_machine.py::test_remove_worker_while_in_fetch <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 99%] 3973s tests/test_worker_state_machine.py::test_remove_worker_unknown <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [100%] 3973s 3973s =================================== FAILURES =================================== 3973s __________________________________ test_nanny __________________________________ 3973s 3973s fut = , timeout = 0 3973s 3973s async def wait_for(fut: Awaitable[T], timeout: float) -> T: 3973s async with asyncio.timeout(timeout): 3973s > return await fut 3973s 3973s /usr/lib/python3/dist-packages/distributed/utils.py:1914: 3973s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 3973s /usr/lib/python3/dist-packages/distributed/nanny.py:358: in start_unsafe 3973s comm = await self.rpc.connect(saddr) 3973s /usr/lib/python3/dist-packages/distributed/core.py:1485: in connect 3973s return await self._connect(addr=addr, timeout=timeout) 3973s /usr/lib/python3/dist-packages/distributed/core.py:1429: in _connect 3973s comm = await connect( 3973s /usr/lib/python3/dist-packages/distributed/comm/core.py:342: in connect 3973s comm = await wait_for( 3973s /usr/lib/python3/dist-packages/distributed/utils.py:1914: in wait_for 3973s return await fut 3973s /usr/lib/python3/dist-packages/distributed/comm/tcp.py:546: in connect 3973s stream = await self.client.connect( 3973s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 3973s 3973s self = 3973s host = '127.0.0.1', port = 37007, af = 3973s ssl_options = 3973s max_buffer_size = 4163035136.0, source_ip = None, source_port = None 3973s timeout = None 3973s 3973s async def connect( 3973s self, 3973s host: str, 3973s port: int, 3973s af: socket.AddressFamily = socket.AF_UNSPEC, 3973s ssl_options: Optional[Union[Dict[str, Any], ssl.SSLContext]] = None, 3973s max_buffer_size: Optional[int] = None, 3973s source_ip: Optional[str] = None, 3973s source_port: Optional[int] = None, 3973s timeout: Optional[Union[float, datetime.timedelta]] = None, 3973s ) -> IOStream: 3973s """Connect to the given host and port. 3973s 3973s Asynchronously returns an `.IOStream` (or `.SSLIOStream` if 3973s ``ssl_options`` is not None). 3973s 3973s Using the ``source_ip`` kwarg, one can specify the source 3973s IP address to use when establishing the connection. 3973s In case the user needs to resolve and 3973s use a specific interface, it has to be handled outside 3973s of Tornado as this depends very much on the platform. 3973s 3973s Raises `TimeoutError` if the input future does not complete before 3973s ``timeout``, which may be specified in any form allowed by 3973s `.IOLoop.add_timeout` (i.e. a `datetime.timedelta` or an absolute time 3973s relative to `.IOLoop.time`) 3973s 3973s Similarly, when the user requires a certain source port, it can 3973s be specified using the ``source_port`` arg. 3973s 3973s .. versionchanged:: 4.5 3973s Added the ``source_ip`` and ``source_port`` arguments. 3973s 3973s .. versionchanged:: 5.0 3973s Added the ``timeout`` argument. 3973s """ 3973s if timeout is not None: 3973s if isinstance(timeout, numbers.Real): 3973s timeout = IOLoop.current().time() + timeout 3973s elif isinstance(timeout, datetime.timedelta): 3973s timeout = IOLoop.current().time() + timeout.total_seconds() 3973s else: 3973s raise TypeError("Unsupported timeout %r" % timeout) 3973s if timeout is not None: 3973s addrinfo = await gen.with_timeout( 3973s timeout, self.resolver.resolve(host, port, af) 3973s ) 3973s else: 3973s addrinfo = await self.resolver.resolve(host, port, af) 3973s connector = _Connector( 3973s addrinfo, 3973s functools.partial( 3973s self._create_stream, 3973s max_buffer_size, 3973s source_ip=source_ip, 3973s source_port=source_port, 3973s ), 3973s ) 3973s > af, addr, stream = await connector.start(connect_timeout=timeout) 3973s E asyncio.exceptions.CancelledError 3973s 3973s /usr/lib/python3/dist-packages/tornado/tcpclient.py:279: CancelledError 3973s 3973s The above exception was the direct cause of the following exception: 3973s 3973s self = 3973s 3973s @final 3973s async def start(self): 3973s async with self._startup_lock: 3973s if self.status == Status.failed: 3973s assert self.__startup_exc is not None 3973s raise self.__startup_exc 3973s elif self.status != Status.init: 3973s return self 3973s timeout = getattr(self, "death_timeout", None) 3973s 3973s async def _close_on_failure(exc: Exception) -> None: 3973s await self.close(reason=f"failure-to-start-{str(type(exc))}") 3973s self.status = Status.failed 3973s self.__startup_exc = exc 3973s 3973s try: 3973s > await wait_for(self.start_unsafe(), timeout=timeout) 3973s 3973s /usr/lib/python3/dist-packages/distributed/core.py:528: 3973s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 3973s /usr/lib/python3/dist-packages/distributed/utils.py:1913: in wait_for 3973s async with asyncio.timeout(timeout): 3973s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 3973s 3973s self = 3973s exc_type = 3973s exc_val = CancelledError(), exc_tb = 3973s 3973s async def __aexit__( 3973s self, 3973s exc_type: Optional[Type[BaseException]], 3973s exc_val: Optional[BaseException], 3973s exc_tb: Optional[TracebackType], 3973s ) -> Optional[bool]: 3973s assert self._state in (_State.ENTERED, _State.EXPIRING) 3973s 3973s if self._timeout_handler is not None: 3973s self._timeout_handler.cancel() 3973s self._timeout_handler = None 3973s 3973s if self._state is _State.EXPIRING: 3973s self._state = _State.EXPIRED 3973s 3973s if self._task.uncancel() <= self._cancelling and exc_type is not None: 3973s # Since there are no new cancel requests, we're 3973s # handling this. 3973s if issubclass(exc_type, exceptions.CancelledError): 3973s > raise TimeoutError from exc_val 3973s E TimeoutError 3973s 3973s /usr/lib/python3.13/asyncio/timeouts.py:116: TimeoutError 3973s 3973s The above exception was the direct cause of the following exception: 3973s 3973s @contextlib.asynccontextmanager 3973s async def _cluster_factory(): 3973s workers = [] 3973s s = None 3973s try: 3973s for _ in range(60): 3973s try: 3973s > s, ws = await start_cluster( 3973s nthreads, 3973s scheduler, 3973s security=security, 3973s Worker=Worker, 3973s scheduler_kwargs=scheduler_kwargs, 3973s worker_kwargs=merge( 3973s {"death_timeout": min(15, int(deadline.remaining))}, 3973s worker_kwargs, 3973s ), 3973s ) 3973s 3973s /usr/lib/python3/dist-packages/distributed/utils_test.py:974: 3973s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 3973s /usr/lib/python3/dist-packages/distributed/utils_test.py:791: in start_cluster 3973s await asyncio.gather(*workers) 3973s /usr/lib/python3.13/asyncio/tasks.py:737: in _wrap_awaitable 3973s return await awaitable 3973s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 3973s 3973s self = 3973s 3973s @final 3973s async def start(self): 3973s async with self._startup_lock: 3973s if self.status == Status.failed: 3973s assert self.__startup_exc is not None 3973s raise self.__startup_exc 3973s elif self.status != Status.init: 3973s return self 3973s timeout = getattr(self, "death_timeout", None) 3973s 3973s async def _close_on_failure(exc: Exception) -> None: 3973s await self.close(reason=f"failure-to-start-{str(type(exc))}") 3973s self.status = Status.failed 3973s self.__startup_exc = exc 3973s 3973s try: 3973s await wait_for(self.start_unsafe(), timeout=timeout) 3973s except asyncio.TimeoutError as exc: 3973s await _close_on_failure(exc) 3973s > raise asyncio.TimeoutError( 3973s f"{type(self).__name__} start timed out after {timeout}s." 3973s ) from exc 3973s E TimeoutError: Nanny start timed out after 0s. 3973s 3973s /usr/lib/python3/dist-packages/distributed/core.py:531: TimeoutError 3973s 3973s During handling of the above exception, another exception occurred: 3973s 3973s fut = ._..test_func..async_fn at 0x718d0883b140> 3973s timeout = 60 3973s 3973s async def wait_for(fut: Awaitable[T], timeout: float) -> T: 3973s async with asyncio.timeout(timeout): 3973s > return await fut 3973s 3973s /usr/lib/python3/dist-packages/distributed/utils.py:1914: 3973s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 3973s /usr/lib/python3/dist-packages/distributed/utils_test.py:1007: in async_fn 3973s _cluster_factory() as (s, workers), 3973s /usr/lib/python3.13/contextlib.py:214: in __aenter__ 3973s return await anext(self.gen) 3973s /usr/lib/python3/dist-packages/distributed/utils_test.py:991: in _cluster_factory 3973s await asyncio.sleep(1) 3973s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 3973s 3973s delay = 1, result = None 3973s 3973s async def sleep(delay, result=None): 3973s """Coroutine that completes after a given time (in seconds).""" 3973s if delay <= 0: 3973s await __sleep0() 3973s return result 3973s 3973s if math.isnan(delay): 3973s raise ValueError("Invalid delay: NaN (not a number)") 3973s 3973s loop = events.get_running_loop() 3973s future = loop.create_future() 3973s h = loop.call_later(delay, 3973s futures._set_result_unless_cancelled, 3973s future, result) 3973s try: 3973s > return await future 3973s E asyncio.exceptions.CancelledError 3973s 3973s /usr/lib/python3.13/asyncio/tasks.py:718: CancelledError 3973s 3973s The above exception was the direct cause of the following exception: 3973s 3973s args = (), kwds = {} 3973s 3973s @wraps(func) 3973s def inner(*args, **kwds): 3973s with self._recreate_cm(): 3973s > return func(*args, **kwds) 3973s 3973s /usr/lib/python3.13/contextlib.py:85: 3973s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 3973s /usr/lib/python3.13/contextlib.py:85: in inner 3973s return func(*args, **kwds) 3973s /usr/lib/python3/dist-packages/distributed/utils_test.py:1090: in test_func 3973s return _run_and_close_tornado(async_fn_outer) 3973s /usr/lib/python3/dist-packages/distributed/utils_test.py:380: in _run_and_close_tornado 3973s return asyncio_run(inner_fn(), loop_factory=get_loop_factory()) 3973s /usr/lib/python3.13/asyncio/runners.py:195: in run 3973s return runner.run(main) 3973s /usr/lib/python3.13/asyncio/runners.py:118: in run 3973s return self._loop.run_until_complete(task) 3973s /usr/lib/python3.13/asyncio/base_events.py:725: in run_until_complete 3973s return future.result() 3973s /usr/lib/python3/dist-packages/distributed/utils_test.py:377: in inner_fn 3973s return await async_fn(*args, **kwargs) 3973s /usr/lib/python3/dist-packages/distributed/utils_test.py:1087: in async_fn_outer 3973s return await utils_wait_for(async_fn(), timeout=timeout * 2) 3973s /usr/lib/python3/dist-packages/distributed/utils.py:1913: in wait_for 3973s async with asyncio.timeout(timeout): 3973s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 3973s 3973s self = 3973s exc_type = 3973s exc_val = CancelledError(), exc_tb = 3973s 3973s async def __aexit__( 3973s self, 3973s exc_type: Optional[Type[BaseException]], 3973s exc_val: Optional[BaseException], 3973s exc_tb: Optional[TracebackType], 3973s ) -> Optional[bool]: 3973s assert self._state in (_State.ENTERED, _State.EXPIRING) 3973s 3973s if self._timeout_handler is not None: 3973s self._timeout_handler.cancel() 3973s self._timeout_handler = None 3973s 3973s if self._state is _State.EXPIRING: 3973s self._state = _State.EXPIRED 3973s 3973s if self._task.uncancel() <= self._cancelling and exc_type is not None: 3973s # Since there are no new cancel requests, we're 3973s # handling this. 3973s if issubclass(exc_type, exceptions.CancelledError): 3973s > raise TimeoutError from exc_val 3973s E TimeoutError 3973s 3973s /usr/lib/python3.13/asyncio/timeouts.py:116: TimeoutError 3973s ----------------------------- Captured stderr call ----------------------------- 3973s 2025-02-21 00:27:05,228 - distributed.scheduler - INFO - State start 3973s 2025-02-21 00:27:05,233 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:42167 3973s 2025-02-21 00:27:05,235 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:39323/status 3973s 2025-02-21 00:27:05,236 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3973s 2025-02-21 00:27:05,253 - distributed.nanny - INFO - Start Nanny at: 'tls://127.0.0.1:35895' 3973s 2025-02-21 00:27:05,255 - distributed.nanny - INFO - Start Nanny at: 'tls://127.0.0.1:36595' 3973s 2025-02-21 00:27:05,995 - distributed.worker.memory - WARNING - Ignoring provided memory limit 8326070272 due to system memory limit of 7.75 GiB 3973s 2025-02-21 00:27:06,000 - distributed.worker.memory - WARNING - Ignoring provided memory limit 8326070272 due to system memory limit of 7.75 GiB 3973s 2025-02-21 00:27:06,013 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41183 3973s 2025-02-21 00:27:06,014 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41183 3973s 2025-02-21 00:27:06,014 - distributed.worker - INFO - Worker name: 0 3973s 2025-02-21 00:27:06,014 - distributed.worker - INFO - dashboard at: 127.0.0.1:36453 3973s 2025-02-21 00:27:06,014 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42167 3973s 2025-02-21 00:27:06,014 - distributed.worker - INFO - ------------------------------------------------- 3973s 2025-02-21 00:27:06,014 - distributed.worker - INFO - Threads: 1 3973s 2025-02-21 00:27:06,014 - distributed.worker - INFO - Memory: 7.75 GiB 3973s 2025-02-21 00:27:06,014 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-l5z4xyy9 3973s 2025-02-21 00:27:06,014 - distributed.worker - INFO - ------------------------------------------------- 3973s 2025-02-21 00:27:06,020 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:45217 3973s 2025-02-21 00:27:06,020 - distributed.worker - INFO - Listening to: tls://127.0.0.1:45217 3973s 2025-02-21 00:27:06,020 - distributed.worker - INFO - Worker name: 1 3973s 2025-02-21 00:27:06,020 - distributed.worker - INFO - dashboard at: 127.0.0.1:39825 3973s 2025-02-21 00:27:06,020 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42167 3973s 2025-02-21 00:27:06,020 - distributed.worker - INFO - ------------------------------------------------- 3973s 2025-02-21 00:27:06,020 - distributed.worker - INFO - Threads: 2 3973s 2025-02-21 00:27:06,020 - distributed.worker - INFO - Memory: 7.75 GiB 3973s 2025-02-21 00:27:06,020 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-jbdwwzkk 3973s 2025-02-21 00:27:06,020 - distributed.worker - INFO - ------------------------------------------------- 3973s 2025-02-21 00:27:06,278 - distributed.scheduler - INFO - Register worker addr: tls://127.0.0.1:41183 name: 0 3973s 2025-02-21 00:27:06,282 - distributed.worker - INFO - Starting Worker plugin shuffle 3973s 2025-02-21 00:27:06,283 - distributed.worker - INFO - Registered to: tls://127.0.0.1:42167 3973s 2025-02-21 00:27:06,283 - distributed.worker - INFO - ------------------------------------------------- 3973s 2025-02-21 00:27:06,283 - distributed.core - INFO - Starting established connection to tls://127.0.0.1:42167 3973s 2025-02-21 00:27:06,281 - distributed.scheduler - INFO - Starting worker compute stream, tls://127.0.0.1:41183 3973s 2025-02-21 00:27:06,284 - distributed.core - INFO - Starting established connection to tls://127.0.0.1:59324 3973s 2025-02-21 00:27:06,303 - distributed.scheduler - INFO - Register worker addr: tls://127.0.0.1:45217 name: 1 3973s 2025-02-21 00:27:06,307 - distributed.worker - INFO - Starting Worker plugin shuffle 3973s 2025-02-21 00:27:06,307 - distributed.worker - INFO - Registered to: tls://127.0.0.1:42167 3973s 2025-02-21 00:27:06,307 - distributed.worker - INFO - ------------------------------------------------- 3973s 2025-02-21 00:27:06,308 - distributed.core - INFO - Starting established connection to tls://127.0.0.1:42167 3973s 2025-02-21 00:27:06,306 - distributed.scheduler - INFO - Starting worker compute stream, tls://127.0.0.1:45217 3973s 2025-02-21 00:27:06,308 - distributed.core - INFO - Starting established connection to tls://127.0.0.1:59340 3973s 2025-02-21 00:27:06,309 - distributed.core - INFO - Connection to tls://127.0.0.1:59340 has been closed. 3973s 2025-02-21 00:27:06,309 - distributed.core - INFO - Connection to tls://127.0.0.1:42167 has been closed. 3973s 2025-02-21 00:27:06,309 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:45217. Reason: worker-handle-scheduler-connection-broken 3973s 2025-02-21 00:27:06,309 - distributed.scheduler - INFO - Remove worker addr: tls://127.0.0.1:45217 name: 1 (stimulus_id='handle-worker-cleanup-1740097626.3093772') 3973s 2025-02-21 00:27:06,354 - distributed.nanny - INFO - Closing Nanny gracefully at 'tls://127.0.0.1:36595'. Reason: worker-handle-scheduler-connection-broken 3973s 2025-02-21 00:27:06,354 - distributed.worker - INFO - Removing Worker plugin shuffle 3973s 2025-02-21 00:27:06,356 - distributed.nanny - INFO - Worker closed 3973s 2025-02-21 00:27:08,358 - distributed.nanny - ERROR - Worker process died unexpectedly 3973s 2025-02-21 00:27:08,530 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:36595'. Reason: nanny-close-gracefully 3973s 2025-02-21 00:27:08,530 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:36595' closed. 3973s 2025-02-21 00:27:36,357 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:35895'. Reason: nanny-close 3973s 2025-02-21 00:27:36,358 - distributed.nanny - INFO - Nanny asking worker to close. Reason: nanny-close 3973s 2025-02-21 00:27:36,359 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41183. Reason: nanny-close 3973s 2025-02-21 00:27:36,359 - distributed.worker - INFO - Removing Worker plugin shuffle 3973s 2025-02-21 00:27:36,361 - distributed.core - INFO - Connection to tls://127.0.0.1:42167 has been closed. 3973s 2025-02-21 00:27:36,361 - distributed.core - INFO - Received 'close-stream' from tls://127.0.0.1:59324; closing. 3973s 2025-02-21 00:27:36,362 - distributed.nanny - INFO - Worker closed 3973s 2025-02-21 00:27:36,361 - distributed.scheduler - INFO - Remove worker addr: tls://127.0.0.1:41183 name: 0 (stimulus_id='handle-worker-cleanup-1740097656.3617458') 3973s 2025-02-21 00:27:36,365 - distributed.scheduler - INFO - Lost all workers 3973s 2025-02-21 00:27:36,529 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:35895' closed. 3973s 2025-02-21 00:27:36,529 - distributed.scheduler - INFO - Closing scheduler. Reason: unknown 3973s 2025-02-21 00:27:36,533 - distributed.scheduler - INFO - Scheduler closing all comms 3973s 2025-02-21 00:27:36,536 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Cluster creation timeout; retrying 3973s Traceback (most recent call last): 3973s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 974, in _cluster_factory 3973s s, ws = await start_cluster( 3973s ^^^^^^^^^^^^^^^^^^^^ 3973s ...<9 lines>... 3973s ) 3973s ^ 3973s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 806, in start_cluster 3973s raise TimeoutError("Cluster creation timeout") 3973s TimeoutError: Cluster creation timeout 3973s 2025-02-21 00:27:37,540 - distributed.scheduler - INFO - State start 3973s 2025-02-21 00:27:37,546 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:39591 3973s 2025-02-21 00:27:37,548 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:37253/status 3973s 2025-02-21 00:27:37,549 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3973s 2025-02-21 00:27:37,557 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:33775'. Reason: failure-to-start- 3973s 2025-02-21 00:27:37,557 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:33775' closed. 3973s 2025-02-21 00:27:37,557 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:46441'. Reason: failure-to-start- 3973s 2025-02-21 00:27:37,557 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:46441' closed. 3973s 2025-02-21 00:27:37,558 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39591': TLS handshake failed with remote 'tls://127.0.0.1:60028': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 3973s 2025-02-21 00:27:37,558 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39591': TLS handshake failed with remote 'tls://127.0.0.1:60044': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 3973s 2025-02-21 00:27:37,558 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 3973s Traceback (most recent call last): 3973s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 3973s return await fut 3973s ^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 3973s comm = await self.rpc.connect(saddr) 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1485, in connect 3973s return await self._connect(addr=addr, timeout=timeout) 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1429, in _connect 3973s comm = await connect( 3973s ^^^^^^^^^^^^^^ 3973s ...<4 lines>... 3973s ) 3973s ^ 3973s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3973s comm = await wait_for( 3973s ^^^^^^^^^^^^^^^ 3973s ...<2 lines>... 3973s ) 3973s ^ 3973s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 3973s return await fut 3973s ^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3973s stream = await self.client.connect( 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s ) 3973s ^ 3973s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3973s af, addr, stream = await connector.start(connect_timeout=timeout) 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s asyncio.exceptions.CancelledError 3973s 3973s The above exception was the direct cause of the following exception: 3973s 3973s Traceback (most recent call last): 3973s File "/usr/lib/python3/dist-packages/distributed/core.py", line 528, in start 3973s await wait_for(self.start_unsafe(), timeout=timeout) 3973s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1913, in wait_for 3973s async with asyncio.timeout(timeout): 3973s ~~~~~~~~~~~~~~~^^^^^^^^^ 3973s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3973s raise TimeoutError from exc_val 3973s TimeoutError 3973s 3973s The above exception was the direct cause of the following exception: 3973s 3973s Traceback (most recent call last): 3973s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 974, in _cluster_factory 3973s s, ws = await start_cluster( 3973s ^^^^^^^^^^^^^^^^^^^^ 3973s ...<9 lines>... 3973s ) 3973s ^ 3973s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 791, in start_cluster 3973s await asyncio.gather(*workers) 3973s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3973s return await awaitable 3973s ^^^^^^^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/core.py", line 531, in start 3973s raise asyncio.TimeoutError( 3973s f"{type(self).__name__} start timed out after {timeout}s." 3973s ) from exc 3973s TimeoutError: Nanny start timed out after 0s. 3973s 2025-02-21 00:27:38,563 - distributed.scheduler - INFO - State start 3973s 2025-02-21 00:27:38,570 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37413 3973s 2025-02-21 00:27:38,573 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:39785/status 3973s 2025-02-21 00:27:38,575 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3973s 2025-02-21 00:27:38,584 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:39759'. Reason: failure-to-start- 3973s 2025-02-21 00:27:38,584 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:39759' closed. 3973s 2025-02-21 00:27:38,584 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:34915'. Reason: failure-to-start- 3973s 2025-02-21 00:27:38,584 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:34915' closed. 3973s 2025-02-21 00:27:38,585 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37413': TLS handshake failed with remote 'tls://127.0.0.1:36668': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 3973s 2025-02-21 00:27:38,585 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37413': TLS handshake failed with remote 'tls://127.0.0.1:36678': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 3973s 2025-02-21 00:27:38,585 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 3973s Traceback (most recent call last): 3973s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 3973s return await fut 3973s ^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 3973s comm = await self.rpc.connect(saddr) 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1485, in connect 3973s return await self._connect(addr=addr, timeout=timeout) 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1429, in _connect 3973s comm = await connect( 3973s ^^^^^^^^^^^^^^ 3973s ...<4 lines>... 3973s ) 3973s ^ 3973s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3973s comm = await wait_for( 3973s ^^^^^^^^^^^^^^^ 3973s ...<2 lines>... 3973s ) 3973s ^ 3973s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 3973s return await fut 3973s ^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3973s stream = await self.client.connect( 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s ) 3973s ^ 3973s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3973s af, addr, stream = await connector.start(connect_timeout=timeout) 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s asyncio.exceptions.CancelledError 3973s 3973s The above exception was the direct cause of the following exception: 3973s 3973s Traceback (most recent call last): 3973s File "/usr/lib/python3/dist-packages/distributed/core.py", line 528, in start 3973s await wait_for(self.start_unsafe(), timeout=timeout) 3973s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1913, in wait_for 3973s async with asyncio.timeout(timeout): 3973s ~~~~~~~~~~~~~~~^^^^^^^^^ 3973s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3973s raise TimeoutError from exc_val 3973s TimeoutError 3973s 3973s The above exception was the direct cause of the following exception: 3973s 3973s Traceback (most recent call last): 3973s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 974, in _cluster_factory 3973s s, ws = await start_cluster( 3973s ^^^^^^^^^^^^^^^^^^^^ 3973s ...<9 lines>... 3973s ) 3973s ^ 3973s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 791, in start_cluster 3973s await asyncio.gather(*workers) 3973s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3973s return await awaitable 3973s ^^^^^^^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/core.py", line 531, in start 3973s raise asyncio.TimeoutError( 3973s f"{type(self).__name__} start timed out after {timeout}s." 3973s ) from exc 3973s TimeoutError: Nanny start timed out after 0s. 3973s 2025-02-21 00:27:39,592 - distributed.scheduler - INFO - State start 3973s 2025-02-21 00:27:39,605 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:39525 3973s 2025-02-21 00:27:39,610 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:45985/status 3973s 2025-02-21 00:27:39,617 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3973s 2025-02-21 00:27:39,634 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:36145'. Reason: failure-to-start- 3973s 2025-02-21 00:27:39,635 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:36145' closed. 3973s 2025-02-21 00:27:39,635 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:33077'. Reason: failure-to-start- 3973s 2025-02-21 00:27:39,635 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:33077' closed. 3973s 2025-02-21 00:27:39,635 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39525': TLS handshake failed with remote 'tls://127.0.0.1:37326': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 3973s 2025-02-21 00:27:39,635 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39525': TLS handshake failed with remote 'tls://127.0.0.1:37342': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 3973s 2025-02-21 00:27:39,636 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 3973s Traceback (most recent call last): 3973s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 3973s return await fut 3973s ^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 3973s comm = await self.rpc.connect(saddr) 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1485, in connect 3973s return await self._connect(addr=addr, timeout=timeout) 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1429, in _connect 3973s comm = await connect( 3973s ^^^^^^^^^^^^^^ 3973s ...<4 lines>... 3973s ) 3973s ^ 3973s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3973s comm = await wait_for( 3973s ^^^^^^^^^^^^^^^ 3973s ...<2 lines>... 3973s ) 3973s ^ 3973s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 3973s return await fut 3973s ^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3973s stream = await self.client.connect( 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s ) 3973s ^ 3973s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3973s af, addr, stream = await connector.start(connect_timeout=timeout) 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s asyncio.exceptions.CancelledError 3973s 3973s The above exception was the direct cause of the following exception: 3973s 3973s Traceback (most recent call last): 3973s File "/usr/lib/python3/dist-packages/distributed/core.py", line 528, in start 3973s await wait_for(self.start_unsafe(), timeout=timeout) 3973s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1913, in wait_for 3973s async with asyncio.timeout(timeout): 3973s ~~~~~~~~~~~~~~~^^^^^^^^^ 3973s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3973s raise TimeoutError from exc_val 3973s TimeoutError 3973s 3973s The above exception was the direct cause of the following exception: 3973s 3973s Traceback (most recent call last): 3973s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 974, in _cluster_factory 3973s s, ws = await start_cluster( 3973s ^^^^^^^^^^^^^^^^^^^^ 3973s ...<9 lines>... 3973s ) 3973s ^ 3973s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 791, in start_cluster 3973s await asyncio.gather(*workers) 3973s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3973s return await awaitable 3973s ^^^^^^^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/core.py", line 531, in start 3973s raise asyncio.TimeoutError( 3973s f"{type(self).__name__} start timed out after {timeout}s." 3973s ) from exc 3973s TimeoutError: Nanny start timed out after 0s. 3973s 2025-02-21 00:27:40,641 - distributed.scheduler - INFO - State start 3973s 2025-02-21 00:27:40,647 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:40045 3973s 2025-02-21 00:27:40,649 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:44453/status 3973s 2025-02-21 00:27:40,651 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3973s 2025-02-21 00:27:40,658 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:34763'. Reason: failure-to-start- 3973s 2025-02-21 00:27:40,658 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:34763' closed. 3973s 2025-02-21 00:27:40,658 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:39331'. Reason: failure-to-start- 3973s 2025-02-21 00:27:40,659 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:39331' closed. 3973s 2025-02-21 00:27:40,659 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40045': TLS handshake failed with remote 'tls://127.0.0.1:35126': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 3973s 2025-02-21 00:27:40,659 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40045': TLS handshake failed with remote 'tls://127.0.0.1:35140': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 3973s 2025-02-21 00:27:40,659 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 3973s Traceback (most recent call last): 3973s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 3973s return await fut 3973s ^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 3973s comm = await self.rpc.connect(saddr) 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1485, in connect 3973s return await self._connect(addr=addr, timeout=timeout) 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1429, in _connect 3973s comm = await connect( 3973s ^^^^^^^^^^^^^^ 3973s ...<4 lines>... 3973s ) 3973s ^ 3973s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3973s comm = await wait_for( 3973s ^^^^^^^^^^^^^^^ 3973s ...<2 lines>... 3973s ) 3973s ^ 3973s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 3973s return await fut 3973s ^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3973s stream = await self.client.connect( 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s ) 3973s ^ 3973s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3973s af, addr, stream = await connector.start(connect_timeout=timeout) 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s asyncio.exceptions.CancelledError 3973s 3973s The above exception was the direct cause of the following exception: 3973s 3973s Traceback (most recent call last): 3973s File "/usr/lib/python3/dist-packages/distributed/core.py", line 528, in start 3973s await wait_for(self.start_unsafe(), timeout=timeout) 3973s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1913, in wait_for 3973s async with asyncio.timeout(timeout): 3973s ~~~~~~~~~~~~~~~^^^^^^^^^ 3973s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3973s raise TimeoutError from exc_val 3973s TimeoutError 3973s 3973s The above exception was the direct cause of the following exception: 3973s 3973s Traceback (most recent call last): 3973s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 974, in _cluster_factory 3973s s, ws = await start_cluster( 3973s ^^^^^^^^^^^^^^^^^^^^ 3973s ...<9 lines>... 3973s ) 3973s ^ 3973s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 791, in start_cluster 3973s await asyncio.gather(*workers) 3973s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3973s return await awaitable 3973s ^^^^^^^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/core.py", line 531, in start 3973s raise asyncio.TimeoutError( 3973s f"{type(self).__name__} start timed out after {timeout}s." 3973s ) from exc 3973s TimeoutError: Nanny start timed out after 0s. 3973s 2025-02-21 00:27:41,663 - distributed.scheduler - INFO - State start 3973s 2025-02-21 00:27:41,670 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:42845 3973s 2025-02-21 00:27:41,672 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:41573/status 3973s 2025-02-21 00:27:41,674 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3973s 2025-02-21 00:27:41,685 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:42773'. Reason: failure-to-start- 3973s 2025-02-21 00:27:41,685 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:42773' closed. 3973s 2025-02-21 00:27:41,685 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:42409'. Reason: failure-to-start- 3973s 2025-02-21 00:27:41,685 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:42409' closed. 3973s 2025-02-21 00:27:41,686 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42845': TLS handshake failed with remote 'tls://127.0.0.1:53978': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 3973s 2025-02-21 00:27:41,686 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42845': TLS handshake failed with remote 'tls://127.0.0.1:53986': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 3973s 2025-02-21 00:27:41,686 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 3973s Traceback (most recent call last): 3973s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 3973s return await fut 3973s ^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 3973s comm = await self.rpc.connect(saddr) 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1485, in connect 3973s return await self._connect(addr=addr, timeout=timeout) 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1429, in _connect 3973s comm = await connect( 3973s ^^^^^^^^^^^^^^ 3973s ...<4 lines>... 3973s ) 3973s ^ 3973s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3973s comm = await wait_for( 3973s ^^^^^^^^^^^^^^^ 3973s ...<2 lines>... 3973s ) 3973s ^ 3973s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 3973s return await fut 3973s ^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3973s stream = await self.client.connect( 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s ) 3973s ^ 3973s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3973s af, addr, stream = await connector.start(connect_timeout=timeout) 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s asyncio.exceptions.CancelledError 3973s 3973s The above exception was the direct cause of the following exception: 3973s 3973s Traceback (most recent call last): 3973s File "/usr/lib/python3/dist-packages/distributed/core.py", line 528, in start 3973s await wait_for(self.start_unsafe(), timeout=timeout) 3973s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1913, in wait_for 3973s async with asyncio.timeout(timeout): 3973s ~~~~~~~~~~~~~~~^^^^^^^^^ 3973s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3973s raise TimeoutError from exc_val 3973s TimeoutError 3973s 3973s The above exception was the direct cause of the following exception: 3973s 3973s Traceback (most recent call last): 3973s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 974, in _cluster_factory 3973s s, ws = await start_cluster( 3973s ^^^^^^^^^^^^^^^^^^^^ 3973s ...<9 lines>... 3973s ) 3973s ^ 3973s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 791, in start_cluster 3973s await asyncio.gather(*workers) 3973s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3973s return await awaitable 3973s ^^^^^^^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/core.py", line 531, in start 3973s raise asyncio.TimeoutError( 3973s f"{type(self).__name__} start timed out after {timeout}s." 3973s ) from exc 3973s TimeoutError: Nanny start timed out after 0s. 3973s 2025-02-21 00:27:42,692 - distributed.scheduler - INFO - State start 3973s 2025-02-21 00:27:42,698 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37235 3973s 2025-02-21 00:27:42,701 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:33139/status 3973s 2025-02-21 00:27:42,704 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3973s 2025-02-21 00:27:42,711 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:36087'. Reason: failure-to-start- 3973s 2025-02-21 00:27:42,712 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:36087' closed. 3973s 2025-02-21 00:27:42,712 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:34467'. Reason: failure-to-start- 3973s 2025-02-21 00:27:42,712 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:34467' closed. 3973s 2025-02-21 00:27:42,712 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37235': TLS handshake failed with remote 'tls://127.0.0.1:56016': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 3973s 2025-02-21 00:27:42,712 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37235': TLS handshake failed with remote 'tls://127.0.0.1:56022': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 3973s 2025-02-21 00:27:42,713 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 3973s Traceback (most recent call last): 3973s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 3973s return await fut 3973s ^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 3973s comm = await self.rpc.connect(saddr) 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1485, in connect 3973s return await self._connect(addr=addr, timeout=timeout) 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1429, in _connect 3973s comm = await connect( 3973s ^^^^^^^^^^^^^^ 3973s ...<4 lines>... 3973s ) 3973s ^ 3973s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3973s comm = await wait_for( 3973s ^^^^^^^^^^^^^^^ 3973s ...<2 lines>... 3973s ) 3973s ^ 3973s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 3973s return await fut 3973s ^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3973s stream = await self.client.connect( 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s ) 3973s ^ 3973s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3973s af, addr, stream = await connector.start(connect_timeout=timeout) 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s asyncio.exceptions.CancelledError 3973s 3973s The above exception was the direct cause of the following exception: 3973s 3973s Traceback (most recent call last): 3973s File "/usr/lib/python3/dist-packages/distributed/core.py", line 528, in start 3973s await wait_for(self.start_unsafe(), timeout=timeout) 3973s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1913, in wait_for 3973s async with asyncio.timeout(timeout): 3973s ~~~~~~~~~~~~~~~^^^^^^^^^ 3973s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3973s raise TimeoutError from exc_val 3973s TimeoutError 3973s 3973s The above exception was the direct cause of the following exception: 3973s 3973s Traceback (most recent call last): 3973s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 974, in _cluster_factory 3973s s, ws = await start_cluster( 3973s ^^^^^^^^^^^^^^^^^^^^ 3973s ...<9 lines>... 3973s ) 3973s ^ 3973s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 791, in start_cluster 3973s await asyncio.gather(*workers) 3973s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3973s return await awaitable 3973s ^^^^^^^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/core.py", line 531, in start 3973s raise asyncio.TimeoutError( 3973s f"{type(self).__name__} start timed out after {timeout}s." 3973s ) from exc 3973s TimeoutError: Nanny start timed out after 0s. 3973s 2025-02-21 00:27:43,716 - distributed.scheduler - INFO - State start 3973s 2025-02-21 00:27:43,724 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:38569 3973s 2025-02-21 00:27:43,727 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:37853/status 3973s 2025-02-21 00:27:43,728 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3973s 2025-02-21 00:27:43,736 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:45345'. Reason: failure-to-start- 3973s 2025-02-21 00:27:43,736 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:45345' closed. 3973s 2025-02-21 00:27:43,736 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:44421'. Reason: failure-to-start- 3973s 2025-02-21 00:27:43,736 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:44421' closed. 3973s 2025-02-21 00:27:43,737 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38569': TLS handshake failed with remote 'tls://127.0.0.1:36246': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 3973s 2025-02-21 00:27:43,737 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38569': TLS handshake failed with remote 'tls://127.0.0.1:36250': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 3973s 2025-02-21 00:27:43,737 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 3973s Traceback (most recent call last): 3973s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 3973s return await fut 3973s ^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 3973s comm = await self.rpc.connect(saddr) 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1485, in connect 3973s return await self._connect(addr=addr, timeout=timeout) 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1429, in _connect 3973s comm = await connect( 3973s ^^^^^^^^^^^^^^ 3973s ...<4 lines>... 3973s ) 3973s ^ 3973s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3973s comm = await wait_for( 3973s ^^^^^^^^^^^^^^^ 3973s ...<2 lines>... 3973s ) 3973s ^ 3973s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 3973s return await fut 3973s ^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3973s stream = await self.client.connect( 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s ) 3973s ^ 3973s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3973s af, addr, stream = await connector.start(connect_timeout=timeout) 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s asyncio.exceptions.CancelledError 3973s 3973s The above exception was the direct cause of the following exception: 3973s 3973s Traceback (most recent call last): 3973s File "/usr/lib/python3/dist-packages/distributed/core.py", line 528, in start 3973s await wait_for(self.start_unsafe(), timeout=timeout) 3973s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1913, in wait_for 3973s async with asyncio.timeout(timeout): 3973s ~~~~~~~~~~~~~~~^^^^^^^^^ 3973s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3973s raise TimeoutError from exc_val 3973s TimeoutError 3973s 3973s The above exception was the direct cause of the following exception: 3973s 3973s Traceback (most recent call last): 3973s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 974, in _cluster_factory 3973s s, ws = await start_cluster( 3973s ^^^^^^^^^^^^^^^^^^^^ 3973s ...<9 lines>... 3973s ) 3973s ^ 3973s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 791, in start_cluster 3973s await asyncio.gather(*workers) 3973s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3973s return await awaitable 3973s ^^^^^^^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/core.py", line 531, in start 3973s raise asyncio.TimeoutError( 3973s f"{type(self).__name__} start timed out after {timeout}s." 3973s ) from exc 3973s TimeoutError: Nanny start timed out after 0s. 3973s 2025-02-21 00:27:44,743 - distributed.scheduler - INFO - State start 3973s 2025-02-21 00:27:44,750 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:41111 3973s 2025-02-21 00:27:44,753 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:34323/status 3973s 2025-02-21 00:27:44,755 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3973s 2025-02-21 00:27:44,764 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:40961'. Reason: failure-to-start- 3973s 2025-02-21 00:27:44,764 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:40961' closed. 3973s 2025-02-21 00:27:44,765 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:41227'. Reason: failure-to-start- 3973s 2025-02-21 00:27:44,765 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:41227' closed. 3973s 2025-02-21 00:27:44,765 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41111': TLS handshake failed with remote 'tls://127.0.0.1:51778': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 3973s 2025-02-21 00:27:44,765 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41111': TLS handshake failed with remote 'tls://127.0.0.1:51790': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 3973s 2025-02-21 00:27:44,765 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 3973s Traceback (most recent call last): 3973s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 3973s return await fut 3973s ^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 3973s comm = await self.rpc.connect(saddr) 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1485, in connect 3973s return await self._connect(addr=addr, timeout=timeout) 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1429, in _connect 3973s comm = await connect( 3973s ^^^^^^^^^^^^^^ 3973s ...<4 lines>... 3973s ) 3973s ^ 3973s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3973s comm = await wait_for( 3973s ^^^^^^^^^^^^^^^ 3973s ...<2 lines>... 3973s ) 3973s ^ 3973s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 3973s return await fut 3973s ^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3973s stream = await self.client.connect( 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s ) 3973s ^ 3973s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3973s af, addr, stream = await connector.start(connect_timeout=timeout) 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s asyncio.exceptions.CancelledError 3973s 3973s The above exception was the direct cause of the following exception: 3973s 3973s Traceback (most recent call last): 3973s File "/usr/lib/python3/dist-packages/distributed/core.py", line 528, in start 3973s await wait_for(self.start_unsafe(), timeout=timeout) 3973s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1913, in wait_for 3973s async with asyncio.timeout(timeout): 3973s ~~~~~~~~~~~~~~~^^^^^^^^^ 3973s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3973s raise TimeoutError from exc_val 3973s TimeoutError 3973s 3973s The above exception was the direct cause of the following exception: 3973s 3973s Traceback (most recent call last): 3973s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 974, in _cluster_factory 3973s s, ws = await start_cluster( 3973s ^^^^^^^^^^^^^^^^^^^^ 3973s ...<9 lines>... 3973s ) 3973s ^ 3973s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 791, in start_cluster 3973s await asyncio.gather(*workers) 3973s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3973s return await awaitable 3973s ^^^^^^^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/core.py", line 531, in start 3973s raise asyncio.TimeoutError( 3973s f"{type(self).__name__} start timed out after {timeout}s." 3973s ) from exc 3973s TimeoutError: Nanny start timed out after 0s. 3973s 2025-02-21 00:27:45,771 - distributed.scheduler - INFO - State start 3973s 2025-02-21 00:27:45,780 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:38477 3973s 2025-02-21 00:27:45,783 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:40009/status 3973s 2025-02-21 00:27:45,785 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3973s 2025-02-21 00:27:45,794 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:34999'. Reason: failure-to-start- 3973s 2025-02-21 00:27:45,795 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:34999' closed. 3973s 2025-02-21 00:27:45,795 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:37849'. Reason: failure-to-start- 3973s 2025-02-21 00:27:45,795 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:37849' closed. 3973s 2025-02-21 00:27:45,796 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38477': TLS handshake failed with remote 'tls://127.0.0.1:41614': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 3973s 2025-02-21 00:27:45,796 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38477': TLS handshake failed with remote 'tls://127.0.0.1:41618': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 3973s 2025-02-21 00:27:45,796 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 3973s Traceback (most recent call last): 3973s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 3973s return await fut 3973s ^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 3973s comm = await self.rpc.connect(saddr) 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1485, in connect 3973s return await self._connect(addr=addr, timeout=timeout) 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1429, in _connect 3973s comm = await connect( 3973s ^^^^^^^^^^^^^^ 3973s ...<4 lines>... 3973s ) 3973s ^ 3973s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3973s comm = await wait_for( 3973s ^^^^^^^^^^^^^^^ 3973s ...<2 lines>... 3973s ) 3973s ^ 3973s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 3973s return await fut 3973s ^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3973s stream = await self.client.connect( 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s ) 3973s ^ 3973s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3973s af, addr, stream = await connector.start(connect_timeout=timeout) 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s asyncio.exceptions.CancelledError 3973s 3973s The above exception was the direct cause of the following exception: 3973s 3973s Traceback (most recent call last): 3973s File "/usr/lib/python3/dist-packages/distributed/core.py", line 528, in start 3973s await wait_for(self.start_unsafe(), timeout=timeout) 3973s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1913, in wait_for 3973s async with asyncio.timeout(timeout): 3973s ~~~~~~~~~~~~~~~^^^^^^^^^ 3973s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3973s raise TimeoutError from exc_val 3973s TimeoutError 3973s 3973s The above exception was the direct cause of the following exception: 3973s 3973s Traceback (most recent call last): 3973s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 974, in _cluster_factory 3973s s, ws = await start_cluster( 3973s ^^^^^^^^^^^^^^^^^^^^ 3973s ...<9 lines>... 3973s ) 3973s ^ 3973s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 791, in start_cluster 3973s await asyncio.gather(*workers) 3973s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3973s return await awaitable 3973s ^^^^^^^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/core.py", line 531, in start 3973s raise asyncio.TimeoutError( 3973s f"{type(self).__name__} start timed out after {timeout}s." 3973s ) from exc 3973s TimeoutError: Nanny start timed out after 0s. 3973s 2025-02-21 00:27:46,802 - distributed.scheduler - INFO - State start 3973s 2025-02-21 00:27:46,808 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:46345 3973s 2025-02-21 00:27:46,812 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:32843/status 3973s 2025-02-21 00:27:46,815 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3973s 2025-02-21 00:27:46,826 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:38617'. Reason: failure-to-start- 3973s 2025-02-21 00:27:46,827 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:38617' closed. 3973s 2025-02-21 00:27:46,827 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:35785'. Reason: failure-to-start- 3973s 2025-02-21 00:27:46,827 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:35785' closed. 3973s 2025-02-21 00:27:46,828 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46345': TLS handshake failed with remote 'tls://127.0.0.1:44072': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 3973s 2025-02-21 00:27:46,828 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46345': TLS handshake failed with remote 'tls://127.0.0.1:44082': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 3973s 2025-02-21 00:27:46,828 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 3973s Traceback (most recent call last): 3973s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 3973s return await fut 3973s ^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 3973s comm = await self.rpc.connect(saddr) 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1485, in connect 3973s return await self._connect(addr=addr, timeout=timeout) 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1429, in _connect 3973s comm = await connect( 3973s ^^^^^^^^^^^^^^ 3973s ...<4 lines>... 3973s ) 3973s ^ 3973s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3973s comm = await wait_for( 3973s ^^^^^^^^^^^^^^^ 3973s ...<2 lines>... 3973s ) 3973s ^ 3973s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 3973s return await fut 3973s ^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3973s stream = await self.client.connect( 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s ) 3973s ^ 3973s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3973s af, addr, stream = await connector.start(connect_timeout=timeout) 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s asyncio.exceptions.CancelledError 3973s 3973s The above exception was the direct cause of the following exception: 3973s 3973s Traceback (most recent call last): 3973s File "/usr/lib/python3/dist-packages/distributed/core.py", line 528, in start 3973s await wait_for(self.start_unsafe(), timeout=timeout) 3973s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1913, in wait_for 3973s async with asyncio.timeout(timeout): 3973s ~~~~~~~~~~~~~~~^^^^^^^^^ 3973s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3973s raise TimeoutError from exc_val 3973s TimeoutError 3973s 3973s The above exception was the direct cause of the following exception: 3973s 3973s Traceback (most recent call last): 3973s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 974, in _cluster_factory 3973s s, ws = await start_cluster( 3973s ^^^^^^^^^^^^^^^^^^^^ 3973s ...<9 lines>... 3973s ) 3973s ^ 3973s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 791, in start_cluster 3973s await asyncio.gather(*workers) 3973s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3973s return await awaitable 3973s ^^^^^^^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/core.py", line 531, in start 3973s raise asyncio.TimeoutError( 3973s f"{type(self).__name__} start timed out after {timeout}s." 3973s ) from exc 3973s TimeoutError: Nanny start timed out after 0s. 3973s 2025-02-21 00:27:47,833 - distributed.scheduler - INFO - State start 3973s 2025-02-21 00:27:47,839 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:45669 3973s 2025-02-21 00:27:47,841 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:37223/status 3973s 2025-02-21 00:27:47,843 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3973s 2025-02-21 00:27:47,853 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:39375'. Reason: failure-to-start- 3973s 2025-02-21 00:27:47,854 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:39375' closed. 3973s 2025-02-21 00:27:47,854 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:36963'. Reason: failure-to-start- 3973s 2025-02-21 00:27:47,854 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:36963' closed. 3973s 2025-02-21 00:27:47,855 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45669': TLS handshake failed with remote 'tls://127.0.0.1:48438': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 3973s 2025-02-21 00:27:47,855 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45669': TLS handshake failed with remote 'tls://127.0.0.1:48448': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 3973s 2025-02-21 00:27:47,855 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 3973s Traceback (most recent call last): 3973s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 3973s return await fut 3973s ^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 3973s comm = await self.rpc.connect(saddr) 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1485, in connect 3973s return await self._connect(addr=addr, timeout=timeout) 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1429, in _connect 3973s comm = await connect( 3973s ^^^^^^^^^^^^^^ 3973s ...<4 lines>... 3973s ) 3973s ^ 3973s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3973s comm = await wait_for( 3973s ^^^^^^^^^^^^^^^ 3973s ...<2 lines>... 3973s ) 3973s ^ 3973s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 3973s return await fut 3973s ^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3973s stream = await self.client.connect( 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s ) 3973s ^ 3973s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3973s af, addr, stream = await connector.start(connect_timeout=timeout) 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s asyncio.exceptions.CancelledError 3973s 3973s The above exception was the direct cause of the following exception: 3973s 3973s Traceback (most recent call last): 3973s File "/usr/lib/python3/dist-packages/distributed/core.py", line 528, in start 3973s await wait_for(self.start_unsafe(), timeout=timeout) 3973s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1913, in wait_for 3973s async with asyncio.timeout(timeout): 3973s ~~~~~~~~~~~~~~~^^^^^^^^^ 3973s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3973s raise TimeoutError from exc_val 3973s TimeoutError 3973s 3973s The above exception was the direct cause of the following exception: 3973s 3973s Traceback (most recent call last): 3973s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 974, in _cluster_factory 3973s s, ws = await start_cluster( 3973s ^^^^^^^^^^^^^^^^^^^^ 3973s ...<9 lines>... 3973s ) 3973s ^ 3973s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 791, in start_cluster 3973s await asyncio.gather(*workers) 3973s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3973s return await awaitable 3973s ^^^^^^^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/core.py", line 531, in start 3973s raise asyncio.TimeoutError( 3973s f"{type(self).__name__} start timed out after {timeout}s." 3973s ) from exc 3973s TimeoutError: Nanny start timed out after 0s. 3973s 2025-02-21 00:27:48,859 - distributed.scheduler - INFO - State start 3973s 2025-02-21 00:27:48,865 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:36225 3973s 2025-02-21 00:27:48,868 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:44271/status 3973s 2025-02-21 00:27:48,871 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3973s 2025-02-21 00:27:48,880 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:36691'. Reason: failure-to-start- 3973s 2025-02-21 00:27:48,880 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:36691' closed. 3973s 2025-02-21 00:27:48,880 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:41421'. Reason: failure-to-start- 3973s 2025-02-21 00:27:48,881 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:41421' closed. 3973s 2025-02-21 00:27:48,881 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36225': TLS handshake failed with remote 'tls://127.0.0.1:58364': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 3973s 2025-02-21 00:27:48,881 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36225': TLS handshake failed with remote 'tls://127.0.0.1:58372': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 3973s 2025-02-21 00:27:48,881 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 3973s Traceback (most recent call last): 3973s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 3973s return await fut 3973s ^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 3973s comm = await self.rpc.connect(saddr) 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1485, in connect 3973s return await self._connect(addr=addr, timeout=timeout) 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1429, in _connect 3973s comm = await connect( 3973s ^^^^^^^^^^^^^^ 3973s ...<4 lines>... 3973s ) 3973s ^ 3973s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3973s comm = await wait_for( 3973s ^^^^^^^^^^^^^^^ 3973s ...<2 lines>... 3973s ) 3973s ^ 3973s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 3973s return await fut 3973s ^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3973s stream = await self.client.connect( 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s ) 3973s ^ 3973s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3973s af, addr, stream = await connector.start(connect_timeout=timeout) 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s asyncio.exceptions.CancelledError 3973s 3973s The above exception was the direct cause of the following exception: 3973s 3973s Traceback (most recent call last): 3973s File "/usr/lib/python3/dist-packages/distributed/core.py", line 528, in start 3973s await wait_for(self.start_unsafe(), timeout=timeout) 3973s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1913, in wait_for 3973s async with asyncio.timeout(timeout): 3973s ~~~~~~~~~~~~~~~^^^^^^^^^ 3973s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3973s raise TimeoutError from exc_val 3973s TimeoutError 3973s 3973s The above exception was the direct cause of the following exception: 3973s 3973s Traceback (most recent call last): 3973s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 974, in _cluster_factory 3973s s, ws = await start_cluster( 3973s ^^^^^^^^^^^^^^^^^^^^ 3973s ...<9 lines>... 3973s ) 3973s ^ 3973s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 791, in start_cluster 3973s await asyncio.gather(*workers) 3973s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3973s return await awaitable 3973s ^^^^^^^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/core.py", line 531, in start 3973s raise asyncio.TimeoutError( 3973s f"{type(self).__name__} start timed out after {timeout}s." 3973s ) from exc 3973s TimeoutError: Nanny start timed out after 0s. 3973s 2025-02-21 00:27:49,886 - distributed.scheduler - INFO - State start 3973s 2025-02-21 00:27:49,892 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:39011 3973s 2025-02-21 00:27:49,895 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:46837/status 3973s 2025-02-21 00:27:49,897 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3973s 2025-02-21 00:27:49,906 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:35099'. Reason: failure-to-start- 3973s 2025-02-21 00:27:49,906 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:35099' closed. 3973s 2025-02-21 00:27:49,906 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:37103'. Reason: failure-to-start- 3973s 2025-02-21 00:27:49,906 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:37103' closed. 3973s 2025-02-21 00:27:49,907 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39011': TLS handshake failed with remote 'tls://127.0.0.1:33580': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 3973s 2025-02-21 00:27:49,907 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39011': TLS handshake failed with remote 'tls://127.0.0.1:33596': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 3973s 2025-02-21 00:27:49,907 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 3973s Traceback (most recent call last): 3973s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 3973s return await fut 3973s ^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 3973s comm = await self.rpc.connect(saddr) 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1485, in connect 3973s return await self._connect(addr=addr, timeout=timeout) 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1429, in _connect 3973s comm = await connect( 3973s ^^^^^^^^^^^^^^ 3973s ...<4 lines>... 3973s ) 3973s ^ 3973s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3973s comm = await wait_for( 3973s ^^^^^^^^^^^^^^^ 3973s ...<2 lines>... 3973s ) 3973s ^ 3973s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 3973s return await fut 3973s ^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3973s stream = await self.client.connect( 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s ) 3973s ^ 3973s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3973s af, addr, stream = await connector.start(connect_timeout=timeout) 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s asyncio.exceptions.CancelledError 3973s 3973s The above exception was the direct cause of the following exception: 3973s 3973s Traceback (most recent call last): 3973s File "/usr/lib/python3/dist-packages/distributed/core.py", line 528, in start 3973s await wait_for(self.start_unsafe(), timeout=timeout) 3973s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1913, in wait_for 3973s async with asyncio.timeout(timeout): 3973s ~~~~~~~~~~~~~~~^^^^^^^^^ 3973s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3973s raise TimeoutError from exc_val 3973s TimeoutError 3973s 3973s The above exception was the direct cause of the following exception: 3973s 3973s Traceback (most recent call last): 3973s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 974, in _cluster_factory 3973s s, ws = await start_cluster( 3973s ^^^^^^^^^^^^^^^^^^^^ 3973s ...<9 lines>... 3973s ) 3973s ^ 3973s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 791, in start_cluster 3973s await asyncio.gather(*workers) 3973s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3973s return await awaitable 3973s ^^^^^^^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/core.py", line 531, in start 3973s raise asyncio.TimeoutError( 3973s f"{type(self).__name__} start timed out after {timeout}s." 3973s ) from exc 3973s TimeoutError: Nanny start timed out after 0s. 3973s 2025-02-21 00:27:50,912 - distributed.scheduler - INFO - State start 3973s 2025-02-21 00:27:50,918 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:35189 3973s 2025-02-21 00:27:50,920 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:36655/status 3973s 2025-02-21 00:27:50,922 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3973s 2025-02-21 00:27:50,929 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:39383'. Reason: failure-to-start- 3973s 2025-02-21 00:27:50,930 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:39383' closed. 3973s 2025-02-21 00:27:50,930 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:44077'. Reason: failure-to-start- 3973s 2025-02-21 00:27:50,930 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:44077' closed. 3973s 2025-02-21 00:27:50,930 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35189': TLS handshake failed with remote 'tls://127.0.0.1:49944': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 3973s 2025-02-21 00:27:50,930 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35189': TLS handshake failed with remote 'tls://127.0.0.1:49950': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 3973s 2025-02-21 00:27:50,931 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 3973s Traceback (most recent call last): 3973s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 3973s return await fut 3973s ^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 3973s comm = await self.rpc.connect(saddr) 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1485, in connect 3973s return await self._connect(addr=addr, timeout=timeout) 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1429, in _connect 3973s comm = await connect( 3973s ^^^^^^^^^^^^^^ 3973s ...<4 lines>... 3973s ) 3973s ^ 3973s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3973s comm = await wait_for( 3973s ^^^^^^^^^^^^^^^ 3973s ...<2 lines>... 3973s ) 3973s ^ 3973s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 3973s return await fut 3973s ^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3973s stream = await self.client.connect( 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s ) 3973s ^ 3973s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3973s af, addr, stream = await connector.start(connect_timeout=timeout) 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s asyncio.exceptions.CancelledError 3973s 3973s The above exception was the direct cause of the following exception: 3973s 3973s Traceback (most recent call last): 3973s File "/usr/lib/python3/dist-packages/distributed/core.py", line 528, in start 3973s await wait_for(self.start_unsafe(), timeout=timeout) 3973s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1913, in wait_for 3973s async with asyncio.timeout(timeout): 3973s ~~~~~~~~~~~~~~~^^^^^^^^^ 3973s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3973s raise TimeoutError from exc_val 3973s TimeoutError 3973s 3973s The above exception was the direct cause of the following exception: 3973s 3973s Traceback (most recent call last): 3973s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 974, in _cluster_factory 3973s s, ws = await start_cluster( 3973s ^^^^^^^^^^^^^^^^^^^^ 3973s ...<9 lines>... 3973s ) 3973s ^ 3973s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 791, in start_cluster 3973s await asyncio.gather(*workers) 3973s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3973s return await awaitable 3973s ^^^^^^^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/core.py", line 531, in start 3973s raise asyncio.TimeoutError( 3973s f"{type(self).__name__} start timed out after {timeout}s." 3973s ) from exc 3973s TimeoutError: Nanny start timed out after 0s. 3973s 2025-02-21 00:27:51,935 - distributed.scheduler - INFO - State start 3973s 2025-02-21 00:27:51,942 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:41099 3973s 2025-02-21 00:27:51,945 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:46707/status 3973s 2025-02-21 00:27:51,948 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3973s 2025-02-21 00:27:51,957 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:44949'. Reason: failure-to-start- 3973s 2025-02-21 00:27:51,957 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:44949' closed. 3973s 2025-02-21 00:27:51,957 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:39089'. Reason: failure-to-start- 3973s 2025-02-21 00:27:51,958 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:39089' closed. 3973s 2025-02-21 00:27:51,958 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41099': TLS handshake failed with remote 'tls://127.0.0.1:35426': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 3973s 2025-02-21 00:27:51,958 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41099': TLS handshake failed with remote 'tls://127.0.0.1:35434': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 3973s 2025-02-21 00:27:51,958 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 3973s Traceback (most recent call last): 3973s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 3973s return await fut 3973s ^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 3973s comm = await self.rpc.connect(saddr) 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1485, in connect 3973s return await self._connect(addr=addr, timeout=timeout) 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1429, in _connect 3973s comm = await connect( 3973s ^^^^^^^^^^^^^^ 3973s ...<4 lines>... 3973s ) 3973s ^ 3973s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3973s comm = await wait_for( 3973s ^^^^^^^^^^^^^^^ 3973s ...<2 lines>... 3973s ) 3973s ^ 3973s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 3973s return await fut 3973s ^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3973s stream = await self.client.connect( 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s ) 3973s ^ 3973s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3973s af, addr, stream = await connector.start(connect_timeout=timeout) 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s asyncio.exceptions.CancelledError 3973s 3973s The above exception was the direct cause of the following exception: 3973s 3973s Traceback (most recent call last): 3973s File "/usr/lib/python3/dist-packages/distributed/core.py", line 528, in start 3973s await wait_for(self.start_unsafe(), timeout=timeout) 3973s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1913, in wait_for 3973s async with asyncio.timeout(timeout): 3973s ~~~~~~~~~~~~~~~^^^^^^^^^ 3973s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3973s raise TimeoutError from exc_val 3973s TimeoutError 3973s 3973s The above exception was the direct cause of the following exception: 3973s 3973s Traceback (most recent call last): 3973s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 974, in _cluster_factory 3973s s, ws = await start_cluster( 3973s ^^^^^^^^^^^^^^^^^^^^ 3973s ...<9 lines>... 3973s ) 3973s ^ 3973s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 791, in start_cluster 3973s await asyncio.gather(*workers) 3973s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3973s return await awaitable 3973s ^^^^^^^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/core.py", line 531, in start 3973s raise asyncio.TimeoutError( 3973s f"{type(self).__name__} start timed out after {timeout}s." 3973s ) from exc 3973s TimeoutError: Nanny start timed out after 0s. 3973s 2025-02-21 00:27:52,963 - distributed.scheduler - INFO - State start 3973s 2025-02-21 00:27:52,970 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:41097 3973s 2025-02-21 00:27:52,973 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:36985/status 3973s 2025-02-21 00:27:52,974 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3973s 2025-02-21 00:27:52,981 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:41861'. Reason: failure-to-start- 3973s 2025-02-21 00:27:52,982 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:41861' closed. 3973s 2025-02-21 00:27:52,982 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:44455'. Reason: failure-to-start- 3973s 2025-02-21 00:27:52,982 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:44455' closed. 3973s 2025-02-21 00:27:52,983 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41097': TLS handshake failed with remote 'tls://127.0.0.1:34250': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 3973s 2025-02-21 00:27:52,983 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41097': TLS handshake failed with remote 'tls://127.0.0.1:34260': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 3973s 2025-02-21 00:27:52,983 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 3973s Traceback (most recent call last): 3973s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 3973s return await fut 3973s ^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 3973s comm = await self.rpc.connect(saddr) 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1485, in connect 3973s return await self._connect(addr=addr, timeout=timeout) 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1429, in _connect 3973s comm = await connect( 3973s ^^^^^^^^^^^^^^ 3973s ...<4 lines>... 3973s ) 3973s ^ 3973s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3973s comm = await wait_for( 3973s ^^^^^^^^^^^^^^^ 3973s ...<2 lines>... 3973s ) 3973s ^ 3973s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 3973s return await fut 3973s ^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3973s stream = await self.client.connect( 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s ) 3973s ^ 3973s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3973s af, addr, stream = await connector.start(connect_timeout=timeout) 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s asyncio.exceptions.CancelledError 3973s 3973s The above exception was the direct cause of the following exception: 3973s 3973s Traceback (most recent call last): 3973s File "/usr/lib/python3/dist-packages/distributed/core.py", line 528, in start 3973s await wait_for(self.start_unsafe(), timeout=timeout) 3973s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1913, in wait_for 3973s async with asyncio.timeout(timeout): 3973s ~~~~~~~~~~~~~~~^^^^^^^^^ 3973s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3973s raise TimeoutError from exc_val 3973s TimeoutError 3973s 3973s The above exception was the direct cause of the following exception: 3973s 3973s Traceback (most recent call last): 3973s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 974, in _cluster_factory 3973s s, ws = await start_cluster( 3973s ^^^^^^^^^^^^^^^^^^^^ 3973s ...<9 lines>... 3973s ) 3973s ^ 3973s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 791, in start_cluster 3973s await asyncio.gather(*workers) 3973s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3973s return await awaitable 3973s ^^^^^^^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/core.py", line 531, in start 3973s raise asyncio.TimeoutError( 3973s f"{type(self).__name__} start timed out after {timeout}s." 3973s ) from exc 3973s TimeoutError: Nanny start timed out after 0s. 3973s 2025-02-21 00:27:53,988 - distributed.scheduler - INFO - State start 3973s 2025-02-21 00:27:53,996 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:41401 3973s 2025-02-21 00:27:53,999 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:34733/status 3973s 2025-02-21 00:27:54,002 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3973s 2025-02-21 00:27:54,011 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:35253'. Reason: failure-to-start- 3973s 2025-02-21 00:27:54,012 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:35253' closed. 3973s 2025-02-21 00:27:54,012 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:41231'. Reason: failure-to-start- 3973s 2025-02-21 00:27:54,012 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:41231' closed. 3973s 2025-02-21 00:27:54,013 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41401': TLS handshake failed with remote 'tls://127.0.0.1:51292': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 3973s 2025-02-21 00:27:54,013 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41401': TLS handshake failed with remote 'tls://127.0.0.1:51294': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 3973s 2025-02-21 00:27:54,013 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 3973s Traceback (most recent call last): 3973s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 3973s return await fut 3973s ^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 3973s comm = await self.rpc.connect(saddr) 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1485, in connect 3973s return await self._connect(addr=addr, timeout=timeout) 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1429, in _connect 3973s comm = await connect( 3973s ^^^^^^^^^^^^^^ 3973s ...<4 lines>... 3973s ) 3973s ^ 3973s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3973s comm = await wait_for( 3973s ^^^^^^^^^^^^^^^ 3973s ...<2 lines>... 3973s ) 3973s ^ 3973s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 3973s return await fut 3973s ^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3973s stream = await self.client.connect( 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s ) 3973s ^ 3973s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3973s af, addr, stream = await connector.start(connect_timeout=timeout) 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s asyncio.exceptions.CancelledError 3973s 3973s The above exception was the direct cause of the following exception: 3973s 3973s Traceback (most recent call last): 3973s File "/usr/lib/python3/dist-packages/distributed/core.py", line 528, in start 3973s await wait_for(self.start_unsafe(), timeout=timeout) 3973s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1913, in wait_for 3973s async with asyncio.timeout(timeout): 3973s ~~~~~~~~~~~~~~~^^^^^^^^^ 3973s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3973s raise TimeoutError from exc_val 3973s TimeoutError 3973s 3973s The above exception was the direct cause of the following exception: 3973s 3973s Traceback (most recent call last): 3973s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 974, in _cluster_factory 3973s s, ws = await start_cluster( 3973s ^^^^^^^^^^^^^^^^^^^^ 3973s ...<9 lines>... 3973s ) 3973s ^ 3973s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 791, in start_cluster 3973s await asyncio.gather(*workers) 3973s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3973s return await awaitable 3973s ^^^^^^^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/core.py", line 531, in start 3973s raise asyncio.TimeoutError( 3973s f"{type(self).__name__} start timed out after {timeout}s." 3973s ) from exc 3973s TimeoutError: Nanny start timed out after 0s. 3973s 2025-02-21 00:27:55,018 - distributed.scheduler - INFO - State start 3973s 2025-02-21 00:27:55,024 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37467 3973s 2025-02-21 00:27:55,027 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:36563/status 3973s 2025-02-21 00:27:55,028 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3973s 2025-02-21 00:27:55,035 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:39529'. Reason: failure-to-start- 3973s 2025-02-21 00:27:55,036 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:39529' closed. 3973s 2025-02-21 00:27:55,036 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:41285'. Reason: failure-to-start- 3973s 2025-02-21 00:27:55,036 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:41285' closed. 3973s 2025-02-21 00:27:55,037 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37467': TLS handshake failed with remote 'tls://127.0.0.1:57134': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 3973s 2025-02-21 00:27:55,037 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37467': TLS handshake failed with remote 'tls://127.0.0.1:57146': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 3973s 2025-02-21 00:27:55,037 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 3973s Traceback (most recent call last): 3973s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 3973s return await fut 3973s ^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 3973s comm = await self.rpc.connect(saddr) 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1485, in connect 3973s return await self._connect(addr=addr, timeout=timeout) 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1429, in _connect 3973s comm = await connect( 3973s ^^^^^^^^^^^^^^ 3973s ...<4 lines>... 3973s ) 3973s ^ 3973s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3973s comm = await wait_for( 3973s ^^^^^^^^^^^^^^^ 3973s ...<2 lines>... 3973s ) 3973s ^ 3973s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 3973s return await fut 3973s ^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3973s stream = await self.client.connect( 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s ) 3973s ^ 3973s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3973s af, addr, stream = await connector.start(connect_timeout=timeout) 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s asyncio.exceptions.CancelledError 3973s 3973s The above exception was the direct cause of the following exception: 3973s 3973s Traceback (most recent call last): 3973s File "/usr/lib/python3/dist-packages/distributed/core.py", line 528, in start 3973s await wait_for(self.start_unsafe(), timeout=timeout) 3973s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1913, in wait_for 3973s async with asyncio.timeout(timeout): 3973s ~~~~~~~~~~~~~~~^^^^^^^^^ 3973s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3973s raise TimeoutError from exc_val 3973s TimeoutError 3973s 3973s The above exception was the direct cause of the following exception: 3973s 3973s Traceback (most recent call last): 3973s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 974, in _cluster_factory 3973s s, ws = await start_cluster( 3973s ^^^^^^^^^^^^^^^^^^^^ 3973s ...<9 lines>... 3973s ) 3973s ^ 3973s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 791, in start_cluster 3973s await asyncio.gather(*workers) 3973s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3973s return await awaitable 3973s ^^^^^^^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/core.py", line 531, in start 3973s raise asyncio.TimeoutError( 3973s f"{type(self).__name__} start timed out after {timeout}s." 3973s ) from exc 3973s TimeoutError: Nanny start timed out after 0s. 3973s 2025-02-21 00:27:56,041 - distributed.scheduler - INFO - State start 3973s 2025-02-21 00:27:56,048 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:41565 3973s 2025-02-21 00:27:56,050 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:46427/status 3973s 2025-02-21 00:27:56,051 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3973s 2025-02-21 00:27:56,059 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:33887'. Reason: failure-to-start- 3973s 2025-02-21 00:27:56,060 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:33887' closed. 3973s 2025-02-21 00:27:56,060 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:37429'. Reason: failure-to-start- 3973s 2025-02-21 00:27:56,060 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:37429' closed. 3973s 2025-02-21 00:27:56,061 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41565': TLS handshake failed with remote 'tls://127.0.0.1:48876': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 3973s 2025-02-21 00:27:56,061 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41565': TLS handshake failed with remote 'tls://127.0.0.1:48884': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 3973s 2025-02-21 00:27:56,061 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 3973s Traceback (most recent call last): 3973s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 3973s return await fut 3973s ^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 3973s comm = await self.rpc.connect(saddr) 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1485, in connect 3973s return await self._connect(addr=addr, timeout=timeout) 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1429, in _connect 3973s comm = await connect( 3973s ^^^^^^^^^^^^^^ 3973s ...<4 lines>... 3973s ) 3973s ^ 3973s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3973s comm = await wait_for( 3973s ^^^^^^^^^^^^^^^ 3973s ...<2 lines>... 3973s ) 3973s ^ 3973s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 3973s return await fut 3973s ^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3973s stream = await self.client.connect( 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s ) 3973s ^ 3973s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3973s af, addr, stream = await connector.start(connect_timeout=timeout) 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s asyncio.exceptions.CancelledError 3973s 3973s The above exception was the direct cause of the following exception: 3973s 3973s Traceback (most recent call last): 3973s File "/usr/lib/python3/dist-packages/distributed/core.py", line 528, in start 3973s await wait_for(self.start_unsafe(), timeout=timeout) 3973s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1913, in wait_for 3973s async with asyncio.timeout(timeout): 3973s ~~~~~~~~~~~~~~~^^^^^^^^^ 3973s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3973s raise TimeoutError from exc_val 3973s TimeoutError 3973s 3973s The above exception was the direct cause of the following exception: 3973s 3973s Traceback (most recent call last): 3973s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 974, in _cluster_factory 3973s s, ws = await start_cluster( 3973s ^^^^^^^^^^^^^^^^^^^^ 3973s ...<9 lines>... 3973s ) 3973s ^ 3973s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 791, in start_cluster 3973s await asyncio.gather(*workers) 3973s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3973s return await awaitable 3973s ^^^^^^^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/core.py", line 531, in start 3973s raise asyncio.TimeoutError( 3973s f"{type(self).__name__} start timed out after {timeout}s." 3973s ) from exc 3973s TimeoutError: Nanny start timed out after 0s. 3973s 2025-02-21 00:27:57,065 - distributed.scheduler - INFO - State start 3973s 2025-02-21 00:27:57,071 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37541 3973s 2025-02-21 00:27:57,073 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:33471/status 3973s 2025-02-21 00:27:57,074 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3973s 2025-02-21 00:27:57,083 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:40109'. Reason: failure-to-start- 3973s 2025-02-21 00:27:57,083 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:40109' closed. 3973s 2025-02-21 00:27:57,084 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:43109'. Reason: failure-to-start- 3973s 2025-02-21 00:27:57,084 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:43109' closed. 3973s 2025-02-21 00:27:57,084 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37541': TLS handshake failed with remote 'tls://127.0.0.1:55592': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 3973s 2025-02-21 00:27:57,084 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37541': TLS handshake failed with remote 'tls://127.0.0.1:55604': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 3973s 2025-02-21 00:27:57,085 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 3973s Traceback (most recent call last): 3973s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 3973s return await fut 3973s ^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 3973s comm = await self.rpc.connect(saddr) 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1485, in connect 3973s return await self._connect(addr=addr, timeout=timeout) 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1429, in _connect 3973s comm = await connect( 3973s ^^^^^^^^^^^^^^ 3973s ...<4 lines>... 3973s ) 3973s ^ 3973s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3973s comm = await wait_for( 3973s ^^^^^^^^^^^^^^^ 3973s ...<2 lines>... 3973s ) 3973s ^ 3973s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 3973s return await fut 3973s ^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3973s stream = await self.client.connect( 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s ) 3973s ^ 3973s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3973s af, addr, stream = await connector.start(connect_timeout=timeout) 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s asyncio.exceptions.CancelledError 3973s 3973s The above exception was the direct cause of the following exception: 3973s 3973s Traceback (most recent call last): 3973s File "/usr/lib/python3/dist-packages/distributed/core.py", line 528, in start 3973s await wait_for(self.start_unsafe(), timeout=timeout) 3973s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1913, in wait_for 3973s async with asyncio.timeout(timeout): 3973s ~~~~~~~~~~~~~~~^^^^^^^^^ 3973s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3973s raise TimeoutError from exc_val 3973s TimeoutError 3973s 3973s The above exception was the direct cause of the following exception: 3973s 3973s Traceback (most recent call last): 3973s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 974, in _cluster_factory 3973s s, ws = await start_cluster( 3973s ^^^^^^^^^^^^^^^^^^^^ 3973s ...<9 lines>... 3973s ) 3973s ^ 3973s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 791, in start_cluster 3973s await asyncio.gather(*workers) 3973s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3973s return await awaitable 3973s ^^^^^^^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/core.py", line 531, in start 3973s raise asyncio.TimeoutError( 3973s f"{type(self).__name__} start timed out after {timeout}s." 3973s ) from exc 3973s TimeoutError: Nanny start timed out after 0s. 3973s 2025-02-21 00:27:58,091 - distributed.scheduler - INFO - State start 3973s 2025-02-21 00:27:58,099 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:38039 3973s 2025-02-21 00:27:58,102 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:44815/status 3973s 2025-02-21 00:27:58,103 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3973s 2025-02-21 00:27:58,114 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:45649'. Reason: failure-to-start- 3973s 2025-02-21 00:27:58,114 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:45649' closed. 3973s 2025-02-21 00:27:58,114 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:35939'. Reason: failure-to-start- 3973s 2025-02-21 00:27:58,115 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:35939' closed. 3973s 2025-02-21 00:27:58,115 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38039': TLS handshake failed with remote 'tls://127.0.0.1:37288': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 3973s 2025-02-21 00:27:58,115 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38039': TLS handshake failed with remote 'tls://127.0.0.1:37294': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 3973s 2025-02-21 00:27:58,115 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 3973s Traceback (most recent call last): 3973s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 3973s return await fut 3973s ^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 3973s comm = await self.rpc.connect(saddr) 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1485, in connect 3973s return await self._connect(addr=addr, timeout=timeout) 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1429, in _connect 3973s comm = await connect( 3973s ^^^^^^^^^^^^^^ 3973s ...<4 lines>... 3973s ) 3973s ^ 3973s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3973s comm = await wait_for( 3973s ^^^^^^^^^^^^^^^ 3973s ...<2 lines>... 3973s ) 3973s ^ 3973s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 3973s return await fut 3973s ^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3973s stream = await self.client.connect( 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s ) 3973s ^ 3973s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3973s af, addr, stream = await connector.start(connect_timeout=timeout) 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s asyncio.exceptions.CancelledError 3973s 3973s The above exception was the direct cause of the following exception: 3973s 3973s Traceback (most recent call last): 3973s File "/usr/lib/python3/dist-packages/distributed/core.py", line 528, in start 3973s await wait_for(self.start_unsafe(), timeout=timeout) 3973s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1913, in wait_for 3973s async with asyncio.timeout(timeout): 3973s ~~~~~~~~~~~~~~~^^^^^^^^^ 3973s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3973s raise TimeoutError from exc_val 3973s TimeoutError 3973s 3973s The above exception was the direct cause of the following exception: 3973s 3973s Traceback (most recent call last): 3973s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 974, in _cluster_factory 3973s s, ws = await start_cluster( 3973s ^^^^^^^^^^^^^^^^^^^^ 3973s ...<9 lines>... 3973s ) 3973s ^ 3973s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 791, in start_cluster 3973s await asyncio.gather(*workers) 3973s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3973s return await awaitable 3973s ^^^^^^^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/core.py", line 531, in start 3973s raise asyncio.TimeoutError( 3973s f"{type(self).__name__} start timed out after {timeout}s." 3973s ) from exc 3973s TimeoutError: Nanny start timed out after 0s. 3973s 2025-02-21 00:27:59,122 - distributed.scheduler - INFO - State start 3973s 2025-02-21 00:27:59,132 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44673 3973s 2025-02-21 00:27:59,135 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:45873/status 3973s 2025-02-21 00:27:59,137 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3973s 2025-02-21 00:27:59,147 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:37997'. Reason: failure-to-start- 3973s 2025-02-21 00:27:59,147 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:37997' closed. 3973s 2025-02-21 00:27:59,148 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:42299'. Reason: failure-to-start- 3973s 2025-02-21 00:27:59,148 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:42299' closed. 3973s 2025-02-21 00:27:59,148 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44673': TLS handshake failed with remote 'tls://127.0.0.1:56642': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 3973s 2025-02-21 00:27:59,149 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44673': TLS handshake failed with remote 'tls://127.0.0.1:56654': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 3973s 2025-02-21 00:27:59,149 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 3973s Traceback (most recent call last): 3973s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 3973s return await fut 3973s ^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 3973s comm = await self.rpc.connect(saddr) 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1485, in connect 3973s return await self._connect(addr=addr, timeout=timeout) 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1429, in _connect 3973s comm = await connect( 3973s ^^^^^^^^^^^^^^ 3973s ...<4 lines>... 3973s ) 3973s ^ 3973s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3973s comm = await wait_for( 3973s ^^^^^^^^^^^^^^^ 3973s ...<2 lines>... 3973s ) 3973s ^ 3973s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 3973s return await fut 3973s ^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3973s stream = await self.client.connect( 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s ) 3973s ^ 3973s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3973s af, addr, stream = await connector.start(connect_timeout=timeout) 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s asyncio.exceptions.CancelledError 3973s 3973s The above exception was the direct cause of the following exception: 3973s 3973s Traceback (most recent call last): 3973s File "/usr/lib/python3/dist-packages/distributed/core.py", line 528, in start 3973s await wait_for(self.start_unsafe(), timeout=timeout) 3973s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1913, in wait_for 3973s async with asyncio.timeout(timeout): 3973s ~~~~~~~~~~~~~~~^^^^^^^^^ 3973s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3973s raise TimeoutError from exc_val 3973s TimeoutError 3973s 3973s The above exception was the direct cause of the following exception: 3973s 3973s Traceback (most recent call last): 3973s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 974, in _cluster_factory 3973s s, ws = await start_cluster( 3973s ^^^^^^^^^^^^^^^^^^^^ 3973s ...<9 lines>... 3973s ) 3973s ^ 3973s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 791, in start_cluster 3973s await asyncio.gather(*workers) 3973s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3973s return await awaitable 3973s ^^^^^^^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/core.py", line 531, in start 3973s raise asyncio.TimeoutError( 3973s f"{type(self).__name__} start timed out after {timeout}s." 3973s ) from exc 3973s TimeoutError: Nanny start timed out after 0s. 3973s 2025-02-21 00:28:00,154 - distributed.scheduler - INFO - State start 3973s 2025-02-21 00:28:00,161 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:35197 3973s 2025-02-21 00:28:00,165 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:40987/status 3973s 2025-02-21 00:28:00,168 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3973s 2025-02-21 00:28:00,181 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:36741'. Reason: failure-to-start- 3973s 2025-02-21 00:28:00,181 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:36741' closed. 3973s 2025-02-21 00:28:00,182 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:39819'. Reason: failure-to-start- 3973s 2025-02-21 00:28:00,182 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:39819' closed. 3973s 2025-02-21 00:28:00,182 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35197': TLS handshake failed with remote 'tls://127.0.0.1:36864': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 3973s 2025-02-21 00:28:00,182 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35197': TLS handshake failed with remote 'tls://127.0.0.1:36876': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 3973s 2025-02-21 00:28:00,183 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 3973s Traceback (most recent call last): 3973s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 3973s return await fut 3973s ^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 3973s comm = await self.rpc.connect(saddr) 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1485, in connect 3973s return await self._connect(addr=addr, timeout=timeout) 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1429, in _connect 3973s comm = await connect( 3973s ^^^^^^^^^^^^^^ 3973s ...<4 lines>... 3973s ) 3973s ^ 3973s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3973s comm = await wait_for( 3973s ^^^^^^^^^^^^^^^ 3973s ...<2 lines>... 3973s ) 3973s ^ 3973s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 3973s return await fut 3973s ^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3973s stream = await self.client.connect( 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s ) 3973s ^ 3973s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3973s af, addr, stream = await connector.start(connect_timeout=timeout) 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s asyncio.exceptions.CancelledError 3973s 3973s The above exception was the direct cause of the following exception: 3973s 3973s Traceback (most recent call last): 3973s File "/usr/lib/python3/dist-packages/distributed/core.py", line 528, in start 3973s await wait_for(self.start_unsafe(), timeout=timeout) 3973s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1913, in wait_for 3973s async with asyncio.timeout(timeout): 3973s ~~~~~~~~~~~~~~~^^^^^^^^^ 3973s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3973s raise TimeoutError from exc_val 3973s TimeoutError 3973s 3973s The above exception was the direct cause of the following exception: 3973s 3973s Traceback (most recent call last): 3973s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 974, in _cluster_factory 3973s s, ws = await start_cluster( 3973s ^^^^^^^^^^^^^^^^^^^^ 3973s ...<9 lines>... 3973s ) 3973s ^ 3973s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 791, in start_cluster 3973s await asyncio.gather(*workers) 3973s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3973s return await awaitable 3973s ^^^^^^^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/core.py", line 531, in start 3973s raise asyncio.TimeoutError( 3973s f"{type(self).__name__} start timed out after {timeout}s." 3973s ) from exc 3973s TimeoutError: Nanny start timed out after 0s. 3973s 2025-02-21 00:28:01,188 - distributed.scheduler - INFO - State start 3973s 2025-02-21 00:28:01,195 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:39359 3973s 2025-02-21 00:28:01,198 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:44331/status 3973s 2025-02-21 00:28:01,200 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3973s 2025-02-21 00:28:01,210 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:42179'. Reason: failure-to-start- 3973s 2025-02-21 00:28:01,210 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:42179' closed. 3973s 2025-02-21 00:28:01,211 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:34623'. Reason: failure-to-start- 3973s 2025-02-21 00:28:01,211 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:34623' closed. 3973s 2025-02-21 00:28:01,211 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39359': TLS handshake failed with remote 'tls://127.0.0.1:49552': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 3973s 2025-02-21 00:28:01,211 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39359': TLS handshake failed with remote 'tls://127.0.0.1:49562': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 3973s 2025-02-21 00:28:01,211 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 3973s Traceback (most recent call last): 3973s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 3973s return await fut 3973s ^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 3973s comm = await self.rpc.connect(saddr) 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1485, in connect 3973s return await self._connect(addr=addr, timeout=timeout) 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1429, in _connect 3973s comm = await connect( 3973s ^^^^^^^^^^^^^^ 3973s ...<4 lines>... 3973s ) 3973s ^ 3973s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3973s comm = await wait_for( 3973s ^^^^^^^^^^^^^^^ 3973s ...<2 lines>... 3973s ) 3973s ^ 3973s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 3973s return await fut 3973s ^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3973s stream = await self.client.connect( 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s ) 3973s ^ 3973s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3973s af, addr, stream = await connector.start(connect_timeout=timeout) 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s asyncio.exceptions.CancelledError 3973s 3973s The above exception was the direct cause of the following exception: 3973s 3973s Traceback (most recent call last): 3973s File "/usr/lib/python3/dist-packages/distributed/core.py", line 528, in start 3973s await wait_for(self.start_unsafe(), timeout=timeout) 3973s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1913, in wait_for 3973s async with asyncio.timeout(timeout): 3973s ~~~~~~~~~~~~~~~^^^^^^^^^ 3973s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3973s raise TimeoutError from exc_val 3973s TimeoutError 3973s 3973s The above exception was the direct cause of the following exception: 3973s 3973s Traceback (most recent call last): 3973s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 974, in _cluster_factory 3973s s, ws = await start_cluster( 3973s ^^^^^^^^^^^^^^^^^^^^ 3973s ...<9 lines>... 3973s ) 3973s ^ 3973s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 791, in start_cluster 3973s await asyncio.gather(*workers) 3973s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3973s return await awaitable 3973s ^^^^^^^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/core.py", line 531, in start 3973s raise asyncio.TimeoutError( 3973s f"{type(self).__name__} start timed out after {timeout}s." 3973s ) from exc 3973s TimeoutError: Nanny start timed out after 0s. 3973s 2025-02-21 00:28:02,216 - distributed.scheduler - INFO - State start 3973s 2025-02-21 00:28:02,222 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:42755 3973s 2025-02-21 00:28:02,225 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:33875/status 3973s 2025-02-21 00:28:02,226 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3973s 2025-02-21 00:28:02,235 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:42409'. Reason: failure-to-start- 3973s 2025-02-21 00:28:02,235 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:42409' closed. 3973s 2025-02-21 00:28:02,235 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:39231'. Reason: failure-to-start- 3973s 2025-02-21 00:28:02,236 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:39231' closed. 3973s 2025-02-21 00:28:02,236 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42755': TLS handshake failed with remote 'tls://127.0.0.1:50778': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 3973s 2025-02-21 00:28:02,236 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42755': TLS handshake failed with remote 'tls://127.0.0.1:50784': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 3973s 2025-02-21 00:28:02,236 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 3973s Traceback (most recent call last): 3973s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 3973s return await fut 3973s ^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 3973s comm = await self.rpc.connect(saddr) 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1485, in connect 3973s return await self._connect(addr=addr, timeout=timeout) 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1429, in _connect 3973s comm = await connect( 3973s ^^^^^^^^^^^^^^ 3973s ...<4 lines>... 3973s ) 3973s ^ 3973s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3973s comm = await wait_for( 3973s ^^^^^^^^^^^^^^^ 3973s ...<2 lines>... 3973s ) 3973s ^ 3973s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 3973s return await fut 3973s ^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3973s stream = await self.client.connect( 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s ) 3973s ^ 3973s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3973s af, addr, stream = await connector.start(connect_timeout=timeout) 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s asyncio.exceptions.CancelledError 3973s 3973s The above exception was the direct cause of the following exception: 3973s 3973s Traceback (most recent call last): 3973s File "/usr/lib/python3/dist-packages/distributed/core.py", line 528, in start 3973s await wait_for(self.start_unsafe(), timeout=timeout) 3973s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1913, in wait_for 3973s async with asyncio.timeout(timeout): 3973s ~~~~~~~~~~~~~~~^^^^^^^^^ 3973s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3973s raise TimeoutError from exc_val 3973s TimeoutError 3973s 3973s The above exception was the direct cause of the following exception: 3973s 3973s Traceback (most recent call last): 3973s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 974, in _cluster_factory 3973s s, ws = await start_cluster( 3973s ^^^^^^^^^^^^^^^^^^^^ 3973s ...<9 lines>... 3973s ) 3973s ^ 3973s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 791, in start_cluster 3973s await asyncio.gather(*workers) 3973s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3973s return await awaitable 3973s ^^^^^^^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/core.py", line 531, in start 3973s raise asyncio.TimeoutError( 3973s f"{type(self).__name__} start timed out after {timeout}s." 3973s ) from exc 3973s TimeoutError: Nanny start timed out after 0s. 3973s 2025-02-21 00:28:03,242 - distributed.scheduler - INFO - State start 3973s 2025-02-21 00:28:03,249 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:39623 3973s 2025-02-21 00:28:03,252 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:33627/status 3973s 2025-02-21 00:28:03,254 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3973s 2025-02-21 00:28:03,263 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:43785'. Reason: failure-to-start- 3973s 2025-02-21 00:28:03,263 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:43785' closed. 3973s 2025-02-21 00:28:03,263 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:38155'. Reason: failure-to-start- 3973s 2025-02-21 00:28:03,263 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:38155' closed. 3973s 2025-02-21 00:28:03,264 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:42040': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 3973s 2025-02-21 00:28:03,264 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39623': TLS handshake failed with remote 'tls://127.0.0.1:42050': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 3973s 2025-02-21 00:28:03,264 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 3973s Traceback (most recent call last): 3973s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 3973s return await fut 3973s ^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 3973s comm = await self.rpc.connect(saddr) 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1485, in connect 3973s return await self._connect(addr=addr, timeout=timeout) 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1429, in _connect 3973s comm = await connect( 3973s ^^^^^^^^^^^^^^ 3973s ...<4 lines>... 3973s ) 3973s ^ 3973s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3973s comm = await wait_for( 3973s ^^^^^^^^^^^^^^^ 3973s ...<2 lines>... 3973s ) 3973s ^ 3973s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 3973s return await fut 3973s ^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3973s stream = await self.client.connect( 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s ) 3973s ^ 3973s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3973s af, addr, stream = await connector.start(connect_timeout=timeout) 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s asyncio.exceptions.CancelledError 3973s 3973s The above exception was the direct cause of the following exception: 3973s 3973s Traceback (most recent call last): 3973s File "/usr/lib/python3/dist-packages/distributed/core.py", line 528, in start 3973s await wait_for(self.start_unsafe(), timeout=timeout) 3973s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1913, in wait_for 3973s async with asyncio.timeout(timeout): 3973s ~~~~~~~~~~~~~~~^^^^^^^^^ 3973s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3973s raise TimeoutError from exc_val 3973s TimeoutError 3973s 3973s The above exception was the direct cause of the following exception: 3973s 3973s Traceback (most recent call last): 3973s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 974, in _cluster_factory 3973s s, ws = await start_cluster( 3973s ^^^^^^^^^^^^^^^^^^^^ 3973s ...<9 lines>... 3973s ) 3973s ^ 3973s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 791, in start_cluster 3973s await asyncio.gather(*workers) 3973s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3973s return await awaitable 3973s ^^^^^^^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/core.py", line 531, in start 3973s raise asyncio.TimeoutError( 3973s f"{type(self).__name__} start timed out after {timeout}s." 3973s ) from exc 3973s TimeoutError: Nanny start timed out after 0s. 3973s 2025-02-21 00:28:04,270 - distributed.scheduler - INFO - State start 3973s 2025-02-21 00:28:04,277 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37007 3973s 2025-02-21 00:28:04,279 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:39285/status 3973s 2025-02-21 00:28:04,283 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3973s 2025-02-21 00:28:04,294 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:37201'. Reason: failure-to-start- 3973s 2025-02-21 00:28:04,294 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:37201' closed. 3973s 2025-02-21 00:28:04,294 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:39987'. Reason: failure-to-start- 3973s 2025-02-21 00:28:04,295 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:39987' closed. 3973s 2025-02-21 00:28:04,295 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37007': TLS handshake failed with remote 'tls://127.0.0.1:55250': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 3973s 2025-02-21 00:28:04,295 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37007': TLS handshake failed with remote 'tls://127.0.0.1:55254': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 3973s 2025-02-21 00:28:04,295 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 3973s Traceback (most recent call last): 3973s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 3973s return await fut 3973s ^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 3973s comm = await self.rpc.connect(saddr) 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1485, in connect 3973s return await self._connect(addr=addr, timeout=timeout) 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1429, in _connect 3973s comm = await connect( 3973s ^^^^^^^^^^^^^^ 3973s ...<4 lines>... 3973s ) 3973s ^ 3973s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3973s comm = await wait_for( 3973s ^^^^^^^^^^^^^^^ 3973s ...<2 lines>... 3973s ) 3973s ^ 3973s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 3973s return await fut 3973s ^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3973s stream = await self.client.connect( 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s ) 3973s ^ 3973s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3973s af, addr, stream = await connector.start(connect_timeout=timeout) 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s asyncio.exceptions.CancelledError 3973s 3973s The above exception was the direct cause of the following exception: 3973s 3973s Traceback (most recent call last): 3973s File "/usr/lib/python3/dist-packages/distributed/core.py", line 528, in start 3973s await wait_for(self.start_unsafe(), timeout=timeout) 3973s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1913, in wait_for 3973s async with asyncio.timeout(timeout): 3973s ~~~~~~~~~~~~~~~^^^^^^^^^ 3973s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3973s raise TimeoutError from exc_val 3973s TimeoutError 3973s 3973s The above exception was the direct cause of the following exception: 3973s 3973s Traceback (most recent call last): 3973s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 974, in _cluster_factory 3973s s, ws = await start_cluster( 3973s ^^^^^^^^^^^^^^^^^^^^ 3973s ...<9 lines>... 3973s ) 3973s ^ 3973s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 791, in start_cluster 3973s await asyncio.gather(*workers) 3973s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3973s return await awaitable 3973s ^^^^^^^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/core.py", line 531, in start 3973s raise asyncio.TimeoutError( 3973s f"{type(self).__name__} start timed out after {timeout}s." 3973s ) from exc 3973s TimeoutError: Nanny start timed out after 0s. 3973s _____________________________ test_retire_workers ______________________________ 3973s 3973s fut = , timeout = 0 3973s 3973s async def wait_for(fut: Awaitable[T], timeout: float) -> T: 3973s async with asyncio.timeout(timeout): 3973s > return await fut 3973s 3973s /usr/lib/python3/dist-packages/distributed/utils.py:1914: 3973s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 3973s /usr/lib/python3/dist-packages/distributed/nanny.py:358: in start_unsafe 3973s comm = await self.rpc.connect(saddr) 3973s /usr/lib/python3/dist-packages/distributed/core.py:1485: in connect 3973s return await self._connect(addr=addr, timeout=timeout) 3973s /usr/lib/python3/dist-packages/distributed/core.py:1429: in _connect 3973s comm = await connect( 3973s /usr/lib/python3/dist-packages/distributed/comm/core.py:342: in connect 3973s comm = await wait_for( 3973s /usr/lib/python3/dist-packages/distributed/utils.py:1914: in wait_for 3973s return await fut 3973s /usr/lib/python3/dist-packages/distributed/comm/tcp.py:546: in connect 3973s stream = await self.client.connect( 3973s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 3973s 3973s self = 3973s host = '127.0.0.1', port = 33375, af = 3973s ssl_options = 3973s max_buffer_size = 4163035136.0, source_ip = None, source_port = None 3973s timeout = None 3973s 3973s async def connect( 3973s self, 3973s host: str, 3973s port: int, 3973s af: socket.AddressFamily = socket.AF_UNSPEC, 3973s ssl_options: Optional[Union[Dict[str, Any], ssl.SSLContext]] = None, 3973s max_buffer_size: Optional[int] = None, 3973s source_ip: Optional[str] = None, 3973s source_port: Optional[int] = None, 3973s timeout: Optional[Union[float, datetime.timedelta]] = None, 3973s ) -> IOStream: 3973s """Connect to the given host and port. 3973s 3973s Asynchronously returns an `.IOStream` (or `.SSLIOStream` if 3973s ``ssl_options`` is not None). 3973s 3973s Using the ``source_ip`` kwarg, one can specify the source 3973s IP address to use when establishing the connection. 3973s In case the user needs to resolve and 3973s use a specific interface, it has to be handled outside 3973s of Tornado as this depends very much on the platform. 3973s 3973s Raises `TimeoutError` if the input future does not complete before 3973s ``timeout``, which may be specified in any form allowed by 3973s `.IOLoop.add_timeout` (i.e. a `datetime.timedelta` or an absolute time 3973s relative to `.IOLoop.time`) 3973s 3973s Similarly, when the user requires a certain source port, it can 3973s be specified using the ``source_port`` arg. 3973s 3973s .. versionchanged:: 4.5 3973s Added the ``source_ip`` and ``source_port`` arguments. 3973s 3973s .. versionchanged:: 5.0 3973s Added the ``timeout`` argument. 3973s """ 3973s if timeout is not None: 3973s if isinstance(timeout, numbers.Real): 3973s timeout = IOLoop.current().time() + timeout 3973s elif isinstance(timeout, datetime.timedelta): 3973s timeout = IOLoop.current().time() + timeout.total_seconds() 3973s else: 3973s raise TypeError("Unsupported timeout %r" % timeout) 3973s if timeout is not None: 3973s addrinfo = await gen.with_timeout( 3973s timeout, self.resolver.resolve(host, port, af) 3973s ) 3973s else: 3973s addrinfo = await self.resolver.resolve(host, port, af) 3973s connector = _Connector( 3973s addrinfo, 3973s functools.partial( 3973s self._create_stream, 3973s max_buffer_size, 3973s source_ip=source_ip, 3973s source_port=source_port, 3973s ), 3973s ) 3973s > af, addr, stream = await connector.start(connect_timeout=timeout) 3973s E asyncio.exceptions.CancelledError 3973s 3973s /usr/lib/python3/dist-packages/tornado/tcpclient.py:279: CancelledError 3973s 3973s The above exception was the direct cause of the following exception: 3973s 3973s self = 3973s 3973s @final 3973s async def start(self): 3973s async with self._startup_lock: 3973s if self.status == Status.failed: 3973s assert self.__startup_exc is not None 3973s raise self.__startup_exc 3973s elif self.status != Status.init: 3973s return self 3973s timeout = getattr(self, "death_timeout", None) 3973s 3973s async def _close_on_failure(exc: Exception) -> None: 3973s await self.close(reason=f"failure-to-start-{str(type(exc))}") 3973s self.status = Status.failed 3973s self.__startup_exc = exc 3973s 3973s try: 3973s > await wait_for(self.start_unsafe(), timeout=timeout) 3973s 3973s /usr/lib/python3/dist-packages/distributed/core.py:528: 3973s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 3973s /usr/lib/python3/dist-packages/distributed/utils.py:1913: in wait_for 3973s async with asyncio.timeout(timeout): 3973s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 3973s 3973s self = 3973s exc_type = 3973s exc_val = CancelledError(), exc_tb = 3973s 3973s async def __aexit__( 3973s self, 3973s exc_type: Optional[Type[BaseException]], 3973s exc_val: Optional[BaseException], 3973s exc_tb: Optional[TracebackType], 3973s ) -> Optional[bool]: 3973s assert self._state in (_State.ENTERED, _State.EXPIRING) 3973s 3973s if self._timeout_handler is not None: 3973s self._timeout_handler.cancel() 3973s self._timeout_handler = None 3973s 3973s if self._state is _State.EXPIRING: 3973s self._state = _State.EXPIRED 3973s 3973s if self._task.uncancel() <= self._cancelling and exc_type is not None: 3973s # Since there are no new cancel requests, we're 3973s # handling this. 3973s if issubclass(exc_type, exceptions.CancelledError): 3973s > raise TimeoutError from exc_val 3973s E TimeoutError 3973s 3973s /usr/lib/python3.13/asyncio/timeouts.py:116: TimeoutError 3973s 3973s The above exception was the direct cause of the following exception: 3973s 3973s @contextlib.asynccontextmanager 3973s async def _cluster_factory(): 3973s workers = [] 3973s s = None 3973s try: 3973s for _ in range(60): 3973s try: 3973s > s, ws = await start_cluster( 3973s nthreads, 3973s scheduler, 3973s security=security, 3973s Worker=Worker, 3973s scheduler_kwargs=scheduler_kwargs, 3973s worker_kwargs=merge( 3973s {"death_timeout": min(15, int(deadline.remaining))}, 3973s worker_kwargs, 3973s ), 3973s ) 3973s 3973s /usr/lib/python3/dist-packages/distributed/utils_test.py:974: 3973s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 3973s /usr/lib/python3/dist-packages/distributed/utils_test.py:791: in start_cluster 3973s await asyncio.gather(*workers) 3973s /usr/lib/python3.13/asyncio/tasks.py:737: in _wrap_awaitable 3973s return await awaitable 3973s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 3973s 3973s self = 3973s 3973s @final 3973s async def start(self): 3973s async with self._startup_lock: 3973s if self.status == Status.failed: 3973s assert self.__startup_exc is not None 3973s raise self.__startup_exc 3973s elif self.status != Status.init: 3973s return self 3973s timeout = getattr(self, "death_timeout", None) 3973s 3973s async def _close_on_failure(exc: Exception) -> None: 3973s await self.close(reason=f"failure-to-start-{str(type(exc))}") 3973s self.status = Status.failed 3973s self.__startup_exc = exc 3973s 3973s try: 3973s await wait_for(self.start_unsafe(), timeout=timeout) 3973s except asyncio.TimeoutError as exc: 3973s await _close_on_failure(exc) 3973s > raise asyncio.TimeoutError( 3973s f"{type(self).__name__} start timed out after {timeout}s." 3973s ) from exc 3973s E TimeoutError: Nanny start timed out after 0s. 3973s 3973s /usr/lib/python3/dist-packages/distributed/core.py:531: TimeoutError 3973s 3973s During handling of the above exception, another exception occurred: 3973s 3973s fut = ._..test_func..async_fn at 0x718ce147f300> 3973s timeout = 60 3973s 3973s async def wait_for(fut: Awaitable[T], timeout: float) -> T: 3973s async with asyncio.timeout(timeout): 3973s > return await fut 3973s 3973s /usr/lib/python3/dist-packages/distributed/utils.py:1914: 3973s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 3973s /usr/lib/python3/dist-packages/distributed/utils_test.py:1007: in async_fn 3973s _cluster_factory() as (s, workers), 3973s /usr/lib/python3.13/contextlib.py:214: in __aenter__ 3973s return await anext(self.gen) 3973s /usr/lib/python3/dist-packages/distributed/utils_test.py:991: in _cluster_factory 3973s await asyncio.sleep(1) 3973s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 3973s 3973s delay = 1, result = None 3973s 3973s async def sleep(delay, result=None): 3973s """Coroutine that completes after a given time (in seconds).""" 3973s if delay <= 0: 3973s await __sleep0() 3973s return result 3973s 3973s if math.isnan(delay): 3973s raise ValueError("Invalid delay: NaN (not a number)") 3973s 3973s loop = events.get_running_loop() 3973s future = loop.create_future() 3973s h = loop.call_later(delay, 3973s futures._set_result_unless_cancelled, 3973s future, result) 3973s try: 3973s > return await future 3973s E asyncio.exceptions.CancelledError 3973s 3973s /usr/lib/python3.13/asyncio/tasks.py:718: CancelledError 3973s 3973s The above exception was the direct cause of the following exception: 3973s 3973s args = (), kwds = {} 3973s 3973s @wraps(func) 3973s def inner(*args, **kwds): 3973s with self._recreate_cm(): 3973s > return func(*args, **kwds) 3973s 3973s /usr/lib/python3.13/contextlib.py:85: 3973s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 3973s /usr/lib/python3.13/contextlib.py:85: in inner 3973s return func(*args, **kwds) 3973s /usr/lib/python3/dist-packages/distributed/utils_test.py:1090: in test_func 3973s return _run_and_close_tornado(async_fn_outer) 3973s /usr/lib/python3/dist-packages/distributed/utils_test.py:380: in _run_and_close_tornado 3973s return asyncio_run(inner_fn(), loop_factory=get_loop_factory()) 3973s /usr/lib/python3.13/asyncio/runners.py:195: in run 3973s return runner.run(main) 3973s /usr/lib/python3.13/asyncio/runners.py:118: in run 3973s return self._loop.run_until_complete(task) 3973s /usr/lib/python3.13/asyncio/base_events.py:725: in run_until_complete 3973s return future.result() 3973s /usr/lib/python3/dist-packages/distributed/utils_test.py:377: in inner_fn 3973s return await async_fn(*args, **kwargs) 3973s /usr/lib/python3/dist-packages/distributed/utils_test.py:1087: in async_fn_outer 3973s return await utils_wait_for(async_fn(), timeout=timeout * 2) 3973s /usr/lib/python3/dist-packages/distributed/utils.py:1913: in wait_for 3973s async with asyncio.timeout(timeout): 3973s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 3973s 3973s self = 3973s exc_type = 3973s exc_val = CancelledError(), exc_tb = 3973s 3973s async def __aexit__( 3973s self, 3973s exc_type: Optional[Type[BaseException]], 3973s exc_val: Optional[BaseException], 3973s exc_tb: Optional[TracebackType], 3973s ) -> Optional[bool]: 3973s assert self._state in (_State.ENTERED, _State.EXPIRING) 3973s 3973s if self._timeout_handler is not None: 3973s self._timeout_handler.cancel() 3973s self._timeout_handler = None 3973s 3973s if self._state is _State.EXPIRING: 3973s self._state = _State.EXPIRED 3973s 3973s if self._task.uncancel() <= self._cancelling and exc_type is not None: 3973s # Since there are no new cancel requests, we're 3973s # handling this. 3973s if issubclass(exc_type, exceptions.CancelledError): 3973s > raise TimeoutError from exc_val 3973s E TimeoutError 3973s 3973s /usr/lib/python3.13/asyncio/timeouts.py:116: TimeoutError 3973s ----------------------------- Captured stderr call ----------------------------- 3973s 2025-02-21 00:28:08,042 - distributed.scheduler - INFO - State start 3973s 2025-02-21 00:28:08,050 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:33077 3973s 2025-02-21 00:28:08,054 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:41129/status 3973s 2025-02-21 00:28:08,057 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3973s 2025-02-21 00:28:08,077 - distributed.nanny - INFO - Start Nanny at: 'tls://127.0.0.1:38949' 3973s 2025-02-21 00:28:08,080 - distributed.nanny - INFO - Start Nanny at: 'tls://127.0.0.1:33059' 3973s 2025-02-21 00:28:08,838 - distributed.worker.memory - WARNING - Ignoring provided memory limit 8326070272 due to system memory limit of 7.75 GiB 3973s 2025-02-21 00:28:08,857 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43571 3973s 2025-02-21 00:28:08,857 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43571 3973s 2025-02-21 00:28:08,857 - distributed.worker - INFO - Worker name: 0 3973s 2025-02-21 00:28:08,857 - distributed.worker - INFO - dashboard at: 127.0.0.1:46221 3973s 2025-02-21 00:28:08,857 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33077 3973s 2025-02-21 00:28:08,857 - distributed.worker - INFO - ------------------------------------------------- 3973s 2025-02-21 00:28:08,857 - distributed.worker - INFO - Threads: 1 3973s 2025-02-21 00:28:08,857 - distributed.worker - INFO - Memory: 7.75 GiB 3973s 2025-02-21 00:28:08,857 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-o2mplaiv 3973s 2025-02-21 00:28:08,857 - distributed.worker - INFO - ------------------------------------------------- 3973s 2025-02-21 00:28:08,891 - distributed.worker.memory - WARNING - Ignoring provided memory limit 8326070272 due to system memory limit of 7.75 GiB 3973s 2025-02-21 00:28:08,912 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34899 3973s 2025-02-21 00:28:08,913 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34899 3973s 2025-02-21 00:28:08,913 - distributed.worker - INFO - Worker name: 1 3973s 2025-02-21 00:28:08,913 - distributed.worker - INFO - dashboard at: 127.0.0.1:38639 3973s 2025-02-21 00:28:08,913 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33077 3973s 2025-02-21 00:28:08,913 - distributed.worker - INFO - ------------------------------------------------- 3973s 2025-02-21 00:28:08,913 - distributed.worker - INFO - Threads: 2 3973s 2025-02-21 00:28:08,913 - distributed.worker - INFO - Memory: 7.75 GiB 3973s 2025-02-21 00:28:08,913 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-4yp4wllb 3973s 2025-02-21 00:28:08,913 - distributed.worker - INFO - ------------------------------------------------- 3973s 2025-02-21 00:28:09,126 - distributed.scheduler - INFO - Register worker addr: tls://127.0.0.1:43571 name: 0 3973s 2025-02-21 00:28:09,130 - distributed.worker - INFO - Starting Worker plugin shuffle 3973s 2025-02-21 00:28:09,130 - distributed.worker - INFO - Registered to: tls://127.0.0.1:33077 3973s 2025-02-21 00:28:09,130 - distributed.worker - INFO - ------------------------------------------------- 3973s 2025-02-21 00:28:09,131 - distributed.core - INFO - Starting established connection to tls://127.0.0.1:33077 3973s 2025-02-21 00:28:09,129 - distributed.scheduler - INFO - Starting worker compute stream, tls://127.0.0.1:43571 3973s 2025-02-21 00:28:09,132 - distributed.core - INFO - Starting established connection to tls://127.0.0.1:56442 3973s 2025-02-21 00:28:09,186 - distributed.scheduler - INFO - Register worker addr: tls://127.0.0.1:34899 name: 1 3973s 2025-02-21 00:28:09,190 - distributed.worker - INFO - Starting Worker plugin shuffle 3973s 2025-02-21 00:28:09,191 - distributed.worker - INFO - Registered to: tls://127.0.0.1:33077 3973s 2025-02-21 00:28:09,191 - distributed.worker - INFO - ------------------------------------------------- 3973s 2025-02-21 00:28:09,189 - distributed.scheduler - INFO - Starting worker compute stream, tls://127.0.0.1:34899 3973s 2025-02-21 00:28:09,191 - distributed.core - INFO - Starting established connection to tls://127.0.0.1:33077 3973s 2025-02-21 00:28:09,191 - distributed.core - INFO - Starting established connection to tls://127.0.0.1:56454 3973s 2025-02-21 00:28:09,192 - distributed.core - INFO - Connection to tls://127.0.0.1:56454 has been closed. 3973s 2025-02-21 00:28:09,192 - distributed.core - INFO - Connection to tls://127.0.0.1:33077 has been closed. 3973s 2025-02-21 00:28:09,192 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34899. Reason: worker-handle-scheduler-connection-broken 3973s 2025-02-21 00:28:09,192 - distributed.scheduler - INFO - Remove worker addr: tls://127.0.0.1:34899 name: 1 (stimulus_id='handle-worker-cleanup-1740097689.1924312') 3973s 2025-02-21 00:28:09,235 - distributed.nanny - INFO - Closing Nanny gracefully at 'tls://127.0.0.1:33059'. Reason: worker-handle-scheduler-connection-broken 3973s 2025-02-21 00:28:09,236 - distributed.worker - INFO - Removing Worker plugin shuffle 3973s 2025-02-21 00:28:09,237 - distributed.nanny - INFO - Worker closed 3973s 2025-02-21 00:28:11,239 - distributed.nanny - ERROR - Worker process died unexpectedly 3973s 2025-02-21 00:28:11,423 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:33059'. Reason: nanny-close-gracefully 3973s 2025-02-21 00:28:11,423 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:33059' closed. 3973s 2025-02-21 00:28:39,244 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:38949'. Reason: nanny-close 3973s 2025-02-21 00:28:39,245 - distributed.nanny - INFO - Nanny asking worker to close. Reason: nanny-close 3973s 2025-02-21 00:28:39,246 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43571. Reason: nanny-close 3973s 2025-02-21 00:28:39,246 - distributed.worker - INFO - Removing Worker plugin shuffle 3973s 2025-02-21 00:28:39,247 - distributed.core - INFO - Received 'close-stream' from tls://127.0.0.1:56442; closing. 3973s 2025-02-21 00:28:39,247 - distributed.core - INFO - Connection to tls://127.0.0.1:33077 has been closed. 3973s 2025-02-21 00:28:39,249 - distributed.nanny - INFO - Worker closed 3973s 2025-02-21 00:28:39,247 - distributed.scheduler - INFO - Remove worker addr: tls://127.0.0.1:43571 name: 0 (stimulus_id='handle-worker-cleanup-1740097719.2477973') 3973s 2025-02-21 00:28:39,250 - distributed.scheduler - INFO - Lost all workers 3973s 2025-02-21 00:28:39,425 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:38949' closed. 3973s 2025-02-21 00:28:39,426 - distributed.scheduler - INFO - Closing scheduler. Reason: unknown 3973s 2025-02-21 00:28:39,431 - distributed.scheduler - INFO - Scheduler closing all comms 3973s 2025-02-21 00:28:39,434 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Cluster creation timeout; retrying 3973s Traceback (most recent call last): 3973s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 974, in _cluster_factory 3973s s, ws = await start_cluster( 3973s ^^^^^^^^^^^^^^^^^^^^ 3973s ...<9 lines>... 3973s ) 3973s ^ 3973s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 806, in start_cluster 3973s raise TimeoutError("Cluster creation timeout") 3973s TimeoutError: Cluster creation timeout 3973s 2025-02-21 00:28:40,440 - distributed.scheduler - INFO - State start 3973s 2025-02-21 00:28:40,448 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:45213 3973s 2025-02-21 00:28:40,451 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:42983/status 3973s 2025-02-21 00:28:40,454 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3973s 2025-02-21 00:28:40,466 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:41285'. Reason: failure-to-start- 3973s 2025-02-21 00:28:40,467 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:41285' closed. 3973s 2025-02-21 00:28:40,467 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:45523'. Reason: failure-to-start- 3973s 2025-02-21 00:28:40,468 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:45523' closed. 3973s 2025-02-21 00:28:40,468 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45213': TLS handshake failed with remote 'tls://127.0.0.1:40890': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 3973s 2025-02-21 00:28:40,468 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45213': TLS handshake failed with remote 'tls://127.0.0.1:40902': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 3973s 2025-02-21 00:28:40,468 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 3973s Traceback (most recent call last): 3973s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 3973s return await fut 3973s ^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 3973s comm = await self.rpc.connect(saddr) 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1485, in connect 3973s return await self._connect(addr=addr, timeout=timeout) 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1429, in _connect 3973s comm = await connect( 3973s ^^^^^^^^^^^^^^ 3973s ...<4 lines>... 3973s ) 3973s ^ 3973s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3973s comm = await wait_for( 3973s ^^^^^^^^^^^^^^^ 3973s ...<2 lines>... 3973s ) 3973s ^ 3973s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 3973s return await fut 3973s ^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3973s stream = await self.client.connect( 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s ) 3973s ^ 3973s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3973s af, addr, stream = await connector.start(connect_timeout=timeout) 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s asyncio.exceptions.CancelledError 3973s 3973s The above exception was the direct cause of the following exception: 3973s 3973s Traceback (most recent call last): 3973s File "/usr/lib/python3/dist-packages/distributed/core.py", line 528, in start 3973s await wait_for(self.start_unsafe(), timeout=timeout) 3973s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1913, in wait_for 3973s async with asyncio.timeout(timeout): 3973s ~~~~~~~~~~~~~~~^^^^^^^^^ 3973s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3973s raise TimeoutError from exc_val 3973s TimeoutError 3973s 3973s The above exception was the direct cause of the following exception: 3973s 3973s Traceback (most recent call last): 3973s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 974, in _cluster_factory 3973s s, ws = await start_cluster( 3973s ^^^^^^^^^^^^^^^^^^^^ 3973s ...<9 lines>... 3973s ) 3973s ^ 3973s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 791, in start_cluster 3973s await asyncio.gather(*workers) 3973s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3973s return await awaitable 3973s ^^^^^^^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/core.py", line 531, in start 3973s raise asyncio.TimeoutError( 3973s f"{type(self).__name__} start timed out after {timeout}s." 3973s ) from exc 3973s TimeoutError: Nanny start timed out after 0s. 3973s 2025-02-21 00:28:41,476 - distributed.scheduler - INFO - State start 3973s 2025-02-21 00:28:41,484 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37723 3973s 2025-02-21 00:28:41,487 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:35107/status 3973s 2025-02-21 00:28:41,489 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3973s 2025-02-21 00:28:41,496 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:34469'. Reason: failure-to-start- 3973s 2025-02-21 00:28:41,496 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:34469' closed. 3973s 2025-02-21 00:28:41,497 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:45721'. Reason: failure-to-start- 3973s 2025-02-21 00:28:41,497 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:45721' closed. 3973s 2025-02-21 00:28:41,497 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37723': TLS handshake failed with remote 'tls://127.0.0.1:49568': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 3973s 2025-02-21 00:28:41,497 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37723': TLS handshake failed with remote 'tls://127.0.0.1:49580': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 3973s 2025-02-21 00:28:41,497 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 3973s Traceback (most recent call last): 3973s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 3973s return await fut 3973s ^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 3973s comm = await self.rpc.connect(saddr) 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1485, in connect 3973s return await self._connect(addr=addr, timeout=timeout) 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1429, in _connect 3973s comm = await connect( 3973s ^^^^^^^^^^^^^^ 3973s ...<4 lines>... 3973s ) 3973s ^ 3973s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3973s comm = await wait_for( 3973s ^^^^^^^^^^^^^^^ 3973s ...<2 lines>... 3973s ) 3973s ^ 3973s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 3973s return await fut 3973s ^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3973s stream = await self.client.connect( 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s ) 3973s ^ 3973s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3973s af, addr, stream = await connector.start(connect_timeout=timeout) 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s asyncio.exceptions.CancelledError 3973s 3973s The above exception was the direct cause of the following exception: 3973s 3973s Traceback (most recent call last): 3973s File "/usr/lib/python3/dist-packages/distributed/core.py", line 528, in start 3973s await wait_for(self.start_unsafe(), timeout=timeout) 3973s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1913, in wait_for 3973s async with asyncio.timeout(timeout): 3973s ~~~~~~~~~~~~~~~^^^^^^^^^ 3973s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3973s raise TimeoutError from exc_val 3973s TimeoutError 3973s 3973s The above exception was the direct cause of the following exception: 3973s 3973s Traceback (most recent call last): 3973s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 974, in _cluster_factory 3973s s, ws = await start_cluster( 3973s ^^^^^^^^^^^^^^^^^^^^ 3973s ...<9 lines>... 3973s ) 3973s ^ 3973s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 791, in start_cluster 3973s await asyncio.gather(*workers) 3973s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3973s return await awaitable 3973s ^^^^^^^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/core.py", line 531, in start 3973s raise asyncio.TimeoutError( 3973s f"{type(self).__name__} start timed out after {timeout}s." 3973s ) from exc 3973s TimeoutError: Nanny start timed out after 0s. 3973s 2025-02-21 00:28:42,502 - distributed.scheduler - INFO - State start 3973s 2025-02-21 00:28:42,508 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:46099 3973s 2025-02-21 00:28:42,510 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:44513/status 3973s 2025-02-21 00:28:42,511 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3973s 2025-02-21 00:28:42,518 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:32901'. Reason: failure-to-start- 3973s 2025-02-21 00:28:42,519 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:32901' closed. 3973s 2025-02-21 00:28:42,519 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:33251'. Reason: failure-to-start- 3973s 2025-02-21 00:28:42,519 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:33251' closed. 3973s 2025-02-21 00:28:42,519 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46099': TLS handshake failed with remote 'tls://127.0.0.1:57062': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 3973s 2025-02-21 00:28:42,519 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46099': TLS handshake failed with remote 'tls://127.0.0.1:57070': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 3973s 2025-02-21 00:28:42,520 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 3973s Traceback (most recent call last): 3973s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 3973s return await fut 3973s ^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 3973s comm = await self.rpc.connect(saddr) 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1485, in connect 3973s return await self._connect(addr=addr, timeout=timeout) 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1429, in _connect 3973s comm = await connect( 3973s ^^^^^^^^^^^^^^ 3973s ...<4 lines>... 3973s ) 3973s ^ 3973s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3973s comm = await wait_for( 3973s ^^^^^^^^^^^^^^^ 3973s ...<2 lines>... 3973s ) 3973s ^ 3973s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 3973s return await fut 3973s ^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3973s stream = await self.client.connect( 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s ) 3973s ^ 3973s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3973s af, addr, stream = await connector.start(connect_timeout=timeout) 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s asyncio.exceptions.CancelledError 3973s 3973s The above exception was the direct cause of the following exception: 3973s 3973s Traceback (most recent call last): 3973s File "/usr/lib/python3/dist-packages/distributed/core.py", line 528, in start 3973s await wait_for(self.start_unsafe(), timeout=timeout) 3973s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1913, in wait_for 3973s async with asyncio.timeout(timeout): 3973s ~~~~~~~~~~~~~~~^^^^^^^^^ 3973s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3973s raise TimeoutError from exc_val 3973s TimeoutError 3973s 3973s The above exception was the direct cause of the following exception: 3973s 3973s Traceback (most recent call last): 3973s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 974, in _cluster_factory 3973s s, ws = await start_cluster( 3973s ^^^^^^^^^^^^^^^^^^^^ 3973s ...<9 lines>... 3973s ) 3973s ^ 3973s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 791, in start_cluster 3973s await asyncio.gather(*workers) 3973s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3973s return await awaitable 3973s ^^^^^^^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/core.py", line 531, in start 3973s raise asyncio.TimeoutError( 3973s f"{type(self).__name__} start timed out after {timeout}s." 3973s ) from exc 3973s TimeoutError: Nanny start timed out after 0s. 3973s 2025-02-21 00:28:43,524 - distributed.scheduler - INFO - State start 3973s 2025-02-21 00:28:43,530 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37737 3973s 2025-02-21 00:28:43,533 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:38001/status 3973s 2025-02-21 00:28:43,534 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3973s 2025-02-21 00:28:43,541 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:44275'. Reason: failure-to-start- 3973s 2025-02-21 00:28:43,542 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:44275' closed. 3973s 2025-02-21 00:28:43,542 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:40413'. Reason: failure-to-start- 3973s 2025-02-21 00:28:43,542 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:40413' closed. 3973s 2025-02-21 00:28:43,543 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37737': TLS handshake failed with remote 'tls://127.0.0.1:48910': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 3973s 2025-02-21 00:28:43,543 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37737': TLS handshake failed with remote 'tls://127.0.0.1:48914': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 3973s 2025-02-21 00:28:43,543 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 3973s Traceback (most recent call last): 3973s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 3973s return await fut 3973s ^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 3973s comm = await self.rpc.connect(saddr) 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1485, in connect 3973s return await self._connect(addr=addr, timeout=timeout) 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1429, in _connect 3973s comm = await connect( 3973s ^^^^^^^^^^^^^^ 3973s ...<4 lines>... 3973s ) 3973s ^ 3973s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3973s comm = await wait_for( 3973s ^^^^^^^^^^^^^^^ 3973s ...<2 lines>... 3973s ) 3973s ^ 3973s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 3973s return await fut 3973s ^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3973s stream = await self.client.connect( 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s ) 3973s ^ 3973s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3973s af, addr, stream = await connector.start(connect_timeout=timeout) 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s asyncio.exceptions.CancelledError 3973s 3973s The above exception was the direct cause of the following exception: 3973s 3973s Traceback (most recent call last): 3973s File "/usr/lib/python3/dist-packages/distributed/core.py", line 528, in start 3973s await wait_for(self.start_unsafe(), timeout=timeout) 3973s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1913, in wait_for 3973s async with asyncio.timeout(timeout): 3973s ~~~~~~~~~~~~~~~^^^^^^^^^ 3973s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3973s raise TimeoutError from exc_val 3973s TimeoutError 3973s 3973s The above exception was the direct cause of the following exception: 3973s 3973s Traceback (most recent call last): 3973s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 974, in _cluster_factory 3973s s, ws = await start_cluster( 3973s ^^^^^^^^^^^^^^^^^^^^ 3973s ...<9 lines>... 3973s ) 3973s ^ 3973s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 791, in start_cluster 3973s await asyncio.gather(*workers) 3973s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3973s return await awaitable 3973s ^^^^^^^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/core.py", line 531, in start 3973s raise asyncio.TimeoutError( 3973s f"{type(self).__name__} start timed out after {timeout}s." 3973s ) from exc 3973s TimeoutError: Nanny start timed out after 0s. 3973s 2025-02-21 00:28:44,547 - distributed.scheduler - INFO - State start 3973s 2025-02-21 00:28:44,553 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:34473 3973s 2025-02-21 00:28:44,556 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:35057/status 3973s 2025-02-21 00:28:44,557 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3973s 2025-02-21 00:28:44,564 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:44931'. Reason: failure-to-start- 3973s 2025-02-21 00:28:44,565 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:44931' closed. 3973s 2025-02-21 00:28:44,565 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:43151'. Reason: failure-to-start- 3973s 2025-02-21 00:28:44,565 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:43151' closed. 3973s 2025-02-21 00:28:44,566 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34473': TLS handshake failed with remote 'tls://127.0.0.1:43486': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 3973s 2025-02-21 00:28:44,566 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34473': TLS handshake failed with remote 'tls://127.0.0.1:43502': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 3973s 2025-02-21 00:28:44,566 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 3973s Traceback (most recent call last): 3973s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 3973s return await fut 3973s ^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 3973s comm = await self.rpc.connect(saddr) 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1485, in connect 3973s return await self._connect(addr=addr, timeout=timeout) 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1429, in _connect 3973s comm = await connect( 3973s ^^^^^^^^^^^^^^ 3973s ...<4 lines>... 3973s ) 3973s ^ 3973s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3973s comm = await wait_for( 3973s ^^^^^^^^^^^^^^^ 3973s ...<2 lines>... 3973s ) 3973s ^ 3973s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 3973s return await fut 3973s ^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3973s stream = await self.client.connect( 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s ) 3973s ^ 3973s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3973s af, addr, stream = await connector.start(connect_timeout=timeout) 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s asyncio.exceptions.CancelledError 3973s 3973s The above exception was the direct cause of the following exception: 3973s 3973s Traceback (most recent call last): 3973s File "/usr/lib/python3/dist-packages/distributed/core.py", line 528, in start 3973s await wait_for(self.start_unsafe(), timeout=timeout) 3973s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1913, in wait_for 3973s async with asyncio.timeout(timeout): 3973s ~~~~~~~~~~~~~~~^^^^^^^^^ 3973s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3973s raise TimeoutError from exc_val 3973s TimeoutError 3973s 3973s The above exception was the direct cause of the following exception: 3973s 3973s Traceback (most recent call last): 3973s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 974, in _cluster_factory 3973s s, ws = await start_cluster( 3973s ^^^^^^^^^^^^^^^^^^^^ 3973s ...<9 lines>... 3973s ) 3973s ^ 3973s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 791, in start_cluster 3973s await asyncio.gather(*workers) 3973s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3973s return await awaitable 3973s ^^^^^^^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/core.py", line 531, in start 3973s raise asyncio.TimeoutError( 3973s f"{type(self).__name__} start timed out after {timeout}s." 3973s ) from exc 3973s TimeoutError: Nanny start timed out after 0s. 3973s 2025-02-21 00:28:45,570 - distributed.scheduler - INFO - State start 3973s 2025-02-21 00:28:45,576 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:35789 3973s 2025-02-21 00:28:45,579 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:43145/status 3973s 2025-02-21 00:28:45,580 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3973s 2025-02-21 00:28:45,587 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:34847'. Reason: failure-to-start- 3973s 2025-02-21 00:28:45,587 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:34847' closed. 3973s 2025-02-21 00:28:45,587 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:36557'. Reason: failure-to-start- 3973s 2025-02-21 00:28:45,588 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:36557' closed. 3973s 2025-02-21 00:28:45,588 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35789': TLS handshake failed with remote 'tls://127.0.0.1:58488': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 3973s 2025-02-21 00:28:45,588 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35789': TLS handshake failed with remote 'tls://127.0.0.1:58498': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 3973s 2025-02-21 00:28:45,588 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 3973s Traceback (most recent call last): 3973s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 3973s return await fut 3973s ^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 3973s comm = await self.rpc.connect(saddr) 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1485, in connect 3973s return await self._connect(addr=addr, timeout=timeout) 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1429, in _connect 3973s comm = await connect( 3973s ^^^^^^^^^^^^^^ 3973s ...<4 lines>... 3973s ) 3973s ^ 3973s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3973s comm = await wait_for( 3973s ^^^^^^^^^^^^^^^ 3973s ...<2 lines>... 3973s ) 3973s ^ 3973s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 3973s return await fut 3973s ^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3973s stream = await self.client.connect( 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s ) 3973s ^ 3973s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3973s af, addr, stream = await connector.start(connect_timeout=timeout) 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s asyncio.exceptions.CancelledError 3973s 3973s The above exception was the direct cause of the following exception: 3973s 3973s Traceback (most recent call last): 3973s File "/usr/lib/python3/dist-packages/distributed/core.py", line 528, in start 3973s await wait_for(self.start_unsafe(), timeout=timeout) 3973s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1913, in wait_for 3973s async with asyncio.timeout(timeout): 3973s ~~~~~~~~~~~~~~~^^^^^^^^^ 3973s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3973s raise TimeoutError from exc_val 3973s TimeoutError 3973s 3973s The above exception was the direct cause of the following exception: 3973s 3973s Traceback (most recent call last): 3973s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 974, in _cluster_factory 3973s s, ws = await start_cluster( 3973s ^^^^^^^^^^^^^^^^^^^^ 3973s ...<9 lines>... 3973s ) 3973s ^ 3973s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 791, in start_cluster 3973s await asyncio.gather(*workers) 3973s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3973s return await awaitable 3973s ^^^^^^^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/core.py", line 531, in start 3973s raise asyncio.TimeoutError( 3973s f"{type(self).__name__} start timed out after {timeout}s." 3973s ) from exc 3973s TimeoutError: Nanny start timed out after 0s. 3973s 2025-02-21 00:28:46,594 - distributed.scheduler - INFO - State start 3973s 2025-02-21 00:28:46,601 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:43833 3973s 2025-02-21 00:28:46,605 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:45219/status 3973s 2025-02-21 00:28:46,607 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3973s 2025-02-21 00:28:46,617 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:44261'. Reason: failure-to-start- 3973s 2025-02-21 00:28:46,617 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:44261' closed. 3973s 2025-02-21 00:28:46,618 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:36635'. Reason: failure-to-start- 3973s 2025-02-21 00:28:46,618 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:36635' closed. 3973s 2025-02-21 00:28:46,619 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43833': TLS handshake failed with remote 'tls://127.0.0.1:57358': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 3973s 2025-02-21 00:28:46,619 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43833': TLS handshake failed with remote 'tls://127.0.0.1:57362': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 3973s 2025-02-21 00:28:46,619 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 3973s Traceback (most recent call last): 3973s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 3973s return await fut 3973s ^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 3973s comm = await self.rpc.connect(saddr) 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1485, in connect 3973s return await self._connect(addr=addr, timeout=timeout) 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1429, in _connect 3973s comm = await connect( 3973s ^^^^^^^^^^^^^^ 3973s ...<4 lines>... 3973s ) 3973s ^ 3973s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3973s comm = await wait_for( 3973s ^^^^^^^^^^^^^^^ 3973s ...<2 lines>... 3973s ) 3973s ^ 3973s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 3973s return await fut 3973s ^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3973s stream = await self.client.connect( 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s ) 3973s ^ 3973s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3973s af, addr, stream = await connector.start(connect_timeout=timeout) 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s asyncio.exceptions.CancelledError 3973s 3973s The above exception was the direct cause of the following exception: 3973s 3973s Traceback (most recent call last): 3973s File "/usr/lib/python3/dist-packages/distributed/core.py", line 528, in start 3973s await wait_for(self.start_unsafe(), timeout=timeout) 3973s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1913, in wait_for 3973s async with asyncio.timeout(timeout): 3973s ~~~~~~~~~~~~~~~^^^^^^^^^ 3973s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3973s raise TimeoutError from exc_val 3973s TimeoutError 3973s 3973s The above exception was the direct cause of the following exception: 3973s 3973s Traceback (most recent call last): 3973s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 974, in _cluster_factory 3973s s, ws = await start_cluster( 3973s ^^^^^^^^^^^^^^^^^^^^ 3973s ...<9 lines>... 3973s ) 3973s ^ 3973s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 791, in start_cluster 3973s await asyncio.gather(*workers) 3973s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3973s return await awaitable 3973s ^^^^^^^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/core.py", line 531, in start 3973s raise asyncio.TimeoutError( 3973s f"{type(self).__name__} start timed out after {timeout}s." 3973s ) from exc 3973s TimeoutError: Nanny start timed out after 0s. 3973s 2025-02-21 00:28:47,625 - distributed.scheduler - INFO - State start 3973s 2025-02-21 00:28:47,631 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:34335 3973s 2025-02-21 00:28:47,634 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:35445/status 3973s 2025-02-21 00:28:47,635 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3973s 2025-02-21 00:28:47,644 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:45785'. Reason: failure-to-start- 3973s 2025-02-21 00:28:47,644 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:45785' closed. 3973s 2025-02-21 00:28:47,645 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:40661'. Reason: failure-to-start- 3973s 2025-02-21 00:28:47,645 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:40661' closed. 3973s 2025-02-21 00:28:47,645 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34335': TLS handshake failed with remote 'tls://127.0.0.1:53536': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 3973s 2025-02-21 00:28:47,645 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34335': TLS handshake failed with remote 'tls://127.0.0.1:53540': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 3973s 2025-02-21 00:28:47,645 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 3973s Traceback (most recent call last): 3973s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 3973s return await fut 3973s ^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 3973s comm = await self.rpc.connect(saddr) 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1485, in connect 3973s return await self._connect(addr=addr, timeout=timeout) 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1429, in _connect 3973s comm = await connect( 3973s ^^^^^^^^^^^^^^ 3973s ...<4 lines>... 3973s ) 3973s ^ 3973s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3973s comm = await wait_for( 3973s ^^^^^^^^^^^^^^^ 3973s ...<2 lines>... 3973s ) 3973s ^ 3973s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 3973s return await fut 3973s ^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3973s stream = await self.client.connect( 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s ) 3973s ^ 3973s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3973s af, addr, stream = await connector.start(connect_timeout=timeout) 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s asyncio.exceptions.CancelledError 3973s 3973s The above exception was the direct cause of the following exception: 3973s 3973s Traceback (most recent call last): 3973s File "/usr/lib/python3/dist-packages/distributed/core.py", line 528, in start 3973s await wait_for(self.start_unsafe(), timeout=timeout) 3973s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1913, in wait_for 3973s async with asyncio.timeout(timeout): 3973s ~~~~~~~~~~~~~~~^^^^^^^^^ 3973s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3973s raise TimeoutError from exc_val 3973s TimeoutError 3973s 3973s The above exception was the direct cause of the following exception: 3973s 3973s Traceback (most recent call last): 3973s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 974, in _cluster_factory 3973s s, ws = await start_cluster( 3973s ^^^^^^^^^^^^^^^^^^^^ 3973s ...<9 lines>... 3973s ) 3973s ^ 3973s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 791, in start_cluster 3973s await asyncio.gather(*workers) 3973s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3973s return await awaitable 3973s ^^^^^^^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/core.py", line 531, in start 3973s raise asyncio.TimeoutError( 3973s f"{type(self).__name__} start timed out after {timeout}s." 3973s ) from exc 3973s TimeoutError: Nanny start timed out after 0s. 3973s 2025-02-21 00:28:48,651 - distributed.scheduler - INFO - State start 3973s 2025-02-21 00:28:48,659 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:35027 3973s 2025-02-21 00:28:48,662 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:43221/status 3973s 2025-02-21 00:28:48,665 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3973s 2025-02-21 00:28:48,674 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:38687'. Reason: failure-to-start- 3973s 2025-02-21 00:28:48,674 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:38687' closed. 3973s 2025-02-21 00:28:48,675 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:45921'. Reason: failure-to-start- 3973s 2025-02-21 00:28:48,675 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:45921' closed. 3973s 2025-02-21 00:28:48,675 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35027': TLS handshake failed with remote 'tls://127.0.0.1:46854': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 3973s 2025-02-21 00:28:48,675 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35027': TLS handshake failed with remote 'tls://127.0.0.1:46868': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 3973s 2025-02-21 00:28:48,675 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 3973s Traceback (most recent call last): 3973s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 3973s return await fut 3973s ^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 3973s comm = await self.rpc.connect(saddr) 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1485, in connect 3973s return await self._connect(addr=addr, timeout=timeout) 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1429, in _connect 3973s comm = await connect( 3973s ^^^^^^^^^^^^^^ 3973s ...<4 lines>... 3973s ) 3973s ^ 3973s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3973s comm = await wait_for( 3973s ^^^^^^^^^^^^^^^ 3973s ...<2 lines>... 3973s ) 3973s ^ 3973s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 3973s return await fut 3973s ^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3973s stream = await self.client.connect( 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s ) 3973s ^ 3973s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3973s af, addr, stream = await connector.start(connect_timeout=timeout) 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s asyncio.exceptions.CancelledError 3973s 3973s The above exception was the direct cause of the following exception: 3973s 3973s Traceback (most recent call last): 3973s File "/usr/lib/python3/dist-packages/distributed/core.py", line 528, in start 3973s await wait_for(self.start_unsafe(), timeout=timeout) 3973s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1913, in wait_for 3973s async with asyncio.timeout(timeout): 3973s ~~~~~~~~~~~~~~~^^^^^^^^^ 3973s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3973s raise TimeoutError from exc_val 3973s TimeoutError 3973s 3973s The above exception was the direct cause of the following exception: 3973s 3973s Traceback (most recent call last): 3973s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 974, in _cluster_factory 3973s s, ws = await start_cluster( 3973s ^^^^^^^^^^^^^^^^^^^^ 3973s ...<9 lines>... 3973s ) 3973s ^ 3973s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 791, in start_cluster 3973s await asyncio.gather(*workers) 3973s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3973s return await awaitable 3973s ^^^^^^^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/core.py", line 531, in start 3973s raise asyncio.TimeoutError( 3973s f"{type(self).__name__} start timed out after {timeout}s." 3973s ) from exc 3973s TimeoutError: Nanny start timed out after 0s. 3973s 2025-02-21 00:28:49,681 - distributed.scheduler - INFO - State start 3973s 2025-02-21 00:28:49,690 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:40979 3973s 2025-02-21 00:28:49,693 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:38775/status 3973s 2025-02-21 00:28:49,695 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3973s 2025-02-21 00:28:49,705 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:37811'. Reason: failure-to-start- 3973s 2025-02-21 00:28:49,706 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:37811' closed. 3973s 2025-02-21 00:28:49,706 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:39189'. Reason: failure-to-start- 3973s 2025-02-21 00:28:49,706 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:39189' closed. 3973s 2025-02-21 00:28:49,707 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40979': TLS handshake failed with remote 'tls://127.0.0.1:41884': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 3973s 2025-02-21 00:28:49,707 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40979': TLS handshake failed with remote 'tls://127.0.0.1:41896': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 3973s 2025-02-21 00:28:49,707 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 3973s Traceback (most recent call last): 3973s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 3973s return await fut 3973s ^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 3973s comm = await self.rpc.connect(saddr) 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1485, in connect 3973s return await self._connect(addr=addr, timeout=timeout) 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1429, in _connect 3973s comm = await connect( 3973s ^^^^^^^^^^^^^^ 3973s ...<4 lines>... 3973s ) 3973s ^ 3973s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3973s comm = await wait_for( 3973s ^^^^^^^^^^^^^^^ 3973s ...<2 lines>... 3973s ) 3973s ^ 3973s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 3973s return await fut 3973s ^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3973s stream = await self.client.connect( 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s ) 3973s ^ 3973s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3973s af, addr, stream = await connector.start(connect_timeout=timeout) 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s asyncio.exceptions.CancelledError 3973s 3973s The above exception was the direct cause of the following exception: 3973s 3973s Traceback (most recent call last): 3973s File "/usr/lib/python3/dist-packages/distributed/core.py", line 528, in start 3973s await wait_for(self.start_unsafe(), timeout=timeout) 3973s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1913, in wait_for 3973s async with asyncio.timeout(timeout): 3973s ~~~~~~~~~~~~~~~^^^^^^^^^ 3973s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3973s raise TimeoutError from exc_val 3973s TimeoutError 3973s 3973s The above exception was the direct cause of the following exception: 3973s 3973s Traceback (most recent call last): 3973s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 974, in _cluster_factory 3973s s, ws = await start_cluster( 3973s ^^^^^^^^^^^^^^^^^^^^ 3973s ...<9 lines>... 3973s ) 3973s ^ 3973s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 791, in start_cluster 3973s await asyncio.gather(*workers) 3973s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3973s return await awaitable 3973s ^^^^^^^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/core.py", line 531, in start 3973s raise asyncio.TimeoutError( 3973s f"{type(self).__name__} start timed out after {timeout}s." 3973s ) from exc 3973s TimeoutError: Nanny start timed out after 0s. 3973s 2025-02-21 00:28:50,712 - distributed.scheduler - INFO - State start 3973s 2025-02-21 00:28:50,718 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:34443 3973s 2025-02-21 00:28:50,722 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:39849/status 3973s 2025-02-21 00:28:50,724 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3973s 2025-02-21 00:28:50,735 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:43157'. Reason: failure-to-start- 3973s 2025-02-21 00:28:50,735 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:43157' closed. 3973s 2025-02-21 00:28:50,735 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:44563'. Reason: failure-to-start- 3973s 2025-02-21 00:28:50,736 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:44563' closed. 3973s 2025-02-21 00:28:50,736 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34443': TLS handshake failed with remote 'tls://127.0.0.1:45264': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 3973s 2025-02-21 00:28:50,736 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34443': TLS handshake failed with remote 'tls://127.0.0.1:45278': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 3973s 2025-02-21 00:28:50,736 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 3973s Traceback (most recent call last): 3973s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 3973s return await fut 3973s ^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 3973s comm = await self.rpc.connect(saddr) 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1485, in connect 3973s return await self._connect(addr=addr, timeout=timeout) 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1429, in _connect 3973s comm = await connect( 3973s ^^^^^^^^^^^^^^ 3973s ...<4 lines>... 3973s ) 3973s ^ 3973s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3973s comm = await wait_for( 3973s ^^^^^^^^^^^^^^^ 3973s ...<2 lines>... 3973s ) 3973s ^ 3973s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 3973s return await fut 3973s ^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3973s stream = await self.client.connect( 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s ) 3973s ^ 3973s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3973s af, addr, stream = await connector.start(connect_timeout=timeout) 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s asyncio.exceptions.CancelledError 3973s 3973s The above exception was the direct cause of the following exception: 3973s 3973s Traceback (most recent call last): 3973s File "/usr/lib/python3/dist-packages/distributed/core.py", line 528, in start 3973s await wait_for(self.start_unsafe(), timeout=timeout) 3973s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1913, in wait_for 3973s async with asyncio.timeout(timeout): 3973s ~~~~~~~~~~~~~~~^^^^^^^^^ 3973s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3973s raise TimeoutError from exc_val 3973s TimeoutError 3973s 3973s The above exception was the direct cause of the following exception: 3973s 3973s Traceback (most recent call last): 3973s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 974, in _cluster_factory 3973s s, ws = await start_cluster( 3973s ^^^^^^^^^^^^^^^^^^^^ 3973s ...<9 lines>... 3973s ) 3973s ^ 3973s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 791, in start_cluster 3973s await asyncio.gather(*workers) 3973s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3973s return await awaitable 3973s ^^^^^^^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/core.py", line 531, in start 3973s raise asyncio.TimeoutError( 3973s f"{type(self).__name__} start timed out after {timeout}s." 3973s ) from exc 3973s TimeoutError: Nanny start timed out after 0s. 3973s 2025-02-21 00:28:51,741 - distributed.scheduler - INFO - State start 3973s 2025-02-21 00:28:51,748 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:39513 3973s 2025-02-21 00:28:51,750 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:43469/status 3973s 2025-02-21 00:28:51,752 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3973s 2025-02-21 00:28:51,762 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:45453'. Reason: failure-to-start- 3973s 2025-02-21 00:28:51,763 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:45453' closed. 3973s 2025-02-21 00:28:51,763 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:33641'. Reason: failure-to-start- 3973s 2025-02-21 00:28:51,763 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:33641' closed. 3973s 2025-02-21 00:28:51,764 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39513': TLS handshake failed with remote 'tls://127.0.0.1:49412': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 3973s 2025-02-21 00:28:51,764 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39513': TLS handshake failed with remote 'tls://127.0.0.1:49418': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 3973s 2025-02-21 00:28:51,764 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 3973s Traceback (most recent call last): 3973s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 3973s return await fut 3973s ^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 3973s comm = await self.rpc.connect(saddr) 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1485, in connect 3973s return await self._connect(addr=addr, timeout=timeout) 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1429, in _connect 3973s comm = await connect( 3973s ^^^^^^^^^^^^^^ 3973s ...<4 lines>... 3973s ) 3973s ^ 3973s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3973s comm = await wait_for( 3973s ^^^^^^^^^^^^^^^ 3973s ...<2 lines>... 3973s ) 3973s ^ 3973s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 3973s return await fut 3973s ^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3973s stream = await self.client.connect( 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s ) 3973s ^ 3973s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3973s af, addr, stream = await connector.start(connect_timeout=timeout) 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s asyncio.exceptions.CancelledError 3973s 3973s The above exception was the direct cause of the following exception: 3973s 3973s Traceback (most recent call last): 3973s File "/usr/lib/python3/dist-packages/distributed/core.py", line 528, in start 3973s await wait_for(self.start_unsafe(), timeout=timeout) 3973s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1913, in wait_for 3973s async with asyncio.timeout(timeout): 3973s ~~~~~~~~~~~~~~~^^^^^^^^^ 3973s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3973s raise TimeoutError from exc_val 3973s TimeoutError 3973s 3973s The above exception was the direct cause of the following exception: 3973s 3973s Traceback (most recent call last): 3973s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 974, in _cluster_factory 3973s s, ws = await start_cluster( 3973s ^^^^^^^^^^^^^^^^^^^^ 3973s ...<9 lines>... 3973s ) 3973s ^ 3973s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 791, in start_cluster 3973s await asyncio.gather(*workers) 3973s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3973s return await awaitable 3973s ^^^^^^^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/core.py", line 531, in start 3973s raise asyncio.TimeoutError( 3973s f"{type(self).__name__} start timed out after {timeout}s." 3973s ) from exc 3973s TimeoutError: Nanny start timed out after 0s. 3973s 2025-02-21 00:28:52,769 - distributed.scheduler - INFO - State start 3973s 2025-02-21 00:28:52,775 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:42863 3973s 2025-02-21 00:28:52,778 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:46185/status 3973s 2025-02-21 00:28:52,780 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3973s 2025-02-21 00:28:52,788 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:38321'. Reason: failure-to-start- 3973s 2025-02-21 00:28:52,789 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:38321' closed. 3973s 2025-02-21 00:28:52,789 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:38865'. Reason: failure-to-start- 3973s 2025-02-21 00:28:52,789 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:38865' closed. 3973s 2025-02-21 00:28:52,790 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42863': TLS handshake failed with remote 'tls://127.0.0.1:60066': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 3973s 2025-02-21 00:28:52,790 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42863': TLS handshake failed with remote 'tls://127.0.0.1:60080': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 3973s 2025-02-21 00:28:52,790 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 3973s Traceback (most recent call last): 3973s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 3973s return await fut 3973s ^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 3973s comm = await self.rpc.connect(saddr) 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1485, in connect 3973s return await self._connect(addr=addr, timeout=timeout) 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1429, in _connect 3973s comm = await connect( 3973s ^^^^^^^^^^^^^^ 3973s ...<4 lines>... 3973s ) 3973s ^ 3973s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3973s comm = await wait_for( 3973s ^^^^^^^^^^^^^^^ 3973s ...<2 lines>... 3973s ) 3973s ^ 3973s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 3973s return await fut 3973s ^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3973s stream = await self.client.connect( 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s ) 3973s ^ 3973s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3973s af, addr, stream = await connector.start(connect_timeout=timeout) 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s asyncio.exceptions.CancelledError 3973s 3973s The above exception was the direct cause of the following exception: 3973s 3973s Traceback (most recent call last): 3973s File "/usr/lib/python3/dist-packages/distributed/core.py", line 528, in start 3973s await wait_for(self.start_unsafe(), timeout=timeout) 3973s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1913, in wait_for 3973s async with asyncio.timeout(timeout): 3973s ~~~~~~~~~~~~~~~^^^^^^^^^ 3973s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3973s raise TimeoutError from exc_val 3973s TimeoutError 3973s 3973s The above exception was the direct cause of the following exception: 3973s 3973s Traceback (most recent call last): 3973s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 974, in _cluster_factory 3973s s, ws = await start_cluster( 3973s ^^^^^^^^^^^^^^^^^^^^ 3973s ...<9 lines>... 3973s ) 3973s ^ 3973s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 791, in start_cluster 3973s await asyncio.gather(*workers) 3973s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3973s return await awaitable 3973s ^^^^^^^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/core.py", line 531, in start 3973s raise asyncio.TimeoutError( 3973s f"{type(self).__name__} start timed out after {timeout}s." 3973s ) from exc 3973s TimeoutError: Nanny start timed out after 0s. 3973s 2025-02-21 00:28:53,794 - distributed.scheduler - INFO - State start 3973s 2025-02-21 00:28:53,800 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:38967 3973s 2025-02-21 00:28:53,803 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:36171/status 3973s 2025-02-21 00:28:53,805 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3973s 2025-02-21 00:28:53,813 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:33653'. Reason: failure-to-start- 3973s 2025-02-21 00:28:53,814 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:33653' closed. 3973s 2025-02-21 00:28:53,814 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:45449'. Reason: failure-to-start- 3973s 2025-02-21 00:28:53,814 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:45449' closed. 3973s 2025-02-21 00:28:53,815 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38967': TLS handshake failed with remote 'tls://127.0.0.1:55278': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 3973s 2025-02-21 00:28:53,815 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38967': TLS handshake failed with remote 'tls://127.0.0.1:55292': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 3973s 2025-02-21 00:28:53,815 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 3973s Traceback (most recent call last): 3973s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 3973s return await fut 3973s ^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 3973s comm = await self.rpc.connect(saddr) 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1485, in connect 3973s return await self._connect(addr=addr, timeout=timeout) 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1429, in _connect 3973s comm = await connect( 3973s ^^^^^^^^^^^^^^ 3973s ...<4 lines>... 3973s ) 3973s ^ 3973s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3973s comm = await wait_for( 3973s ^^^^^^^^^^^^^^^ 3973s ...<2 lines>... 3973s ) 3973s ^ 3973s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 3973s return await fut 3973s ^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3973s stream = await self.client.connect( 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s ) 3973s ^ 3973s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3973s af, addr, stream = await connector.start(connect_timeout=timeout) 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s asyncio.exceptions.CancelledError 3973s 3973s The above exception was the direct cause of the following exception: 3973s 3973s Traceback (most recent call last): 3973s File "/usr/lib/python3/dist-packages/distributed/core.py", line 528, in start 3973s await wait_for(self.start_unsafe(), timeout=timeout) 3973s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1913, in wait_for 3973s async with asyncio.timeout(timeout): 3973s ~~~~~~~~~~~~~~~^^^^^^^^^ 3973s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3973s raise TimeoutError from exc_val 3973s TimeoutError 3973s 3973s The above exception was the direct cause of the following exception: 3973s 3973s Traceback (most recent call last): 3973s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 974, in _cluster_factory 3973s s, ws = await start_cluster( 3973s ^^^^^^^^^^^^^^^^^^^^ 3973s ...<9 lines>... 3973s ) 3973s ^ 3973s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 791, in start_cluster 3973s await asyncio.gather(*workers) 3973s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3973s return await awaitable 3973s ^^^^^^^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/core.py", line 531, in start 3973s raise asyncio.TimeoutError( 3973s f"{type(self).__name__} start timed out after {timeout}s." 3973s ) from exc 3973s TimeoutError: Nanny start timed out after 0s. 3973s 2025-02-21 00:28:54,820 - distributed.scheduler - INFO - State start 3973s 2025-02-21 00:28:54,829 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:46229 3973s 2025-02-21 00:28:54,832 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:41931/status 3973s 2025-02-21 00:28:54,835 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3973s 2025-02-21 00:28:54,844 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:43493'. Reason: failure-to-start- 3973s 2025-02-21 00:28:54,844 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:43493' closed. 3973s 2025-02-21 00:28:54,845 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:35433'. Reason: failure-to-start- 3973s 2025-02-21 00:28:54,845 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:35433' closed. 3973s 2025-02-21 00:28:54,845 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46229': TLS handshake failed with remote 'tls://127.0.0.1:46230': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 3973s 2025-02-21 00:28:54,845 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46229': TLS handshake failed with remote 'tls://127.0.0.1:46234': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 3973s 2025-02-21 00:28:54,845 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 3973s Traceback (most recent call last): 3973s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 3973s return await fut 3973s ^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 3973s comm = await self.rpc.connect(saddr) 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1485, in connect 3973s return await self._connect(addr=addr, timeout=timeout) 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1429, in _connect 3973s comm = await connect( 3973s ^^^^^^^^^^^^^^ 3973s ...<4 lines>... 3973s ) 3973s ^ 3973s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3973s comm = await wait_for( 3973s ^^^^^^^^^^^^^^^ 3973s ...<2 lines>... 3973s ) 3973s ^ 3973s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 3973s return await fut 3973s ^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3973s stream = await self.client.connect( 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s ) 3973s ^ 3973s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3973s af, addr, stream = await connector.start(connect_timeout=timeout) 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s asyncio.exceptions.CancelledError 3973s 3973s The above exception was the direct cause of the following exception: 3973s 3973s Traceback (most recent call last): 3973s File "/usr/lib/python3/dist-packages/distributed/core.py", line 528, in start 3973s await wait_for(self.start_unsafe(), timeout=timeout) 3973s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1913, in wait_for 3973s async with asyncio.timeout(timeout): 3973s ~~~~~~~~~~~~~~~^^^^^^^^^ 3973s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3973s raise TimeoutError from exc_val 3973s TimeoutError 3973s 3973s The above exception was the direct cause of the following exception: 3973s 3973s Traceback (most recent call last): 3973s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 974, in _cluster_factory 3973s s, ws = await start_cluster( 3973s ^^^^^^^^^^^^^^^^^^^^ 3973s ...<9 lines>... 3973s ) 3973s ^ 3973s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 791, in start_cluster 3973s await asyncio.gather(*workers) 3973s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3973s return await awaitable 3973s ^^^^^^^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/core.py", line 531, in start 3973s raise asyncio.TimeoutError( 3973s f"{type(self).__name__} start timed out after {timeout}s." 3973s ) from exc 3973s TimeoutError: Nanny start timed out after 0s. 3973s 2025-02-21 00:28:55,850 - distributed.scheduler - INFO - State start 3973s 2025-02-21 00:28:55,856 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:35067 3973s 2025-02-21 00:28:55,859 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:40715/status 3973s 2025-02-21 00:28:55,860 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3973s 2025-02-21 00:28:55,868 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:44103'. Reason: failure-to-start- 3973s 2025-02-21 00:28:55,868 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:44103' closed. 3973s 2025-02-21 00:28:55,869 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:37027'. Reason: failure-to-start- 3973s 2025-02-21 00:28:55,869 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:37027' closed. 3973s 2025-02-21 00:28:55,869 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35067': TLS handshake failed with remote 'tls://127.0.0.1:60632': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 3973s 2025-02-21 00:28:55,869 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35067': TLS handshake failed with remote 'tls://127.0.0.1:60640': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 3973s 2025-02-21 00:28:55,870 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 3973s Traceback (most recent call last): 3973s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 3973s return await fut 3973s ^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 3973s comm = await self.rpc.connect(saddr) 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1485, in connect 3973s return await self._connect(addr=addr, timeout=timeout) 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1429, in _connect 3973s comm = await connect( 3973s ^^^^^^^^^^^^^^ 3973s ...<4 lines>... 3973s ) 3973s ^ 3973s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3973s comm = await wait_for( 3973s ^^^^^^^^^^^^^^^ 3973s ...<2 lines>... 3973s ) 3973s ^ 3973s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 3973s return await fut 3973s ^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3973s stream = await self.client.connect( 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s ) 3973s ^ 3973s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3973s af, addr, stream = await connector.start(connect_timeout=timeout) 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s asyncio.exceptions.CancelledError 3973s 3973s The above exception was the direct cause of the following exception: 3973s 3973s Traceback (most recent call last): 3973s File "/usr/lib/python3/dist-packages/distributed/core.py", line 528, in start 3973s await wait_for(self.start_unsafe(), timeout=timeout) 3973s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1913, in wait_for 3973s async with asyncio.timeout(timeout): 3973s ~~~~~~~~~~~~~~~^^^^^^^^^ 3973s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3973s raise TimeoutError from exc_val 3973s TimeoutError 3973s 3973s The above exception was the direct cause of the following exception: 3973s 3973s Traceback (most recent call last): 3973s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 974, in _cluster_factory 3973s s, ws = await start_cluster( 3973s ^^^^^^^^^^^^^^^^^^^^ 3973s ...<9 lines>... 3973s ) 3973s ^ 3973s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 791, in start_cluster 3973s await asyncio.gather(*workers) 3973s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3973s return await awaitable 3973s ^^^^^^^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/core.py", line 531, in start 3973s raise asyncio.TimeoutError( 3973s f"{type(self).__name__} start timed out after {timeout}s." 3973s ) from exc 3973s TimeoutError: Nanny start timed out after 0s. 3973s 2025-02-21 00:28:56,874 - distributed.scheduler - INFO - State start 3973s 2025-02-21 00:28:56,881 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44157 3973s 2025-02-21 00:28:56,884 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:36885/status 3973s 2025-02-21 00:28:56,886 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3973s 2025-02-21 00:28:56,893 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:45087'. Reason: failure-to-start- 3973s 2025-02-21 00:28:56,893 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:45087' closed. 3973s 2025-02-21 00:28:56,894 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:46725'. Reason: failure-to-start- 3973s 2025-02-21 00:28:56,894 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:46725' closed. 3973s 2025-02-21 00:28:56,894 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44157': TLS handshake failed with remote 'tls://127.0.0.1:34622': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 3973s 2025-02-21 00:28:56,894 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44157': TLS handshake failed with remote 'tls://127.0.0.1:34624': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 3973s 2025-02-21 00:28:56,894 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 3973s Traceback (most recent call last): 3973s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 3973s return await fut 3973s ^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 3973s comm = await self.rpc.connect(saddr) 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1485, in connect 3973s return await self._connect(addr=addr, timeout=timeout) 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1429, in _connect 3973s comm = await connect( 3973s ^^^^^^^^^^^^^^ 3973s ...<4 lines>... 3973s ) 3973s ^ 3973s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3973s comm = await wait_for( 3973s ^^^^^^^^^^^^^^^ 3973s ...<2 lines>... 3973s ) 3973s ^ 3973s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 3973s return await fut 3973s ^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3973s stream = await self.client.connect( 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s ) 3973s ^ 3973s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3973s af, addr, stream = await connector.start(connect_timeout=timeout) 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s asyncio.exceptions.CancelledError 3973s 3973s The above exception was the direct cause of the following exception: 3973s 3973s Traceback (most recent call last): 3973s File "/usr/lib/python3/dist-packages/distributed/core.py", line 528, in start 3973s await wait_for(self.start_unsafe(), timeout=timeout) 3973s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1913, in wait_for 3973s async with asyncio.timeout(timeout): 3973s ~~~~~~~~~~~~~~~^^^^^^^^^ 3973s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3973s raise TimeoutError from exc_val 3973s TimeoutError 3973s 3973s The above exception was the direct cause of the following exception: 3973s 3973s Traceback (most recent call last): 3973s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 974, in _cluster_factory 3973s s, ws = await start_cluster( 3973s ^^^^^^^^^^^^^^^^^^^^ 3973s ...<9 lines>... 3973s ) 3973s ^ 3973s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 791, in start_cluster 3973s await asyncio.gather(*workers) 3973s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3973s return await awaitable 3973s ^^^^^^^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/core.py", line 531, in start 3973s raise asyncio.TimeoutError( 3973s f"{type(self).__name__} start timed out after {timeout}s." 3973s ) from exc 3973s TimeoutError: Nanny start timed out after 0s. 3973s 2025-02-21 00:28:57,899 - distributed.scheduler - INFO - State start 3973s 2025-02-21 00:28:57,905 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:39337 3973s 2025-02-21 00:28:57,908 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:45549/status 3973s 2025-02-21 00:28:57,910 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3973s 2025-02-21 00:28:57,919 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:43583'. Reason: failure-to-start- 3973s 2025-02-21 00:28:57,919 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:43583' closed. 3973s 2025-02-21 00:28:57,920 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:37635'. Reason: failure-to-start- 3973s 2025-02-21 00:28:57,920 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:37635' closed. 3973s 2025-02-21 00:28:57,920 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39337': TLS handshake failed with remote 'tls://127.0.0.1:58200': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 3973s 2025-02-21 00:28:57,920 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39337': TLS handshake failed with remote 'tls://127.0.0.1:58202': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 3973s 2025-02-21 00:28:57,921 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 3973s Traceback (most recent call last): 3973s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 3973s return await fut 3973s ^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 3973s comm = await self.rpc.connect(saddr) 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1485, in connect 3973s return await self._connect(addr=addr, timeout=timeout) 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1429, in _connect 3973s comm = await connect( 3973s ^^^^^^^^^^^^^^ 3973s ...<4 lines>... 3973s ) 3973s ^ 3973s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3973s comm = await wait_for( 3973s ^^^^^^^^^^^^^^^ 3973s ...<2 lines>... 3973s ) 3973s ^ 3973s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 3973s return await fut 3973s ^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3973s stream = await self.client.connect( 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s ) 3973s ^ 3973s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3973s af, addr, stream = await connector.start(connect_timeout=timeout) 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s asyncio.exceptions.CancelledError 3973s 3973s The above exception was the direct cause of the following exception: 3973s 3973s Traceback (most recent call last): 3973s File "/usr/lib/python3/dist-packages/distributed/core.py", line 528, in start 3973s await wait_for(self.start_unsafe(), timeout=timeout) 3973s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1913, in wait_for 3973s async with asyncio.timeout(timeout): 3973s ~~~~~~~~~~~~~~~^^^^^^^^^ 3973s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3973s raise TimeoutError from exc_val 3973s TimeoutError 3973s 3973s The above exception was the direct cause of the following exception: 3973s 3973s Traceback (most recent call last): 3973s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 974, in _cluster_factory 3973s s, ws = await start_cluster( 3973s ^^^^^^^^^^^^^^^^^^^^ 3973s ...<9 lines>... 3973s ) 3973s ^ 3973s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 791, in start_cluster 3973s await asyncio.gather(*workers) 3973s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3973s return await awaitable 3973s ^^^^^^^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/core.py", line 531, in start 3973s raise asyncio.TimeoutError( 3973s f"{type(self).__name__} start timed out after {timeout}s." 3973s ) from exc 3973s TimeoutError: Nanny start timed out after 0s. 3973s 2025-02-21 00:28:58,927 - distributed.scheduler - INFO - State start 3973s 2025-02-21 00:28:58,935 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:33213 3973s 2025-02-21 00:28:58,939 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:46065/status 3973s 2025-02-21 00:28:58,942 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3973s 2025-02-21 00:28:58,954 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:38543'. Reason: failure-to-start- 3973s 2025-02-21 00:28:58,954 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:38543' closed. 3973s 2025-02-21 00:28:58,955 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:35777'. Reason: failure-to-start- 3973s 2025-02-21 00:28:58,955 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:35777' closed. 3973s 2025-02-21 00:28:58,956 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33213': TLS handshake failed with remote 'tls://127.0.0.1:43980': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 3973s 2025-02-21 00:28:58,956 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33213': TLS handshake failed with remote 'tls://127.0.0.1:43988': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 3973s 2025-02-21 00:28:58,956 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 3973s Traceback (most recent call last): 3973s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 3973s return await fut 3973s ^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 3973s comm = await self.rpc.connect(saddr) 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1485, in connect 3973s return await self._connect(addr=addr, timeout=timeout) 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1429, in _connect 3973s comm = await connect( 3973s ^^^^^^^^^^^^^^ 3973s ...<4 lines>... 3973s ) 3973s ^ 3973s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3973s comm = await wait_for( 3973s ^^^^^^^^^^^^^^^ 3973s ...<2 lines>... 3973s ) 3973s ^ 3973s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 3973s return await fut 3973s ^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3973s stream = await self.client.connect( 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s ) 3973s ^ 3973s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3973s af, addr, stream = await connector.start(connect_timeout=timeout) 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s asyncio.exceptions.CancelledError 3973s 3973s The above exception was the direct cause of the following exception: 3973s 3973s Traceback (most recent call last): 3973s File "/usr/lib/python3/dist-packages/distributed/core.py", line 528, in start 3973s await wait_for(self.start_unsafe(), timeout=timeout) 3973s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1913, in wait_for 3973s async with asyncio.timeout(timeout): 3973s ~~~~~~~~~~~~~~~^^^^^^^^^ 3973s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3973s raise TimeoutError from exc_val 3973s TimeoutError 3973s 3973s The above exception was the direct cause of the following exception: 3973s 3973s Traceback (most recent call last): 3973s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 974, in _cluster_factory 3973s s, ws = await start_cluster( 3973s ^^^^^^^^^^^^^^^^^^^^ 3973s ...<9 lines>... 3973s ) 3973s ^ 3973s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 791, in start_cluster 3973s await asyncio.gather(*workers) 3973s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3973s return await awaitable 3973s ^^^^^^^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/core.py", line 531, in start 3973s raise asyncio.TimeoutError( 3973s f"{type(self).__name__} start timed out after {timeout}s." 3973s ) from exc 3973s TimeoutError: Nanny start timed out after 0s. 3973s 2025-02-21 00:28:59,961 - distributed.scheduler - INFO - State start 3973s 2025-02-21 00:28:59,967 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:45421 3973s 2025-02-21 00:28:59,970 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:42137/status 3973s 2025-02-21 00:28:59,972 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3973s 2025-02-21 00:28:59,981 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:35579'. Reason: failure-to-start- 3973s 2025-02-21 00:28:59,981 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:35579' closed. 3973s 2025-02-21 00:28:59,981 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:38377'. Reason: failure-to-start- 3973s 2025-02-21 00:28:59,982 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:38377' closed. 3973s 2025-02-21 00:28:59,982 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45421': TLS handshake failed with remote 'tls://127.0.0.1:48892': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 3973s 2025-02-21 00:28:59,982 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45421': TLS handshake failed with remote 'tls://127.0.0.1:48902': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 3973s 2025-02-21 00:28:59,982 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 3973s Traceback (most recent call last): 3973s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 3973s return await fut 3973s ^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 3973s comm = await self.rpc.connect(saddr) 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1485, in connect 3973s return await self._connect(addr=addr, timeout=timeout) 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1429, in _connect 3973s comm = await connect( 3973s ^^^^^^^^^^^^^^ 3973s ...<4 lines>... 3973s ) 3973s ^ 3973s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3973s comm = await wait_for( 3973s ^^^^^^^^^^^^^^^ 3973s ...<2 lines>... 3973s ) 3973s ^ 3973s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 3973s return await fut 3973s ^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3973s stream = await self.client.connect( 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s ) 3973s ^ 3973s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3973s af, addr, stream = await connector.start(connect_timeout=timeout) 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s asyncio.exceptions.CancelledError 3973s 3973s The above exception was the direct cause of the following exception: 3973s 3973s Traceback (most recent call last): 3973s File "/usr/lib/python3/dist-packages/distributed/core.py", line 528, in start 3973s await wait_for(self.start_unsafe(), timeout=timeout) 3973s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1913, in wait_for 3973s async with asyncio.timeout(timeout): 3973s ~~~~~~~~~~~~~~~^^^^^^^^^ 3973s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3973s raise TimeoutError from exc_val 3973s TimeoutError 3973s 3973s The above exception was the direct cause of the following exception: 3973s 3973s Traceback (most recent call last): 3973s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 974, in _cluster_factory 3973s s, ws = await start_cluster( 3973s ^^^^^^^^^^^^^^^^^^^^ 3973s ...<9 lines>... 3973s ) 3973s ^ 3973s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 791, in start_cluster 3973s await asyncio.gather(*workers) 3973s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3973s return await awaitable 3973s ^^^^^^^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/core.py", line 531, in start 3973s raise asyncio.TimeoutError( 3973s f"{type(self).__name__} start timed out after {timeout}s." 3973s ) from exc 3973s TimeoutError: Nanny start timed out after 0s. 3973s 2025-02-21 00:29:00,987 - distributed.scheduler - INFO - State start 3973s 2025-02-21 00:29:00,993 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:43757 3973s 2025-02-21 00:29:00,996 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:40025/status 3973s 2025-02-21 00:29:00,997 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3973s 2025-02-21 00:29:01,006 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:45231'. Reason: failure-to-start- 3973s 2025-02-21 00:29:01,007 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:45231' closed. 3973s 2025-02-21 00:29:01,007 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:32835'. Reason: failure-to-start- 3973s 2025-02-21 00:29:01,007 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:32835' closed. 3973s 2025-02-21 00:29:01,008 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43757': TLS handshake failed with remote 'tls://127.0.0.1:41912': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 3973s 2025-02-21 00:29:01,008 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43757': TLS handshake failed with remote 'tls://127.0.0.1:41924': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 3973s 2025-02-21 00:29:01,008 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 3973s Traceback (most recent call last): 3973s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 3973s return await fut 3973s ^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 3973s comm = await self.rpc.connect(saddr) 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1485, in connect 3973s return await self._connect(addr=addr, timeout=timeout) 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1429, in _connect 3973s comm = await connect( 3973s ^^^^^^^^^^^^^^ 3973s ...<4 lines>... 3973s ) 3973s ^ 3973s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3973s comm = await wait_for( 3973s ^^^^^^^^^^^^^^^ 3973s ...<2 lines>... 3973s ) 3973s ^ 3973s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 3973s return await fut 3973s ^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3973s stream = await self.client.connect( 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s ) 3973s ^ 3973s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3973s af, addr, stream = await connector.start(connect_timeout=timeout) 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s asyncio.exceptions.CancelledError 3973s 3973s The above exception was the direct cause of the following exception: 3973s 3973s Traceback (most recent call last): 3973s File "/usr/lib/python3/dist-packages/distributed/core.py", line 528, in start 3973s await wait_for(self.start_unsafe(), timeout=timeout) 3973s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1913, in wait_for 3973s async with asyncio.timeout(timeout): 3973s ~~~~~~~~~~~~~~~^^^^^^^^^ 3973s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3973s raise TimeoutError from exc_val 3973s TimeoutError 3973s 3973s The above exception was the direct cause of the following exception: 3973s 3973s Traceback (most recent call last): 3973s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 974, in _cluster_factory 3973s s, ws = await start_cluster( 3973s ^^^^^^^^^^^^^^^^^^^^ 3973s ...<9 lines>... 3973s ) 3973s ^ 3973s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 791, in start_cluster 3973s await asyncio.gather(*workers) 3973s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3973s return await awaitable 3973s ^^^^^^^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/core.py", line 531, in start 3973s raise asyncio.TimeoutError( 3973s f"{type(self).__name__} start timed out after {timeout}s." 3973s ) from exc 3973s TimeoutError: Nanny start timed out after 0s. 3973s 2025-02-21 00:29:02,012 - distributed.scheduler - INFO - State start 3973s 2025-02-21 00:29:02,019 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:38417 3973s 2025-02-21 00:29:02,022 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:43467/status 3973s 2025-02-21 00:29:02,025 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3973s 2025-02-21 00:29:02,034 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:45641'. Reason: failure-to-start- 3973s 2025-02-21 00:29:02,035 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:45641' closed. 3973s 2025-02-21 00:29:02,035 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:36207'. Reason: failure-to-start- 3973s 2025-02-21 00:29:02,035 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:36207' closed. 3973s 2025-02-21 00:29:02,036 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38417': TLS handshake failed with remote 'tls://127.0.0.1:55566': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 3973s 2025-02-21 00:29:02,036 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38417': TLS handshake failed with remote 'tls://127.0.0.1:55572': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 3973s 2025-02-21 00:29:02,036 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 3973s Traceback (most recent call last): 3973s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 3973s return await fut 3973s ^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 3973s comm = await self.rpc.connect(saddr) 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1485, in connect 3973s return await self._connect(addr=addr, timeout=timeout) 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1429, in _connect 3973s comm = await connect( 3973s ^^^^^^^^^^^^^^ 3973s ...<4 lines>... 3973s ) 3973s ^ 3973s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3973s comm = await wait_for( 3973s ^^^^^^^^^^^^^^^ 3973s ...<2 lines>... 3973s ) 3973s ^ 3973s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 3973s return await fut 3973s ^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3973s stream = await self.client.connect( 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s ) 3973s ^ 3973s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3973s af, addr, stream = await connector.start(connect_timeout=timeout) 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s asyncio.exceptions.CancelledError 3973s 3973s The above exception was the direct cause of the following exception: 3973s 3973s Traceback (most recent call last): 3973s File "/usr/lib/python3/dist-packages/distributed/core.py", line 528, in start 3973s await wait_for(self.start_unsafe(), timeout=timeout) 3973s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1913, in wait_for 3973s async with asyncio.timeout(timeout): 3973s ~~~~~~~~~~~~~~~^^^^^^^^^ 3973s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3973s raise TimeoutError from exc_val 3973s TimeoutError 3973s 3973s The above exception was the direct cause of the following exception: 3973s 3973s Traceback (most recent call last): 3973s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 974, in _cluster_factory 3973s s, ws = await start_cluster( 3973s ^^^^^^^^^^^^^^^^^^^^ 3973s ...<9 lines>... 3973s ) 3973s ^ 3973s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 791, in start_cluster 3973s await asyncio.gather(*workers) 3973s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3973s return await awaitable 3973s ^^^^^^^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/core.py", line 531, in start 3973s raise asyncio.TimeoutError( 3973s f"{type(self).__name__} start timed out after {timeout}s." 3973s ) from exc 3973s TimeoutError: Nanny start timed out after 0s. 3973s 2025-02-21 00:29:03,040 - distributed.scheduler - INFO - State start 3973s 2025-02-21 00:29:03,046 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44103 3973s 2025-02-21 00:29:03,048 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:40215/status 3973s 2025-02-21 00:29:03,049 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3973s 2025-02-21 00:29:03,056 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:45625'. Reason: failure-to-start- 3973s 2025-02-21 00:29:03,057 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:45625' closed. 3973s 2025-02-21 00:29:03,057 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:36105'. Reason: failure-to-start- 3973s 2025-02-21 00:29:03,057 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:36105' closed. 3973s 2025-02-21 00:29:03,058 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44103': TLS handshake failed with remote 'tls://127.0.0.1:38130': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 3973s 2025-02-21 00:29:03,058 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44103': TLS handshake failed with remote 'tls://127.0.0.1:38146': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 3973s 2025-02-21 00:29:03,058 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 3973s Traceback (most recent call last): 3973s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 3973s return await fut 3973s ^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 3973s comm = await self.rpc.connect(saddr) 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1485, in connect 3973s return await self._connect(addr=addr, timeout=timeout) 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1429, in _connect 3973s comm = await connect( 3973s ^^^^^^^^^^^^^^ 3973s ...<4 lines>... 3973s ) 3973s ^ 3973s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3973s comm = await wait_for( 3973s ^^^^^^^^^^^^^^^ 3973s ...<2 lines>... 3973s ) 3973s ^ 3973s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 3973s return await fut 3973s ^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3973s stream = await self.client.connect( 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s ) 3973s ^ 3973s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3973s af, addr, stream = await connector.start(connect_timeout=timeout) 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s asyncio.exceptions.CancelledError 3973s 3973s The above exception was the direct cause of the following exception: 3973s 3973s Traceback (most recent call last): 3973s File "/usr/lib/python3/dist-packages/distributed/core.py", line 528, in start 3973s await wait_for(self.start_unsafe(), timeout=timeout) 3973s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1913, in wait_for 3973s async with asyncio.timeout(timeout): 3973s ~~~~~~~~~~~~~~~^^^^^^^^^ 3973s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3973s raise TimeoutError from exc_val 3973s TimeoutError 3973s 3973s The above exception was the direct cause of the following exception: 3973s 3973s Traceback (most recent call last): 3973s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 974, in _cluster_factory 3973s s, ws = await start_cluster( 3973s ^^^^^^^^^^^^^^^^^^^^ 3973s ...<9 lines>... 3973s ) 3973s ^ 3973s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 791, in start_cluster 3973s await asyncio.gather(*workers) 3973s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3973s return await awaitable 3973s ^^^^^^^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/core.py", line 531, in start 3973s raise asyncio.TimeoutError( 3973s f"{type(self).__name__} start timed out after {timeout}s." 3973s ) from exc 3973s TimeoutError: Nanny start timed out after 0s. 3973s 2025-02-21 00:29:04,063 - distributed.scheduler - INFO - State start 3973s 2025-02-21 00:29:04,071 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:36947 3973s 2025-02-21 00:29:04,074 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:38999/status 3973s 2025-02-21 00:29:04,077 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3973s 2025-02-21 00:29:04,089 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:44239'. Reason: failure-to-start- 3973s 2025-02-21 00:29:04,089 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:44239' closed. 3973s 2025-02-21 00:29:04,090 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:35593'. Reason: failure-to-start- 3973s 2025-02-21 00:29:04,090 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:35593' closed. 3973s 2025-02-21 00:29:04,091 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36947': TLS handshake failed with remote 'tls://127.0.0.1:45540': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 3973s 2025-02-21 00:29:04,091 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36947': TLS handshake failed with remote 'tls://127.0.0.1:45556': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 3973s 2025-02-21 00:29:04,091 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 3973s Traceback (most recent call last): 3973s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 3973s return await fut 3973s ^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 3973s comm = await self.rpc.connect(saddr) 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1485, in connect 3973s return await self._connect(addr=addr, timeout=timeout) 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1429, in _connect 3973s comm = await connect( 3973s ^^^^^^^^^^^^^^ 3973s ...<4 lines>... 3973s ) 3973s ^ 3973s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3973s comm = await wait_for( 3973s ^^^^^^^^^^^^^^^ 3973s ...<2 lines>... 3973s ) 3973s ^ 3973s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 3973s return await fut 3973s ^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3973s stream = await self.client.connect( 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s ) 3973s ^ 3973s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3973s af, addr, stream = await connector.start(connect_timeout=timeout) 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s asyncio.exceptions.CancelledError 3973s 3973s The above exception was the direct cause of the following exception: 3973s 3973s Traceback (most recent call last): 3973s File "/usr/lib/python3/dist-packages/distributed/core.py", line 528, in start 3973s await wait_for(self.start_unsafe(), timeout=timeout) 3973s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1913, in wait_for 3973s async with asyncio.timeout(timeout): 3973s ~~~~~~~~~~~~~~~^^^^^^^^^ 3973s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3973s raise TimeoutError from exc_val 3973s TimeoutError 3973s 3973s The above exception was the direct cause of the following exception: 3973s 3973s Traceback (most recent call last): 3973s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 974, in _cluster_factory 3973s s, ws = await start_cluster( 3973s ^^^^^^^^^^^^^^^^^^^^ 3973s ...<9 lines>... 3973s ) 3973s ^ 3973s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 791, in start_cluster 3973s await asyncio.gather(*workers) 3973s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3973s return await awaitable 3973s ^^^^^^^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/core.py", line 531, in start 3973s raise asyncio.TimeoutError( 3973s f"{type(self).__name__} start timed out after {timeout}s." 3973s ) from exc 3973s TimeoutError: Nanny start timed out after 0s. 3973s 2025-02-21 00:29:05,097 - distributed.scheduler - INFO - State start 3973s 2025-02-21 00:29:05,106 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:46155 3973s 2025-02-21 00:29:05,109 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:44363/status 3973s 2025-02-21 00:29:05,112 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3973s 2025-02-21 00:29:05,125 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:42829'. Reason: failure-to-start- 3973s 2025-02-21 00:29:05,126 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:42829' closed. 3973s 2025-02-21 00:29:05,126 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:38049'. Reason: failure-to-start- 3973s 2025-02-21 00:29:05,127 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:38049' closed. 3973s 2025-02-21 00:29:05,127 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46155': TLS handshake failed with remote 'tls://127.0.0.1:32982': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 3973s 2025-02-21 00:29:05,127 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46155': TLS handshake failed with remote 'tls://127.0.0.1:32994': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 3973s 2025-02-21 00:29:05,128 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 3973s Traceback (most recent call last): 3973s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 3973s return await fut 3973s ^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 3973s comm = await self.rpc.connect(saddr) 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1485, in connect 3973s return await self._connect(addr=addr, timeout=timeout) 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1429, in _connect 3973s comm = await connect( 3973s ^^^^^^^^^^^^^^ 3973s ...<4 lines>... 3973s ) 3973s ^ 3973s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3973s comm = await wait_for( 3973s ^^^^^^^^^^^^^^^ 3973s ...<2 lines>... 3973s ) 3973s ^ 3973s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 3973s return await fut 3973s ^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3973s stream = await self.client.connect( 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s ) 3973s ^ 3973s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3973s af, addr, stream = await connector.start(connect_timeout=timeout) 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s asyncio.exceptions.CancelledError 3973s 3973s The above exception was the direct cause of the following exception: 3973s 3973s Traceback (most recent call last): 3973s File "/usr/lib/python3/dist-packages/distributed/core.py", line 528, in start 3973s await wait_for(self.start_unsafe(), timeout=timeout) 3973s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1913, in wait_for 3973s async with asyncio.timeout(timeout): 3973s ~~~~~~~~~~~~~~~^^^^^^^^^ 3973s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3973s raise TimeoutError from exc_val 3973s TimeoutError 3973s 3973s The above exception was the direct cause of the following exception: 3973s 3973s Traceback (most recent call last): 3973s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 974, in _cluster_factory 3973s s, ws = await start_cluster( 3973s ^^^^^^^^^^^^^^^^^^^^ 3973s ...<9 lines>... 3973s ) 3973s ^ 3973s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 791, in start_cluster 3973s await asyncio.gather(*workers) 3973s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3973s return await awaitable 3973s ^^^^^^^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/core.py", line 531, in start 3973s raise asyncio.TimeoutError( 3973s f"{type(self).__name__} start timed out after {timeout}s." 3973s ) from exc 3973s TimeoutError: Nanny start timed out after 0s. 3973s 2025-02-21 00:29:06,133 - distributed.scheduler - INFO - State start 3973s 2025-02-21 00:29:06,139 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37279 3973s 2025-02-21 00:29:06,140 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:43901/status 3973s 2025-02-21 00:29:06,142 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3973s 2025-02-21 00:29:06,150 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:35729'. Reason: failure-to-start- 3973s 2025-02-21 00:29:06,150 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:35729' closed. 3973s 2025-02-21 00:29:06,150 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:41565'. Reason: failure-to-start- 3973s 2025-02-21 00:29:06,151 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:41565' closed. 3973s 2025-02-21 00:29:06,151 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37279': TLS handshake failed with remote 'tls://127.0.0.1:56236': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 3973s 2025-02-21 00:29:06,151 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37279': TLS handshake failed with remote 'tls://127.0.0.1:56240': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 3973s 2025-02-21 00:29:06,151 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 3973s Traceback (most recent call last): 3973s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 3973s return await fut 3973s ^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 3973s comm = await self.rpc.connect(saddr) 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1485, in connect 3973s return await self._connect(addr=addr, timeout=timeout) 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1429, in _connect 3973s comm = await connect( 3973s ^^^^^^^^^^^^^^ 3973s ...<4 lines>... 3973s ) 3973s ^ 3973s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3973s comm = await wait_for( 3973s ^^^^^^^^^^^^^^^ 3973s ...<2 lines>... 3973s ) 3973s ^ 3973s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 3973s return await fut 3973s ^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3973s stream = await self.client.connect( 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s ) 3973s ^ 3973s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3973s af, addr, stream = await connector.start(connect_timeout=timeout) 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s asyncio.exceptions.CancelledError 3973s 3973s The above exception was the direct cause of the following exception: 3973s 3973s Traceback (most recent call last): 3973s File "/usr/lib/python3/dist-packages/distributed/core.py", line 528, in start 3973s await wait_for(self.start_unsafe(), timeout=timeout) 3973s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1913, in wait_for 3973s async with asyncio.timeout(timeout): 3973s ~~~~~~~~~~~~~~~^^^^^^^^^ 3973s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3973s raise TimeoutError from exc_val 3973s TimeoutError 3973s 3973s The above exception was the direct cause of the following exception: 3973s 3973s Traceback (most recent call last): 3973s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 974, in _cluster_factory 3973s s, ws = await start_cluster( 3973s ^^^^^^^^^^^^^^^^^^^^ 3973s ...<9 lines>... 3973s ) 3973s ^ 3973s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 791, in start_cluster 3973s await asyncio.gather(*workers) 3973s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3973s return await awaitable 3973s ^^^^^^^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/core.py", line 531, in start 3973s raise asyncio.TimeoutError( 3973s f"{type(self).__name__} start timed out after {timeout}s." 3973s ) from exc 3973s TimeoutError: Nanny start timed out after 0s. 3973s 2025-02-21 00:29:07,156 - distributed.scheduler - INFO - State start 3973s 2025-02-21 00:29:07,162 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:33375 3973s 2025-02-21 00:29:07,164 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:37041/status 3973s 2025-02-21 00:29:07,166 - distributed.scheduler - INFO - Registering Worker plugin shuffle 3973s 2025-02-21 00:29:07,174 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:40131'. Reason: failure-to-start- 3973s 2025-02-21 00:29:07,174 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:40131' closed. 3973s 2025-02-21 00:29:07,174 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:33053'. Reason: failure-to-start- 3973s 2025-02-21 00:29:07,175 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:33053' closed. 3973s 2025-02-21 00:29:07,175 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33375': TLS handshake failed with remote 'tls://127.0.0.1:40586': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 3973s 2025-02-21 00:29:07,175 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33375': TLS handshake failed with remote 'tls://127.0.0.1:40600': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 3973s 2025-02-21 00:29:07,175 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 3973s Traceback (most recent call last): 3973s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 3973s return await fut 3973s ^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 3973s comm = await self.rpc.connect(saddr) 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1485, in connect 3973s return await self._connect(addr=addr, timeout=timeout) 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1429, in _connect 3973s comm = await connect( 3973s ^^^^^^^^^^^^^^ 3973s ...<4 lines>... 3973s ) 3973s ^ 3973s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 3973s comm = await wait_for( 3973s ^^^^^^^^^^^^^^^ 3973s ...<2 lines>... 3973s ) 3973s ^ 3973s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 3973s return await fut 3973s ^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 3973s stream = await self.client.connect( 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s ) 3973s ^ 3973s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 3973s af, addr, stream = await connector.start(connect_timeout=timeout) 3973s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 3973s asyncio.exceptions.CancelledError 3973s 3973s The above exception was the direct cause of the following exception: 3973s 3973s Traceback (most recent call last): 3973s File "/usr/lib/python3/dist-packages/distributed/core.py", line 528, in start 3973s await wait_for(self.start_unsafe(), timeout=timeout) 3973s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1913, in wait_for 3973s async with asyncio.timeout(timeout): 3973s ~~~~~~~~~~~~~~~^^^^^^^^^ 3973s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 3973s raise TimeoutError from exc_val 3973s TimeoutError 3973s 3973s The above exception was the direct cause of the following exception: 3973s 3973s Traceback (most recent call last): 3973s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 974, in _cluster_factory 3973s s, ws = await start_cluster( 3973s ^^^^^^^^^^^^^^^^^^^^ 3973s ...<9 lines>... 3973s ) 3973s ^ 3973s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 791, in start_cluster 3973s await asyncio.gather(*workers) 3973s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 3973s return await awaitable 3973s ^^^^^^^^^^^^^^^ 3973s File "/usr/lib/python3/dist-packages/distributed/core.py", line 531, in start 3973s raise asyncio.TimeoutError( 3973s f"{type(self).__name__} start timed out after {timeout}s." 3973s ) from exc 3973s TimeoutError: Nanny start timed out after 0s. 3973s ============================= slowest 20 durations ============================= 3973s 60.01s call tests/test_tls_functional.py::test_retire_workers 3973s 60.01s call tests/test_tls_functional.py::test_nanny 3973s 21.53s call tests/test_scheduler.py::test_restart_some_nannies_some_not 3973s 19.18s call tests/test_gc.py::test_gc_diagnosis_cpu_time 3973s 16.18s call tests/test_stress.py::test_chaos_rechunk 3973s 15.84s call tests/test_diskutils.py::test_workspace_concurrency 3973s 13.63s call tests/test_scheduler.py::test_file_descriptors 3973s 12.81s call tests/test_stress.py::test_close_connections 3973s 12.80s call tests/test_scheduler.py::test_memory 3973s 11.81s call tests/test_failed_workers.py::test_worker_ttl_restarts_worker[True] 3973s 11.19s call tests/test_scheduler.py::test_log_tasks_during_restart 3973s 11.17s call tests/test_core.py::test_large_payload 3973s 11.00s call tests/test_stress.py::test_stress_creation_and_deletion 3973s 10.91s call tests/test_client.py::test_bad_tasks_fail 3973s 10.04s call tests/test_utils_test.py::test_popen_timeout 3973s 9.81s call tests/test_client.py::test_threadsafe_get 3973s 9.36s call tests/test_client.py::test_threadsafe_compute 3973s 7.58s call tests/test_stress.py::test_stress_gc[inc-1000] 3973s 7.49s call tests/test_failed_workers.py::test_broken_worker_during_computation 3973s 7.38s call tests/test_failed_workers.py::test_worker_ttl_restarts_worker[False] 3973s =========================== short test summary info ============================ 3973s SKIPPED [1] ../../../usr/lib/python3/dist-packages/distributed/comm/tests/test_ucx.py:15: could not import 'ucp': No module named 'ucp' 3973s SKIPPED [1] ../../../usr/lib/python3/dist-packages/distributed/comm/tests/test_ucx_config.py:23: could not import 'ucp': No module named 'ucp' 3973s SKIPPED [1] ../../../usr/lib/python3/dist-packages/distributed/dashboard/tests/test_components.py:5: could not import 'bokeh': No module named 'bokeh' 3973s SKIPPED [1] ../../../usr/lib/python3/dist-packages/distributed/dashboard/tests/test_scheduler_bokeh.py:11: could not import 'bokeh': No module named 'bokeh' 3973s SKIPPED [1] ../../../usr/lib/python3/dist-packages/distributed/dashboard/tests/test_worker_bokeh.py:10: could not import 'bokeh': No module named 'bokeh' 3973s SKIPPED [1] ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_ssh.py:5: could not import 'asyncssh': No module named 'asyncssh' 3973s SKIPPED [1] ../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_cudf_diagnostics.py:20: could not import 'cudf': No module named 'cudf' 3973s SKIPPED [1] ../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_memray.py:5: could not import 'memray': No module named 'memray' 3973s SKIPPED [1] ../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_nvml.py:11: could not import 'pynvml': No module named 'pynvml' 3973s SKIPPED [1] ../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_progress_stream.py:5: could not import 'bokeh': No module named 'bokeh' 3973s SKIPPED [1] ../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_progress_widgets.py:14: could not import 'ipywidgets': No module named 'ipywidgets' 3973s SKIPPED [1] ../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_rmm_diagnostics.py:14: could not import 'dask_cuda': No module named 'dask_cuda' 3973s SKIPPED [1] ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_arrow.py:5: could not import 'pyarrow': No module named 'pyarrow' 3973s SKIPPED [1] ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_cupy.py:11: could not import 'cupy': No module named 'cupy' 3973s SKIPPED [1] ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_keras.py:5: could not import 'keras': No module named 'keras' 3973s SKIPPED [1] ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numba.py:11: could not import 'numba.cuda': No module named 'numba' 3973s SKIPPED [1] ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_rmm.py:10: could not import 'numba.cuda': No module named 'numba' 3973s SKIPPED [1] ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_sparse.py:6: could not import 'sparse': No module named 'sparse' 3973s SKIPPED [1] ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_torch.py:8: could not import 'torch': No module named 'torch' 3973s SKIPPED [1] ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_graph.py:9: could not import 'pyarrow': No module named 'pyarrow' 3973s SKIPPED [1] ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_merge.py:71: could not import 'pyarrow': No module named 'pyarrow' 3973s SKIPPED [1] ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_merge_column_and_index.py:110: could not import 'pyarrow': No module named 'pyarrow' 3973s SKIPPED [1] ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_metrics.py:71: could not import 'pyarrow': No module named 'pyarrow' 3973s SKIPPED [1] ../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_shuffle.py:195: could not import 'pyarrow': No module named 'pyarrow' 3973s SKIPPED [1] ../../../usr/lib/python3/dist-packages/distributed/tests/test_parse_stdout.py:14: could not import 'parse_stdout': No module named 'parse_stdout' 3973s SKIPPED [1] ../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py:85: could not import 'bokeh': No module named 'bokeh' 3973s SKIPPED [1] ../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py:117: could not import 'bokeh': No module named 'bokeh' 3973s SKIPPED [1] ../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py:168: could not import 'bokeh': No module named 'bokeh' 3973s SKIPPED [1] ../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py:325: could not import 'bokeh': No module named 'bokeh' 3973s SKIPPED [4] ../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py:508: ipv6 required 3973s SKIPPED [1] ../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py:580: could not import 'bokeh': No module named 'bokeh' 3973s SKIPPED [1] ../../../usr/lib/python3/dist-packages/distributed/comm/tests/test_comms.py:573: could not import 'ucp': No module named 'ucp' 3973s SKIPPED [1] ../../../usr/lib/python3/dist-packages/distributed/comm/tests/test_comms.py:626: ipv6 required 3973s SKIPPED [1] ../../../usr/lib/python3/dist-packages/distributed/comm/tests/test_comms.py:652: ipv6 required 3973s SKIPPED [1] ../../../usr/lib/python3/dist-packages/distributed/comm/tests/test_comms.py:675: ipv6 required 3973s SKIPPED [1] ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_local.py:257: could not import 'bokeh': No module named 'bokeh' 3973s SKIPPED [2] ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_local.py:471: could not import 'bokeh': No module named 'bokeh' 3973s SKIPPED [1] ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_local.py:609: could not import 'bokeh': No module named 'bokeh' 3973s SKIPPED [1] ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_local.py:646: could not import 'ipywidgets': No module named 'ipywidgets' 3973s SKIPPED [1] ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_local.py:664: could not import 'ipywidgets': No module named 'ipywidgets' 3973s SKIPPED [1] ../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_subprocess.py:92: Windows-specific error testing (distributed#7434) 3973s SKIPPED [1] ../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_eventstream.py:16: could not import 'bokeh': No module named 'bokeh' 3973s SKIPPED [1] ../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_task_stream.py:140: could not import 'bokeh.models': No module named 'bokeh' 3973s SKIPPED [1] ../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_task_stream.py:151: could not import 'bokeh.models': No module named 'bokeh' 3973s SKIPPED [1] ../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_missing_bokeh.py:35: could not import 'bokeh': No module named 'bokeh' 3973s SKIPPED [1] ../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_missing_bokeh.py:59: could not import 'bokeh': No module named 'bokeh' 3973s SKIPPED [1] ../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py:87: could not import 'bokeh': No module named 'bokeh' 3973s SKIPPED [1] ../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py:648: could not import 'bokeh': No module named 'bokeh' 3973s SKIPPED [1] ../../../usr/lib/python3/dist-packages/distributed/http/worker/tests/test_worker_http.py:234: Fails on 32-bit, seems to be large memory request 3973s SKIPPED [4] ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_collection_cuda.py:12: could not import 'cupy': No module named 'cupy' 3973s SKIPPED [4] ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_collection_cuda.py:44: could not import 'cudf': No module named 'cudf' 3973s SKIPPED [2] ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py:132: could not import 'snappy': No module named 'snappy' 3973s SKIPPED [2] ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py:132: could not import 'zstandard': No module named 'zstandard' 3973s SKIPPED [1] ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py:143: could not import 'snappy': No module named 'snappy' 3973s SKIPPED [1] ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py:143: could not import 'zstandard': No module named 'zstandard' 3973s SKIPPED [1] ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py:151: could not import 'snappy': No module named 'snappy' 3973s SKIPPED [1] ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py:151: could not import 'zstandard': No module named 'zstandard' 3973s SKIPPED [2] ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py:168: could not import 'snappy': No module named 'snappy' 3973s SKIPPED [2] ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py:168: could not import 'zstandard': No module named 'zstandard' 3973s SKIPPED [1] ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py:188: could not import 'snappy': No module named 'snappy' 3973s SKIPPED [1] ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py:188: could not import 'zstandard': No module named 'zstandard' 3973s SKIPPED [1] ../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py:150: could not import 'numpy.core.test_rational': No module named 'numpy.core.test_rational' 3973s SKIPPED [1] ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py:1707: Upstream issue in CPython. See https://github.com/dask/distributed/issues/8708 and https://github.com/python/cpython/issues/121342. 3973s SKIPPED [1] ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py:1870: unconditional skip 3973s SKIPPED [1] ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py:2088: unconditional skip 3973s SKIPPED [1] ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py:2677: Use fast random selection now 3973s SKIPPED [1] ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py:3301: unconditional skip 3973s SKIPPED [1] ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py:4667: Now prefer first-in-first-out 3973s SKIPPED [1] ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py:5961: unconditional skip 3973s SKIPPED [1] ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py:6179: could not import 'bokeh.plotting': No module named 'bokeh' 3973s SKIPPED [1] ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py:6540: known intermittent failure 3973s SKIPPED [2] ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py:6626: could not import 'bokeh': No module named 'bokeh' 3973s SKIPPED [1] ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py:7065: could not import 'bokeh': No module named 'bokeh' 3973s SKIPPED [1] ../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py:7265: numpy >=1.25 can capture ufunc code 3973s SKIPPED [1] ../../../usr/lib/python3/dist-packages/distributed/tests/test_config.py:356: could not import 'uvloop': No module named 'uvloop' 3973s SKIPPED [1] ../../../usr/lib/python3/dist-packages/distributed/tests/test_core.py:115: could not import 'gilknocker': No module named 'gilknocker' 3973s SKIPPED [1] ../../../usr/lib/python3/dist-packages/distributed/tests/test_core.py:915: could not import 'crick': No module named 'crick' 3973s SKIPPED [1] ../../../usr/lib/python3/dist-packages/distributed/tests/test_core.py:924: could not import 'crick': No module named 'crick' 3973s SKIPPED [1] ../../../usr/lib/python3/dist-packages/distributed/tests/test_counter.py:13: no crick library 3973s SKIPPED [1] ../../../usr/lib/python3/dist-packages/distributed/tests/test_dask_collections.py:221: could not import 'sparse': No module named 'sparse' 3973s SKIPPED [1] ../../../usr/lib/python3/dist-packages/distributed/tests/test_metrics.py:30: WindowsTime doesn't work with high accuracy base timer 3973s SKIPPED [2] ../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py:567: could not import 'ucp': No module named 'ucp' 3973s SKIPPED [1] ../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py:75: could not import 'stacktrace': No module named 'stacktrace' 3973s SKIPPED [1] ../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py:363: Skipped 3973s SKIPPED [1] ../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py:422: Should protect resource keys from optimization 3973s SKIPPED [1] ../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py:445: atop fusion seemed to break this 3973s SKIPPED [1] ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py:286: Not relevant with queuing on; see https://github.com/dask/distributed/issues/7204 3973s SKIPPED [1] ../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py:2661: could not import 'bokeh': No module named 'bokeh' 3973s SKIPPED [1] ../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py:285: Skipped 3973s SKIPPED [1] ../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py:1287: executing heartbeats not considered yet 3973s SKIPPED [1] ../../../usr/lib/python3/dist-packages/distributed/tests/test_stress.py:209: unconditional skip 3973s SKIPPED [1] ../../../usr/lib/python3/dist-packages/distributed/tests/test_stress.py:277: could not import 'crick': No module named 'crick' 3973s SKIPPED [1] ../../../usr/lib/python3/dist-packages/distributed/tests/test_system_monitor.py:111: could not import 'gilknocker': No module named 'gilknocker' 3973s SKIPPED [1] ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py:347: could not import 'pyarrow': No module named 'pyarrow' 3973s SKIPPED [1] ../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py:146: This hangs on travis 3973s SKIPPED [1] ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py:219: don't yet support uploading pyc files 3973s SKIPPED [1] ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py:309: could not import 'crick': No module named 'crick' 3973s SKIPPED [2] ../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py:1453: could not import 'ucp': No module named 'ucp' 3973s FAILED tests/test_tls_functional.py::test_nanny - TimeoutError 3973s FAILED tests/test_tls_functional.py::test_retire_workers - TimeoutError 3973s = 2 failed, 3509 passed, 115 skipped, 38 deselected, 16 xfailed, 8 xpassed, 1 rerun in 1859.27s (0:30:59) = 3984s *** END OF RUN 1: NOT ALL TESTS HAVE YET PASSED/XFAILED *** 3984s *** STARTING RUN 2: python3.13 -m pytest -m not avoid_ci --verbose --timeout-method=signal --timeout=300 --durations=20 --color=no --runslow --pyargs distributed -rfE --last-failed --last-failed-no-failures none --deselect=cli/tests/test_dask_scheduler.py::test_no_dashboard --deselect=deploy/tests/test_local.py::test_localcluster_get_client --deselect=deploy/tests/test_old_ssh.py::test_cluster --deselect=deploy/tests/test_old_ssh.py::test_old_ssh_nprocs_renamed_to_n_workers --deselect=deploy/tests/test_old_ssh.py::test_nprocs_attribute_is_deprecated --deselect=deploy/tests/test_ssh.py::test_nprocs_attribute_is_deprecated --deselect=http/tests/test_core.py::test_prometheus_api_doc --deselect=tests/test_init.py::test_git_revision --deselect=tests/test_jupyter.py::test_jupyter_idle_timeout --deselect=tests/test_jupyter.py::test_jupyter_idle_timeout_returned --deselect=tests/test_jupyter.py::test_jupyter_server --deselect=tests/test_jupyter.py::test_shutsdown_cleanly --deselect=tests/test_profile.py::test_stack_overflow --deselect=tests/test_pubsub.py::test_client_worker --deselect=tests/test_queues.py::test_queue_in_task --deselect=tests/test_spill.py::test_spillbuffer_oserror --deselect=tests/test_steal.py::test_steal_twice --deselect=tests/test_utils_test.py::test_cluster --deselect=tests/test_variable.py::test_variable_in_task --deselect=tests/test_worker.py::test_process_executor_kills_process --deselect=tests/test_worker_memory.py::test_fail_to_pickle_execute_1 --deselect=tests/test_worker_state_machine.py::test_task_state_instance_are_garbage_collected --deselect=protocol/tests/test_protocol.py::test_deeply_nested_structures --deselect=protocol/tests/test_serialize.py::test_deeply_nested_structures 3985s ============================= test session starts ============================== 3985s platform linux -- Python 3.13.2, pytest-8.3.4, pluggy-1.5.0 -- /usr/bin/python3.13 3985s cachedir: .pytest_cache 3985s rootdir: /tmp/autopkgtest.4PKwEm/autopkgtest_tmp 3985s configfile: pyproject.toml 3985s plugins: timeout-2.3.1, rerunfailures-15.0, anyio-4.7.0, typeguard-4.4.1 3985s timeout: 300.0s 3985s timeout method: signal 3985s timeout func_only: False 3993s collecting ... collected 3663 items / 3661 deselected / 25 skipped / 2 selected 3993s run-last-failure: rerun previous 2 failures 3993s 3995s tests/test_tls_functional.py::test_nanny <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_tls_functional.py PASSED [ 50%] 3998s tests/test_tls_functional.py::test_retire_workers <- ../../../usr/lib/python3/dist-packages/distributed/tests/test_tls_functional.py PASSED [100%] 3998s 3998s ============================= slowest 20 durations ============================= 3998s 3.20s call tests/test_tls_functional.py::test_retire_workers 3998s 1.34s call tests/test_tls_functional.py::test_nanny 3998s 0.00s setup tests/test_tls_functional.py::test_nanny 3998s 0.00s teardown tests/test_tls_functional.py::test_retire_workers 3998s 0.00s teardown tests/test_tls_functional.py::test_nanny 3998s 0.00s setup tests/test_tls_functional.py::test_retire_workers 3998s =============== 2 passed, 25 skipped, 3661 deselected in 12.87s ================ 3999s *** END OF RUN 2: ALL TESTS RUN HAVE NOW PASSED/XFAILED *** 3999s autopkgtest [00:33:22]: test pytest: -----------------------] 3999s pytest PASS 3999s autopkgtest [00:33:22]: test pytest: - - - - - - - - - - results - - - - - - - - - - 3999s autopkgtest [00:33:22]: test pybuild-autopkgtest: preparing testbed 4072s autopkgtest [00:34:35]: testbed dpkg architecture: amd64 4072s autopkgtest [00:34:35]: testbed apt version: 2.9.30 4072s autopkgtest [00:34:35]: @@@@@@@@@@@@@@@@@@@@ test bed setup 4072s autopkgtest [00:34:35]: testbed release detected to be: plucky 4073s autopkgtest [00:34:36]: updating testbed package index (apt update) 4073s Get:1 http://ftpmaster.internal/ubuntu plucky-proposed InRelease [110 kB] 4073s Hit:2 http://ftpmaster.internal/ubuntu plucky InRelease 4073s Hit:3 http://ftpmaster.internal/ubuntu plucky-updates InRelease 4073s Hit:4 http://ftpmaster.internal/ubuntu plucky-security InRelease 4073s Get:5 http://ftpmaster.internal/ubuntu plucky-proposed/universe Sources [729 kB] 4073s Get:6 http://ftpmaster.internal/ubuntu plucky-proposed/restricted Sources [3120 B] 4073s Get:7 http://ftpmaster.internal/ubuntu plucky-proposed/multiverse Sources [14.8 kB] 4073s Get:8 http://ftpmaster.internal/ubuntu plucky-proposed/main Sources [89.5 kB] 4073s Get:9 http://ftpmaster.internal/ubuntu plucky-proposed/main i386 Packages [110 kB] 4073s Get:10 http://ftpmaster.internal/ubuntu plucky-proposed/main amd64 Packages [136 kB] 4073s Get:11 http://ftpmaster.internal/ubuntu plucky-proposed/restricted amd64 Packages [7984 B] 4073s Get:12 http://ftpmaster.internal/ubuntu plucky-proposed/restricted i386 Packages [2412 B] 4073s Get:13 http://ftpmaster.internal/ubuntu plucky-proposed/universe i386 Packages [261 kB] 4073s Get:14 http://ftpmaster.internal/ubuntu plucky-proposed/universe amd64 Packages [691 kB] 4073s Get:15 http://ftpmaster.internal/ubuntu plucky-proposed/multiverse i386 Packages [9128 B] 4073s Get:16 http://ftpmaster.internal/ubuntu plucky-proposed/multiverse amd64 Packages [22.5 kB] 4073s Fetched 2187 kB in 0s (5982 kB/s) 4075s Reading package lists... 4075s + lsb_release --codename --short 4075s + RELEASE=plucky 4075s + cat 4075s + [ plucky != trusty ] 4075s + DEBIAN_FRONTEND=noninteractive eatmydata apt-get -y --allow-downgrades -o Dpkg::Options::=--force-confnew dist-upgrade 4075s Reading package lists... 4075s Building dependency tree... 4075s Reading state information... 4076s Calculating upgrade... 4076s The following package was automatically installed and is no longer required: 4076s libapt-pkg6.0t64 4076s Use 'sudo apt autoremove' to remove it. 4076s The following packages will be upgraded: 4076s apt apt-utils binutils binutils-common binutils-x86-64-linux-gnu 4076s cryptsetup-bin fwupd inetutils-telnet kbd libapt-pkg7.0 libbinutils 4076s libcbor0.10 libcryptsetup12 libctf-nobfd0 libctf0 libfwupd3 libgprofng0 4076s libplymouth5 libsframe1 libssl3t64 lto-disabled-list openssl 4076s openssl-provider-legacy plymouth plymouth-theme-ubuntu-text python3-requests 4076s telnet ubuntu-pro-client ubuntu-pro-client-l10n 4076s 29 upgraded, 0 newly installed, 0 to remove and 0 not upgraded. 4076s Need to get 16.7 MB of archives. 4076s After this operation, 230 kB of additional disk space will be used. 4076s Get:1 http://ftpmaster.internal/ubuntu plucky/main amd64 openssl-provider-legacy amd64 3.4.1-1ubuntu1 [38.8 kB] 4076s Get:2 http://ftpmaster.internal/ubuntu plucky/main amd64 libssl3t64 amd64 3.4.1-1ubuntu1 [2334 kB] 4076s Get:3 http://ftpmaster.internal/ubuntu plucky/main amd64 libapt-pkg7.0 amd64 2.9.30ubuntu1 [1132 kB] 4076s Get:4 http://ftpmaster.internal/ubuntu plucky/main amd64 apt amd64 2.9.30ubuntu1 [1436 kB] 4076s Get:5 http://ftpmaster.internal/ubuntu plucky/main amd64 apt-utils amd64 2.9.30ubuntu1 [222 kB] 4076s Get:6 http://ftpmaster.internal/ubuntu plucky/main amd64 kbd amd64 2.7.1-2ubuntu1 [242 kB] 4076s Get:7 http://ftpmaster.internal/ubuntu plucky/main amd64 openssl amd64 3.4.1-1ubuntu1 [1189 kB] 4076s Get:8 http://ftpmaster.internal/ubuntu plucky/main amd64 ubuntu-pro-client-l10n amd64 34.1.3 [18.3 kB] 4076s Get:9 http://ftpmaster.internal/ubuntu plucky/main amd64 ubuntu-pro-client amd64 34.1.3 [241 kB] 4076s Get:10 http://ftpmaster.internal/ubuntu plucky/main amd64 inetutils-telnet amd64 2:2.5-6ubuntu1 [116 kB] 4076s Get:11 http://ftpmaster.internal/ubuntu plucky/main amd64 libcbor0.10 amd64 0.10.2-2ubuntu1 [26.0 kB] 4076s Get:12 http://ftpmaster.internal/ubuntu plucky/main amd64 libplymouth5 amd64 24.004.60-2ubuntu5 [146 kB] 4076s Get:13 http://ftpmaster.internal/ubuntu plucky/main amd64 plymouth-theme-ubuntu-text amd64 24.004.60-2ubuntu5 [10.3 kB] 4076s Get:14 http://ftpmaster.internal/ubuntu plucky/main amd64 plymouth amd64 24.004.60-2ubuntu5 [140 kB] 4076s Get:15 http://ftpmaster.internal/ubuntu plucky/main amd64 telnet all 0.17+2.5-6ubuntu1 [3694 B] 4076s Get:16 http://ftpmaster.internal/ubuntu plucky/main amd64 libgprofng0 amd64 2.44-2ubuntu1 [885 kB] 4076s Get:17 http://ftpmaster.internal/ubuntu plucky/main amd64 libctf0 amd64 2.44-2ubuntu1 [96.5 kB] 4076s Get:18 http://ftpmaster.internal/ubuntu plucky/main amd64 libctf-nobfd0 amd64 2.44-2ubuntu1 [98.9 kB] 4076s Get:19 http://ftpmaster.internal/ubuntu plucky/main amd64 binutils-x86-64-linux-gnu amd64 2.44-2ubuntu1 [1108 kB] 4076s Get:20 http://ftpmaster.internal/ubuntu plucky/main amd64 libbinutils amd64 2.44-2ubuntu1 [585 kB] 4076s Get:21 http://ftpmaster.internal/ubuntu plucky/main amd64 binutils amd64 2.44-2ubuntu1 [208 kB] 4076s Get:22 http://ftpmaster.internal/ubuntu plucky/main amd64 binutils-common amd64 2.44-2ubuntu1 [215 kB] 4076s Get:23 http://ftpmaster.internal/ubuntu plucky/main amd64 libsframe1 amd64 2.44-2ubuntu1 [14.9 kB] 4076s Get:24 http://ftpmaster.internal/ubuntu plucky/main amd64 libcryptsetup12 amd64 2:2.7.5-1ubuntu2 [321 kB] 4076s Get:25 http://ftpmaster.internal/ubuntu plucky/main amd64 cryptsetup-bin amd64 2:2.7.5-1ubuntu2 [222 kB] 4076s Get:26 http://ftpmaster.internal/ubuntu plucky/main amd64 fwupd amd64 2.0.6-3 [5408 kB] 4076s Get:27 http://ftpmaster.internal/ubuntu plucky/main amd64 libfwupd3 amd64 2.0.6-3 [136 kB] 4076s Get:28 http://ftpmaster.internal/ubuntu plucky/main amd64 lto-disabled-list all 56 [12.4 kB] 4076s Get:29 http://ftpmaster.internal/ubuntu plucky/main amd64 python3-requests all 2.32.3+dfsg-4ubuntu1 [52.9 kB] 4077s Fetched 16.7 MB in 0s (91.3 MB/s) 4077s (Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 109023 files and directories currently installed.) 4077s Preparing to unpack .../openssl-provider-legacy_3.4.1-1ubuntu1_amd64.deb ... 4077s Unpacking openssl-provider-legacy (3.4.1-1ubuntu1) over (3.4.0-1ubuntu2) ... 4078s Setting up openssl-provider-legacy (3.4.1-1ubuntu1) ... 4078s (Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 109023 files and directories currently installed.) 4078s Preparing to unpack .../libssl3t64_3.4.1-1ubuntu1_amd64.deb ... 4078s Unpacking libssl3t64:amd64 (3.4.1-1ubuntu1) over (3.4.0-1ubuntu2) ... 4078s Setting up libssl3t64:amd64 (3.4.1-1ubuntu1) ... 4078s (Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 109023 files and directories currently installed.) 4078s Preparing to unpack .../libapt-pkg7.0_2.9.30ubuntu1_amd64.deb ... 4078s Unpacking libapt-pkg7.0:amd64 (2.9.30ubuntu1) over (2.9.30) ... 4078s Setting up libapt-pkg7.0:amd64 (2.9.30ubuntu1) ... 4078s (Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 109023 files and directories currently installed.) 4078s Preparing to unpack .../apt_2.9.30ubuntu1_amd64.deb ... 4078s Unpacking apt (2.9.30ubuntu1) over (2.9.30) ... 4078s Setting up apt (2.9.30ubuntu1) ... 4079s (Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 109023 files and directories currently installed.) 4079s Preparing to unpack .../00-apt-utils_2.9.30ubuntu1_amd64.deb ... 4079s Unpacking apt-utils (2.9.30ubuntu1) over (2.9.30) ... 4079s Preparing to unpack .../01-kbd_2.7.1-2ubuntu1_amd64.deb ... 4079s Unpacking kbd (2.7.1-2ubuntu1) over (2.6.4-2ubuntu3) ... 4079s Preparing to unpack .../02-openssl_3.4.1-1ubuntu1_amd64.deb ... 4079s Unpacking openssl (3.4.1-1ubuntu1) over (3.4.0-1ubuntu2) ... 4079s Preparing to unpack .../03-ubuntu-pro-client-l10n_34.1.3_amd64.deb ... 4079s Unpacking ubuntu-pro-client-l10n (34.1.3) over (34.1.2) ... 4079s Preparing to unpack .../04-ubuntu-pro-client_34.1.3_amd64.deb ... 4080s /usr/bin/py3clean:101: DeprecationWarning: glob.glob1 is deprecated and will be removed in Python 3.15. Use glob.glob and pass a directory to its root_dir argument instead. 4080s for fn in glob1(directory, "%s.*" % fname): 4080s Unpacking ubuntu-pro-client (34.1.3) over (34.1.2) ... 4080s Preparing to unpack .../05-inetutils-telnet_2%3a2.5-6ubuntu1_amd64.deb ... 4080s Unpacking inetutils-telnet (2:2.5-6ubuntu1) over (2:2.5-5ubuntu1) ... 4080s Preparing to unpack .../06-libcbor0.10_0.10.2-2ubuntu1_amd64.deb ... 4080s Unpacking libcbor0.10:amd64 (0.10.2-2ubuntu1) over (0.10.2-1.2ubuntu2) ... 4080s Preparing to unpack .../07-libplymouth5_24.004.60-2ubuntu5_amd64.deb ... 4080s Unpacking libplymouth5:amd64 (24.004.60-2ubuntu5) over (24.004.60-2ubuntu4) ... 4080s Preparing to unpack .../08-plymouth-theme-ubuntu-text_24.004.60-2ubuntu5_amd64.deb ... 4080s Unpacking plymouth-theme-ubuntu-text (24.004.60-2ubuntu5) over (24.004.60-2ubuntu4) ... 4080s Preparing to unpack .../09-plymouth_24.004.60-2ubuntu5_amd64.deb ... 4080s Unpacking plymouth (24.004.60-2ubuntu5) over (24.004.60-2ubuntu4) ... 4080s Preparing to unpack .../10-telnet_0.17+2.5-6ubuntu1_all.deb ... 4080s Unpacking telnet (0.17+2.5-6ubuntu1) over (0.17+2.5-5ubuntu1) ... 4080s Preparing to unpack .../11-libgprofng0_2.44-2ubuntu1_amd64.deb ... 4080s Unpacking libgprofng0:amd64 (2.44-2ubuntu1) over (2.44-1ubuntu1) ... 4080s Preparing to unpack .../12-libctf0_2.44-2ubuntu1_amd64.deb ... 4080s Unpacking libctf0:amd64 (2.44-2ubuntu1) over (2.44-1ubuntu1) ... 4080s Preparing to unpack .../13-libctf-nobfd0_2.44-2ubuntu1_amd64.deb ... 4080s Unpacking libctf-nobfd0:amd64 (2.44-2ubuntu1) over (2.44-1ubuntu1) ... 4080s Preparing to unpack .../14-binutils-x86-64-linux-gnu_2.44-2ubuntu1_amd64.deb ... 4080s Unpacking binutils-x86-64-linux-gnu (2.44-2ubuntu1) over (2.44-1ubuntu1) ... 4080s Preparing to unpack .../15-libbinutils_2.44-2ubuntu1_amd64.deb ... 4080s Unpacking libbinutils:amd64 (2.44-2ubuntu1) over (2.44-1ubuntu1) ... 4080s Preparing to unpack .../16-binutils_2.44-2ubuntu1_amd64.deb ... 4080s Unpacking binutils (2.44-2ubuntu1) over (2.44-1ubuntu1) ... 4081s Preparing to unpack .../17-binutils-common_2.44-2ubuntu1_amd64.deb ... 4081s Unpacking binutils-common:amd64 (2.44-2ubuntu1) over (2.44-1ubuntu1) ... 4081s Preparing to unpack .../18-libsframe1_2.44-2ubuntu1_amd64.deb ... 4081s Unpacking libsframe1:amd64 (2.44-2ubuntu1) over (2.44-1ubuntu1) ... 4081s Preparing to unpack .../19-libcryptsetup12_2%3a2.7.5-1ubuntu2_amd64.deb ... 4081s Unpacking libcryptsetup12:amd64 (2:2.7.5-1ubuntu2) over (2:2.7.2-2ubuntu1) ... 4081s Preparing to unpack .../20-cryptsetup-bin_2%3a2.7.5-1ubuntu2_amd64.deb ... 4081s Unpacking cryptsetup-bin (2:2.7.5-1ubuntu2) over (2:2.7.2-2ubuntu1) ... 4081s Preparing to unpack .../21-fwupd_2.0.6-3_amd64.deb ... 4081s Unpacking fwupd (2.0.6-3) over (2.0.5-1) ... 4081s Preparing to unpack .../22-libfwupd3_2.0.6-3_amd64.deb ... 4081s Unpacking libfwupd3:amd64 (2.0.6-3) over (2.0.5-1) ... 4081s Preparing to unpack .../23-lto-disabled-list_56_all.deb ... 4081s Unpacking lto-disabled-list (56) over (55) ... 4081s Preparing to unpack .../24-python3-requests_2.32.3+dfsg-4ubuntu1_all.deb ... 4081s /usr/bin/py3clean:101: DeprecationWarning: glob.glob1 is deprecated and will be removed in Python 3.15. Use glob.glob and pass a directory to its root_dir argument instead. 4081s for fn in glob1(directory, "%s.*" % fname): 4081s Unpacking python3-requests (2.32.3+dfsg-4ubuntu1) over (2.32.3+dfsg-1ubuntu1) ... 4081s Setting up lto-disabled-list (56) ... 4081s Setting up apt-utils (2.9.30ubuntu1) ... 4081s Setting up libcbor0.10:amd64 (0.10.2-2ubuntu1) ... 4081s Setting up binutils-common:amd64 (2.44-2ubuntu1) ... 4081s Setting up inetutils-telnet (2:2.5-6ubuntu1) ... 4081s Setting up libctf-nobfd0:amd64 (2.44-2ubuntu1) ... 4081s Setting up libfwupd3:amd64 (2.0.6-3) ... 4081s Setting up libsframe1:amd64 (2.44-2ubuntu1) ... 4081s Setting up python3-requests (2.32.3+dfsg-4ubuntu1) ... 4082s Setting up libplymouth5:amd64 (24.004.60-2ubuntu5) ... 4082s Setting up libcryptsetup12:amd64 (2:2.7.5-1ubuntu2) ... 4082s Setting up kbd (2.7.1-2ubuntu1) ... 4082s Setting up libbinutils:amd64 (2.44-2ubuntu1) ... 4082s Setting up openssl (3.4.1-1ubuntu1) ... 4082s Setting up ubuntu-pro-client (34.1.3) ... 4084s Setting up fwupd (2.0.6-3) ... 4084s fwupd-refresh.service is a disabled or a static unit not running, not starting it. 4085s fwupd.service is a disabled or a static unit not running, not starting it. 4085s Setting up libctf0:amd64 (2.44-2ubuntu1) ... 4085s Setting up cryptsetup-bin (2:2.7.5-1ubuntu2) ... 4085s Setting up ubuntu-pro-client-l10n (34.1.3) ... 4085s Setting up telnet (0.17+2.5-6ubuntu1) ... 4085s Setting up plymouth (24.004.60-2ubuntu5) ... 4085s update-rc.d: warning: start and stop actions are no longer supported; falling back to defaults 4085s update-rc.d: warning: start and stop actions are no longer supported; falling back to defaults 4085s Setting up libgprofng0:amd64 (2.44-2ubuntu1) ... 4085s Setting up binutils-x86-64-linux-gnu (2.44-2ubuntu1) ... 4085s Setting up binutils (2.44-2ubuntu1) ... 4085s Processing triggers for dbus (1.16.0-1ubuntu1) ... 4085s Processing triggers for initramfs-tools (0.145ubuntu2) ... 4085s update-initramfs: Generating /boot/initrd.img-6.12.0-15-generic 4085s W: No lz4 in /usr/bin:/sbin:/bin, using gzip 4102s Processing triggers for libc-bin (2.40-4ubuntu1) ... 4103s Processing triggers for man-db (2.13.0-1) ... 4105s Setting up plymouth-theme-ubuntu-text (24.004.60-2ubuntu5) ... 4105s Processing triggers for initramfs-tools (0.145ubuntu2) ... 4105s update-initramfs: Generating /boot/initrd.img-6.12.0-15-generic 4105s W: No lz4 in /usr/bin:/sbin:/bin, using gzip 4121s + rm /etc/apt/preferences.d/force-downgrade-to-release.pref 4121s + /usr/lib/apt/apt-helper analyze-pattern ?true 4121s + + uname -r 4121s sed s/\./\\./g 4121s + running_kernel_pattern=^linux-.*6\.12\.0-15-generic.* 4121s + apt list ?obsolete 4121s + tail -n+2 4121s + cut -d/ -f1 4121s + grep -v ^linux-.*6\.12\.0-15-generic.* 4123s + true 4123s + obsolete_pkgs= 4123s + DEBIAN_FRONTEND=noninteractive eatmydata apt-get -y purge --autoremove 4123s Reading package lists... 4123s Building dependency tree... 4123s Reading state information... 4124s Solving dependencies... 4124s The following packages will be REMOVED: 4124s libapt-pkg6.0t64* 4125s 0 upgraded, 0 newly installed, 1 to remove and 0 not upgraded. 4125s After this operation, 3725 kB disk space will be freed. 4125s (Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 109020 files and directories currently installed.) 4125s Removing libapt-pkg6.0t64:amd64 (2.9.29) ... 4125s Processing triggers for libc-bin (2.40-4ubuntu1) ... 4125s + grep -q trusty /etc/lsb-release 4125s + [ ! -d /usr/share/doc/unattended-upgrades ] 4125s + [ ! -d /usr/share/doc/lxd ] 4125s + [ ! -d /usr/share/doc/lxd-client ] 4125s + [ ! -d /usr/share/doc/snapd ] 4125s + type iptables 4125s + cat 4125s + chmod 755 /etc/rc.local 4125s + . /etc/rc.local 4125s + iptables -w -t mangle -A FORWARD -p tcp --tcp-flags SYN,RST SYN -j TCPMSS --clamp-mss-to-pmtu 4125s + iptables -A OUTPUT -d 10.255.255.1/32 -p tcp -j DROP 4125s + iptables -A OUTPUT -d 10.255.255.2/32 -p tcp -j DROP 4125s + uname -m 4125s + [ x86_64 = ppc64le ] 4125s + [ -d /run/systemd/system ] 4125s + systemd-detect-virt --quiet --vm 4125s + mkdir -p /etc/systemd/system/systemd-random-seed.service.d/ 4125s + cat 4125s + grep -q lz4 /etc/initramfs-tools/initramfs.conf 4125s + echo COMPRESS=lz4 4125s autopkgtest [00:35:28]: upgrading testbed (apt dist-upgrade and autopurge) 4125s Reading package lists... 4126s Building dependency tree... 4126s Reading state information... 4126s Calculating upgrade...Starting pkgProblemResolver with broken count: 0 4127s Starting 2 pkgProblemResolver with broken count: 0 4127s Done 4128s Entering ResolveByKeep 4128s 4128s Calculating upgrade... 4129s 0 upgraded, 0 newly installed, 0 to remove and 0 not upgraded. 4129s Reading package lists... 4129s Building dependency tree... 4129s Reading state information... 4130s Starting pkgProblemResolver with broken count: 0 4130s Starting 2 pkgProblemResolver with broken count: 0 4130s Done 4130s Solving dependencies... 4131s 0 upgraded, 0 newly installed, 0 to remove and 0 not upgraded. 4131s autopkgtest [00:35:34]: rebooting testbed after setup commands that affected boot 4135s autopkgtest-virt-ssh: WARNING: ssh connection failed. Retrying in 3 seconds... 4149s Reading package lists... 4150s Building dependency tree... 4150s Reading state information... 4150s Starting pkgProblemResolver with broken count: 0 4150s Starting 2 pkgProblemResolver with broken count: 0 4150s Done 4152s The following NEW packages will be installed: 4152s autoconf automake autopoint autotools-dev build-essential cpp cpp-14 4152s cpp-14-x86-64-linux-gnu cpp-x86-64-linux-gnu debhelper debugedit 4152s dh-autoreconf dh-python dh-strip-nondeterminism docutils-common dwz 4152s fonts-font-awesome fonts-glyphicons-halflings fonts-lato fonts-mathjax g++ 4152s g++-14 g++-14-x86-64-linux-gnu g++-x86-64-linux-gnu gcc gcc-14 4152s gcc-14-x86-64-linux-gnu gcc-x86-64-linux-gnu gettext intltool-debian 4152s libarchive-zip-perl libargon2-1 libasan8 libblas3 libcares2 libcc1-0 4152s libdebhelper-perl libfile-stripnondeterminism-perl libgcc-14-dev 4152s libgfortran5 libgomp1 libhwasan0 libisl23 libitm1 libjs-bootstrap 4152s libjs-jquery libjs-mathjax libjs-sortable-tablesort libjs-sphinxdoc 4152s libjs-sprintf-js libjs-underscore libjson-perl liblapack3 liblsan0 libmpc3 4152s libnode115 libnorm1t64 libpgm-5.3-0t64 libquadmath0 libsodium23 4152s libstdc++-14-dev libtool libtsan2 libubsan1 libzmq5 m4 node-acorn 4152s node-argparse node-balanced-match node-brace-expansion node-cjs-module-lexer 4152s node-esprima node-fortawesome-fontawesome-free node-js-yaml node-minimatch 4152s node-sprintf-js node-uglify-js node-undici node-xtend nodejs po-debconf 4152s pybuild-plugin-autopkgtest pybuild-plugin-pyproject python-dask-doc 4152s python-distributed-doc python-fsspec-doc python-numpy-doc python-pandas-doc 4152s python-tinycss2-common python3-accessible-pygments python3-alabaster 4152s python3-all python3-anyio python3-argon2 python3-arrow 4152s python3-async-generator python3-bleach python3-bs4 python3-build 4152s python3-click python3-cloudpickle python3-dask python3-dask-sphinx-theme 4152s python3-dateutil python3-decorator python3-defusedxml python3-distributed 4152s python3-doc python3-docutils python3-fastjsonschema python3-fqdn 4152s python3-fsspec python3-html5lib python3-imagesize python3-iniconfig 4152s python3-installer python3-isoduration python3-jupyter-client 4152s python3-jupyter-core python3-jupyter-events python3-jupyter-server 4152s python3-jupyter-server-terminals python3-jupyterlab-pygments python3-locket 4152s python3-mistune python3-msgpack python3-nbclient python3-nbconvert 4152s python3-nbformat python3-numpy python3-numpy-dev python3-numpydoc 4152s python3-overrides python3-packaging python3-pandas python3-pandas-lib 4152s python3-pandocfilters python3-partd python3-platformdirs python3-pluggy 4152s python3-prometheus-client python3-psutil python3-ptyprocess 4152s python3-pydata-sphinx-theme python3-pyproject-hooks python3-pytest 4152s python3-pytest-asyncio python3-pytest-rerunfailures python3-pytest-timeout 4152s python3-pythonjsonlogger python3-pytz python3-rfc3339-validator 4152s python3-rfc3986-validator python3-roman python3-send2trash python3-sniffio 4152s python3-snowballstemmer python3-sortedcollections python3-sortedcontainers 4152s python3-soupsieve python3-sphinx python3-sphinx-book-theme 4152s python3-sphinx-click python3-sphinx-design python3-tabulate python3-tblib 4152s python3-terminado python3-tinycss2 python3-toml python3-toolz 4152s python3-tornado python3-traitlets python3-tz python3-uritemplate 4152s python3-versioneer python3-webcolors python3-webencodings python3-websocket 4152s python3-wheel python3-zict python3-zmq python3.12 python3.12-minimal 4152s python3.13-doc sass-stylesheets-bulma sgml-base sphinx-common 4152s sphinx-rtd-theme-common tzdata-legacy uglifyjs xml-core 4152s 0 upgraded, 191 newly installed, 0 to remove and 0 not upgraded. 4152s Need to get 183 MB of archives. 4152s After this operation, 1054 MB of additional disk space will be used. 4152s Get:1 http://ftpmaster.internal/ubuntu plucky/main amd64 python3.12-minimal amd64 3.12.9-1 [2348 kB] 4152s Get:2 http://ftpmaster.internal/ubuntu plucky/main amd64 fonts-lato all 2.015-1 [2781 kB] 4152s Get:3 http://ftpmaster.internal/ubuntu plucky-proposed/main amd64 python3-numpy-dev amd64 1:2.2.3+ds-2 [147 kB] 4152s Get:4 http://ftpmaster.internal/ubuntu plucky/main amd64 libblas3 amd64 3.12.1-2 [359 kB] 4152s Get:5 http://ftpmaster.internal/ubuntu plucky/main amd64 libgfortran5 amd64 15-20250213-1ubuntu1 [920 kB] 4152s Get:6 http://ftpmaster.internal/ubuntu plucky/main amd64 liblapack3 amd64 3.12.1-2 [3179 kB] 4152s Get:7 http://ftpmaster.internal/ubuntu plucky-proposed/main amd64 python3-numpy amd64 1:2.2.3+ds-2 [8537 kB] 4152s Get:8 http://ftpmaster.internal/ubuntu plucky/main amd64 sgml-base all 1.31 [11.4 kB] 4152s Get:9 http://ftpmaster.internal/ubuntu plucky/main amd64 python3.12 amd64 3.12.9-1 [671 kB] 4152s Get:10 http://ftpmaster.internal/ubuntu plucky/main amd64 m4 amd64 1.4.19-5 [263 kB] 4152s Get:11 http://ftpmaster.internal/ubuntu plucky/main amd64 autoconf all 2.72-3ubuntu1 [383 kB] 4152s Get:12 http://ftpmaster.internal/ubuntu plucky/main amd64 autotools-dev all 20220109.1 [44.9 kB] 4152s Get:13 http://ftpmaster.internal/ubuntu plucky/main amd64 automake all 1:1.17-3ubuntu1 [572 kB] 4152s Get:14 http://ftpmaster.internal/ubuntu plucky/main amd64 autopoint all 0.23.1-1 [619 kB] 4152s Get:15 http://ftpmaster.internal/ubuntu plucky/main amd64 libisl23 amd64 0.27-1 [685 kB] 4152s Get:16 http://ftpmaster.internal/ubuntu plucky/main amd64 libmpc3 amd64 1.3.1-1build2 [55.3 kB] 4152s Get:17 http://ftpmaster.internal/ubuntu plucky/main amd64 cpp-14-x86-64-linux-gnu amd64 14.2.0-17ubuntu1 [11.9 MB] 4152s Get:18 http://ftpmaster.internal/ubuntu plucky/main amd64 cpp-14 amd64 14.2.0-17ubuntu1 [1032 B] 4152s Get:19 http://ftpmaster.internal/ubuntu plucky/main amd64 cpp-x86-64-linux-gnu amd64 4:14.2.0-1ubuntu1 [5586 B] 4152s Get:20 http://ftpmaster.internal/ubuntu plucky/main amd64 cpp amd64 4:14.2.0-1ubuntu1 [22.4 kB] 4152s Get:21 http://ftpmaster.internal/ubuntu plucky/main amd64 libcc1-0 amd64 15-20250213-1ubuntu1 [47.0 kB] 4152s Get:22 http://ftpmaster.internal/ubuntu plucky/main amd64 libgomp1 amd64 15-20250213-1ubuntu1 [148 kB] 4152s Get:23 http://ftpmaster.internal/ubuntu plucky/main amd64 libitm1 amd64 15-20250213-1ubuntu1 [28.5 kB] 4152s Get:24 http://ftpmaster.internal/ubuntu plucky/main amd64 libasan8 amd64 15-20250213-1ubuntu1 [3059 kB] 4152s Get:25 http://ftpmaster.internal/ubuntu plucky/main amd64 liblsan0 amd64 15-20250213-1ubuntu1 [1356 kB] 4152s Get:26 http://ftpmaster.internal/ubuntu plucky/main amd64 libtsan2 amd64 15-20250213-1ubuntu1 [2757 kB] 4152s Get:27 http://ftpmaster.internal/ubuntu plucky/main amd64 libubsan1 amd64 15-20250213-1ubuntu1 [1206 kB] 4152s Get:28 http://ftpmaster.internal/ubuntu plucky/main amd64 libhwasan0 amd64 15-20250213-1ubuntu1 [1678 kB] 4152s Get:29 http://ftpmaster.internal/ubuntu plucky/main amd64 libquadmath0 amd64 15-20250213-1ubuntu1 [152 kB] 4152s Get:30 http://ftpmaster.internal/ubuntu plucky/main amd64 libgcc-14-dev amd64 14.2.0-17ubuntu1 [2814 kB] 4152s Get:31 http://ftpmaster.internal/ubuntu plucky/main amd64 gcc-14-x86-64-linux-gnu amd64 14.2.0-17ubuntu1 [23.3 MB] 4152s Get:32 http://ftpmaster.internal/ubuntu plucky/main amd64 gcc-14 amd64 14.2.0-17ubuntu1 [536 kB] 4152s Get:33 http://ftpmaster.internal/ubuntu plucky/main amd64 gcc-x86-64-linux-gnu amd64 4:14.2.0-1ubuntu1 [1208 B] 4152s Get:34 http://ftpmaster.internal/ubuntu plucky/main amd64 gcc amd64 4:14.2.0-1ubuntu1 [5004 B] 4152s Get:35 http://ftpmaster.internal/ubuntu plucky/main amd64 libstdc++-14-dev amd64 14.2.0-17ubuntu1 [2507 kB] 4152s Get:36 http://ftpmaster.internal/ubuntu plucky/main amd64 g++-14-x86-64-linux-gnu amd64 14.2.0-17ubuntu1 [13.4 MB] 4152s Get:37 http://ftpmaster.internal/ubuntu plucky/main amd64 g++-14 amd64 14.2.0-17ubuntu1 [21.8 kB] 4152s Get:38 http://ftpmaster.internal/ubuntu plucky/main amd64 g++-x86-64-linux-gnu amd64 4:14.2.0-1ubuntu1 [968 B] 4152s Get:39 http://ftpmaster.internal/ubuntu plucky/main amd64 g++ amd64 4:14.2.0-1ubuntu1 [1100 B] 4152s Get:40 http://ftpmaster.internal/ubuntu plucky/main amd64 build-essential amd64 12.10ubuntu1 [4928 B] 4152s Get:41 http://ftpmaster.internal/ubuntu plucky/main amd64 libdebhelper-perl all 13.24.1ubuntu2 [95.4 kB] 4152s Get:42 http://ftpmaster.internal/ubuntu plucky/main amd64 libtool all 2.5.4-3build1 [168 kB] 4152s Get:43 http://ftpmaster.internal/ubuntu plucky/main amd64 dh-autoreconf all 20 [16.1 kB] 4152s Get:44 http://ftpmaster.internal/ubuntu plucky/main amd64 libarchive-zip-perl all 1.68-1 [90.2 kB] 4152s Get:45 http://ftpmaster.internal/ubuntu plucky/main amd64 libfile-stripnondeterminism-perl all 1.14.1-2 [20.3 kB] 4152s Get:46 http://ftpmaster.internal/ubuntu plucky/main amd64 dh-strip-nondeterminism all 1.14.1-2 [5064 B] 4152s Get:47 http://ftpmaster.internal/ubuntu plucky/main amd64 debugedit amd64 1:5.1-2 [47.0 kB] 4152s Get:48 http://ftpmaster.internal/ubuntu plucky/main amd64 dwz amd64 0.15-1build6 [115 kB] 4152s Get:49 http://ftpmaster.internal/ubuntu plucky/main amd64 gettext amd64 0.23.1-1 [1086 kB] 4152s Get:50 http://ftpmaster.internal/ubuntu plucky/main amd64 intltool-debian all 0.35.0+20060710.6 [23.2 kB] 4152s Get:51 http://ftpmaster.internal/ubuntu plucky/main amd64 po-debconf all 1.0.21+nmu1 [233 kB] 4152s Get:52 http://ftpmaster.internal/ubuntu plucky/main amd64 debhelper all 13.24.1ubuntu2 [895 kB] 4153s Get:53 http://ftpmaster.internal/ubuntu plucky/universe amd64 dh-python all 6.20250108 [117 kB] 4153s Get:54 http://ftpmaster.internal/ubuntu plucky/main amd64 xml-core all 0.19 [20.3 kB] 4153s Get:55 http://ftpmaster.internal/ubuntu plucky/main amd64 docutils-common all 0.21.2+dfsg-2 [131 kB] 4153s Get:56 http://ftpmaster.internal/ubuntu plucky/main amd64 fonts-font-awesome all 5.0.10+really4.7.0~dfsg-4.1 [516 kB] 4153s Get:57 http://ftpmaster.internal/ubuntu plucky/universe amd64 fonts-glyphicons-halflings all 1.009~3.4.1+dfsg-3 [118 kB] 4153s Get:58 http://ftpmaster.internal/ubuntu plucky/main amd64 fonts-mathjax all 2.7.9+dfsg-1 [2208 kB] 4153s Get:59 http://ftpmaster.internal/ubuntu plucky/main amd64 libargon2-1 amd64 0~20190702+dfsg-4build1 [20.8 kB] 4153s Get:60 http://ftpmaster.internal/ubuntu plucky/main amd64 libcares2 amd64 1.34.4-2.1 [109 kB] 4153s Get:61 http://ftpmaster.internal/ubuntu plucky/universe amd64 libjs-bootstrap all 3.4.1+dfsg-3 [129 kB] 4153s Get:62 http://ftpmaster.internal/ubuntu plucky/main amd64 libjs-jquery all 3.6.1+dfsg+~3.5.14-1 [328 kB] 4153s Get:63 http://ftpmaster.internal/ubuntu plucky/universe amd64 libjs-sortable-tablesort all 3.1.0+ds-2 [12.6 kB] 4153s Get:64 http://ftpmaster.internal/ubuntu plucky/main amd64 libjs-underscore all 1.13.4~dfsg+~1.11.4-3 [118 kB] 4153s Get:65 http://ftpmaster.internal/ubuntu plucky/main amd64 libjs-sphinxdoc all 8.1.3-4 [30.9 kB] 4153s Get:66 http://ftpmaster.internal/ubuntu plucky/universe amd64 libjs-sprintf-js all 1.1.2+ds1+~1.1.2-1 [12.8 kB] 4153s Get:67 http://ftpmaster.internal/ubuntu plucky/main amd64 libjson-perl all 4.10000-1 [81.9 kB] 4153s Get:68 http://ftpmaster.internal/ubuntu plucky/universe amd64 node-xtend all 4.0.2-3 [3902 B] 4153s Get:69 http://ftpmaster.internal/ubuntu plucky/universe amd64 nodejs amd64 20.18.1+dfsg-1ubuntu2 [334 kB] 4153s Get:70 http://ftpmaster.internal/ubuntu plucky/universe amd64 node-acorn all 8.8.1+ds+~cs25.17.7-2 [115 kB] 4153s Get:71 http://ftpmaster.internal/ubuntu plucky/universe amd64 node-cjs-module-lexer all 1.2.3+dfsg-1 [32.1 kB] 4153s Get:72 http://ftpmaster.internal/ubuntu plucky/universe amd64 node-balanced-match all 2.0.0-1 [4910 B] 4153s Get:73 http://ftpmaster.internal/ubuntu plucky/universe amd64 node-brace-expansion all 2.0.1+~1.1.0-1 [8072 B] 4153s Get:74 http://ftpmaster.internal/ubuntu plucky/universe amd64 node-minimatch all 9.0.3-5 [78.2 kB] 4153s Get:75 http://ftpmaster.internal/ubuntu plucky/universe amd64 node-undici all 7.3.0+dfsg1+~cs24.12.11-1 [341 kB] 4153s Get:76 http://ftpmaster.internal/ubuntu plucky/universe amd64 libnode115 amd64 20.18.1+dfsg-1ubuntu2 [13.3 MB] 4153s Get:77 http://ftpmaster.internal/ubuntu plucky/universe amd64 libnorm1t64 amd64 1.5.9+dfsg-3.1build1 [154 kB] 4153s Get:78 http://ftpmaster.internal/ubuntu plucky/universe amd64 libpgm-5.3-0t64 amd64 5.3.128~dfsg-2.1build1 [167 kB] 4153s Get:79 http://ftpmaster.internal/ubuntu plucky/main amd64 libsodium23 amd64 1.0.18-1build3 [161 kB] 4153s Get:80 http://ftpmaster.internal/ubuntu plucky/universe amd64 libzmq5 amd64 4.3.5-1build2 [260 kB] 4153s Get:81 http://ftpmaster.internal/ubuntu plucky/universe amd64 node-esprima all 4.0.1+ds+~4.0.3-2 [69.3 kB] 4153s Get:82 http://ftpmaster.internal/ubuntu plucky/universe amd64 node-fortawesome-fontawesome-free all 6.7.2+ds1-1 [1653 kB] 4153s Get:83 http://ftpmaster.internal/ubuntu plucky/universe amd64 node-sprintf-js all 1.1.2+ds1+~1.1.2-1 [3916 B] 4153s Get:84 http://ftpmaster.internal/ubuntu plucky/universe amd64 node-argparse all 2.0.1-2 [33.2 kB] 4153s Get:85 http://ftpmaster.internal/ubuntu plucky/universe amd64 node-js-yaml all 4.1.0+dfsg+~4.0.5-7 [61.9 kB] 4153s Get:86 http://ftpmaster.internal/ubuntu plucky/universe amd64 node-uglify-js all 3.17.4-2 [205 kB] 4153s Get:87 http://ftpmaster.internal/ubuntu plucky/universe amd64 pybuild-plugin-autopkgtest all 6.20250108 [1744 B] 4153s Get:88 http://ftpmaster.internal/ubuntu plucky/main amd64 python3-packaging all 24.2-1 [51.5 kB] 4153s Get:89 http://ftpmaster.internal/ubuntu plucky/universe amd64 python3-pyproject-hooks all 1.2.0-1 [10.2 kB] 4153s Get:90 http://ftpmaster.internal/ubuntu plucky/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 4153s Get:91 http://ftpmaster.internal/ubuntu plucky/universe amd64 python3-wheel all 0.45.1-1 [57.7 kB] 4153s Get:92 http://ftpmaster.internal/ubuntu plucky/universe amd64 python3-build all 1.2.2-1 [31.0 kB] 4153s Get:93 http://ftpmaster.internal/ubuntu plucky/universe amd64 python3-installer all 0.7.0+dfsg1-3 [17.4 kB] 4153s Get:94 http://ftpmaster.internal/ubuntu plucky/universe amd64 pybuild-plugin-pyproject all 6.20250108 [1726 B] 4153s Get:95 http://ftpmaster.internal/ubuntu plucky/main amd64 libjs-mathjax all 2.7.9+dfsg-1 [5665 kB] 4153s Get:96 http://ftpmaster.internal/ubuntu plucky/universe amd64 python-dask-doc all 2024.12.1+dfsg-2 [10.4 MB] 4153s Get:97 http://ftpmaster.internal/ubuntu plucky/main amd64 sphinx-rtd-theme-common all 3.0.2+dfsg-2 [1014 kB] 4153s Get:98 http://ftpmaster.internal/ubuntu plucky/universe amd64 python-fsspec-doc all 2025.2.0-1 [320 kB] 4153s Get:99 http://ftpmaster.internal/ubuntu plucky-proposed/main amd64 python-numpy-doc all 1:2.2.3+ds-2 [5757 kB] 4153s Get:100 http://ftpmaster.internal/ubuntu plucky/universe amd64 python-pandas-doc all 2.2.3+dfsg-8 [10.7 MB] 4153s Get:101 http://ftpmaster.internal/ubuntu plucky/main amd64 python3.13-doc all 3.13.2-1 [14.2 MB] 4153s Get:102 http://ftpmaster.internal/ubuntu plucky/main amd64 python3-doc all 3.13.1-1~exp2 [10.4 kB] 4153s Get:103 http://ftpmaster.internal/ubuntu plucky/universe amd64 sass-stylesheets-bulma all 0.9.4~ds-1 [113 kB] 4153s Get:104 http://ftpmaster.internal/ubuntu plucky/universe amd64 python-distributed-doc all 2024.12.1+ds-1 [3147 kB] 4153s Get:105 http://ftpmaster.internal/ubuntu plucky/universe amd64 python-tinycss2-common all 1.4.0-1 [47.0 kB] 4153s Get:106 http://ftpmaster.internal/ubuntu plucky/universe amd64 python3-accessible-pygments all 0.0.5-2 [790 kB] 4153s Get:107 http://ftpmaster.internal/ubuntu plucky/main amd64 python3-all amd64 3.13.1-1~exp2 [894 B] 4153s Get:108 http://ftpmaster.internal/ubuntu plucky/universe amd64 python3-sniffio all 1.3.1-1 [7262 B] 4153s Get:109 http://ftpmaster.internal/ubuntu plucky/universe amd64 python3-anyio all 4.7.0-1 [61.6 kB] 4153s Get:110 http://ftpmaster.internal/ubuntu plucky/universe amd64 python3-argon2 amd64 21.1.0-3 [21.4 kB] 4153s Get:111 http://ftpmaster.internal/ubuntu plucky/main amd64 python3-dateutil all 2.9.0-3 [80.2 kB] 4153s Get:112 http://ftpmaster.internal/ubuntu plucky/main amd64 python3-arrow all 1.3.0-1.1ubuntu1 [56.1 kB] 4153s Get:113 http://ftpmaster.internal/ubuntu plucky/universe amd64 python3-async-generator all 1.10-4 [17.5 kB] 4153s Get:114 http://ftpmaster.internal/ubuntu plucky/main amd64 python3-webencodings all 0.5.1-5 [11.5 kB] 4153s Get:115 http://ftpmaster.internal/ubuntu plucky/main amd64 python3-html5lib all 1.2-1 [90.8 kB] 4153s Get:116 http://ftpmaster.internal/ubuntu plucky/universe amd64 python3-bleach all 6.2.0-1 [43.9 kB] 4153s Get:117 http://ftpmaster.internal/ubuntu plucky/main amd64 python3-soupsieve all 2.6-1 [33.0 kB] 4153s Get:118 http://ftpmaster.internal/ubuntu plucky/main amd64 python3-bs4 all 4.13.3-1 [136 kB] 4153s Get:119 http://ftpmaster.internal/ubuntu plucky/main amd64 python3-click all 8.1.8-1 [79.8 kB] 4153s Get:120 http://ftpmaster.internal/ubuntu plucky/universe amd64 python3-cloudpickle all 3.1.1-1 [22.4 kB] 4153s Get:121 http://ftpmaster.internal/ubuntu plucky/universe amd64 python3-fsspec all 2025.2.0-1 [211 kB] 4153s Get:122 http://ftpmaster.internal/ubuntu plucky/universe amd64 python3-toolz all 1.0.0-2 [45.0 kB] 4153s Get:123 http://ftpmaster.internal/ubuntu plucky/universe amd64 python3-locket all 1.0.0-2 [5872 B] 4153s Get:124 http://ftpmaster.internal/ubuntu plucky/universe amd64 python3-partd all 1.4.2-1 [15.7 kB] 4153s Get:125 http://ftpmaster.internal/ubuntu plucky/universe amd64 python3-dask all 2024.12.1+dfsg-2 [875 kB] 4153s Get:126 http://ftpmaster.internal/ubuntu plucky/main amd64 python3-roman all 5.0-1 [10.3 kB] 4153s Get:127 http://ftpmaster.internal/ubuntu plucky/main amd64 python3-docutils all 0.21.2+dfsg-2 [409 kB] 4153s Get:128 http://ftpmaster.internal/ubuntu plucky/main amd64 python3-defusedxml all 0.7.1-3 [42.2 kB] 4153s Get:129 http://ftpmaster.internal/ubuntu plucky/main amd64 sphinx-common all 8.1.3-4 [663 kB] 4153s Get:130 http://ftpmaster.internal/ubuntu plucky/main amd64 python3-alabaster all 0.7.16-0.1 [18.5 kB] 4153s Get:131 http://ftpmaster.internal/ubuntu plucky/main amd64 python3-imagesize all 1.4.1-1 [6844 B] 4153s Get:132 http://ftpmaster.internal/ubuntu plucky/main amd64 python3-snowballstemmer all 2.2.0-4build1 [59.8 kB] 4153s Get:133 http://ftpmaster.internal/ubuntu plucky/main amd64 python3-sphinx all 8.1.3-4 [474 kB] 4153s Get:134 http://ftpmaster.internal/ubuntu plucky/universe amd64 python3-pydata-sphinx-theme all 0.16.1+dfsg-3 [959 kB] 4153s Get:135 http://ftpmaster.internal/ubuntu plucky/universe amd64 python3-sphinx-book-theme all 0.1.7-3 [42.8 kB] 4153s Get:136 http://ftpmaster.internal/ubuntu plucky/universe amd64 python3-dask-sphinx-theme all 3.0.5-2 [15.9 kB] 4153s Get:137 http://ftpmaster.internal/ubuntu plucky/main amd64 python3-decorator all 5.1.1-5 [10.1 kB] 4153s Get:138 http://ftpmaster.internal/ubuntu plucky/main amd64 python3-msgpack amd64 1.0.3-3build3 [113 kB] 4153s Get:139 http://ftpmaster.internal/ubuntu plucky/main amd64 python3-psutil amd64 5.9.8-2build3 [196 kB] 4153s Get:140 http://ftpmaster.internal/ubuntu plucky/main amd64 python3-sortedcontainers all 2.4.0-2 [27.6 kB] 4153s Get:141 http://ftpmaster.internal/ubuntu plucky/universe amd64 python3-tblib all 3.0.0-6 [13.0 kB] 4153s Get:142 http://ftpmaster.internal/ubuntu plucky/main amd64 python3-tornado amd64 6.4.2-1 [299 kB] 4153s Get:143 http://ftpmaster.internal/ubuntu plucky/universe amd64 python3-zict all 3.0.0-2ubuntu1 [30.4 kB] 4153s Get:144 http://ftpmaster.internal/ubuntu plucky/universe amd64 python3-distributed all 2024.12.1+ds-1 [1019 kB] 4153s Get:145 http://ftpmaster.internal/ubuntu plucky/universe amd64 python3-fastjsonschema all 2.21.1-1 [20.4 kB] 4153s Get:146 http://ftpmaster.internal/ubuntu plucky/universe amd64 python3-fqdn all 1.5.1-2 [7688 B] 4153s Get:147 http://ftpmaster.internal/ubuntu plucky/universe amd64 python3-iniconfig all 1.1.1-2 [6024 B] 4153s Get:148 http://ftpmaster.internal/ubuntu plucky/universe amd64 python3-isoduration all 20.11.0+git20211126.ae0bd61-2 [12.5 kB] 4153s Get:149 http://ftpmaster.internal/ubuntu plucky/main amd64 python3-platformdirs all 4.3.6-1 [16.8 kB] 4153s Get:150 http://ftpmaster.internal/ubuntu plucky/universe amd64 python3-traitlets all 5.14.3+really5.14.3-1 [71.5 kB] 4153s Get:151 http://ftpmaster.internal/ubuntu plucky/universe amd64 python3-jupyter-core all 5.7.2-5 [28.1 kB] 4153s Get:152 http://ftpmaster.internal/ubuntu plucky/universe amd64 python3-zmq amd64 26.2.1-1 [226 kB] 4153s Get:153 http://ftpmaster.internal/ubuntu plucky/universe amd64 python3-jupyter-client all 8.6.3-2 [78.5 kB] 4153s Get:154 http://ftpmaster.internal/ubuntu plucky/universe amd64 python3-pythonjsonlogger all 3.2.1-1 [12.3 kB] 4154s Get:155 http://ftpmaster.internal/ubuntu plucky/universe amd64 python3-rfc3339-validator all 0.1.4-2 [3930 B] 4154s Get:156 http://ftpmaster.internal/ubuntu plucky/universe amd64 python3-rfc3986-validator all 0.1.1-2 [4758 B] 4154s Get:157 http://ftpmaster.internal/ubuntu plucky/universe amd64 python3-uritemplate all 4.1.1-3 [9762 B] 4154s Get:158 http://ftpmaster.internal/ubuntu plucky/universe amd64 python3-webcolors all 1.13-1 [13.6 kB] 4154s Get:159 http://ftpmaster.internal/ubuntu plucky/universe amd64 python3-jupyter-events all 0.10.0-4 [15.6 kB] 4154s Get:160 http://ftpmaster.internal/ubuntu plucky/main amd64 python3-ptyprocess all 0.7.0-6 [14.8 kB] 4154s Get:161 http://ftpmaster.internal/ubuntu plucky/universe amd64 python3-terminado all 0.18.1-1 [13.2 kB] 4154s Get:162 http://ftpmaster.internal/ubuntu plucky/universe amd64 python3-jupyter-server-terminals all 0.5.3-2 [10.9 kB] 4154s Get:163 http://ftpmaster.internal/ubuntu plucky/universe amd64 python3-tinycss2 all 1.4.0-1 [22.5 kB] 4154s Get:164 http://ftpmaster.internal/ubuntu plucky/universe amd64 python3-jupyterlab-pygments all 0.2.2-3 [6054 B] 4154s Get:165 http://ftpmaster.internal/ubuntu plucky/universe amd64 python3-mistune all 3.0.2-2 [32.9 kB] 4154s Get:166 http://ftpmaster.internal/ubuntu plucky/universe amd64 python3-nbformat all 5.9.1-1 [41.2 kB] 4154s Get:167 http://ftpmaster.internal/ubuntu plucky/universe amd64 python3-nbclient all 0.8.0-2 [53.9 kB] 4154s Get:168 http://ftpmaster.internal/ubuntu plucky/universe amd64 python3-pandocfilters all 1.5.1-1 [23.6 kB] 4154s Get:169 http://ftpmaster.internal/ubuntu plucky/universe amd64 python3-nbconvert all 7.16.6-1 [140 kB] 4154s Get:170 http://ftpmaster.internal/ubuntu plucky/universe amd64 python3-overrides all 7.7.0-2 [14.4 kB] 4154s Get:171 http://ftpmaster.internal/ubuntu plucky/main amd64 python3-prometheus-client all 0.21.1+ds1-1 [45.8 kB] 4154s Get:172 http://ftpmaster.internal/ubuntu plucky/universe amd64 python3-send2trash all 1.8.3-1 [14.6 kB] 4154s Get:173 http://ftpmaster.internal/ubuntu plucky/universe amd64 python3-websocket all 1.8.0-2 [38.5 kB] 4154s Get:174 http://ftpmaster.internal/ubuntu plucky/universe amd64 python3-jupyter-server all 2.14.2-5 [183 kB] 4154s Get:175 http://ftpmaster.internal/ubuntu plucky/main amd64 python3-tabulate all 0.9.0-1 [45.3 kB] 4154s Get:176 http://ftpmaster.internal/ubuntu plucky/universe amd64 python3-numpydoc all 1.8.0-1 [52.4 kB] 4154s Get:177 http://ftpmaster.internal/ubuntu plucky/main amd64 python3-pytz all 2025.1-3 [162 kB] 4154s Get:178 http://ftpmaster.internal/ubuntu plucky/main amd64 python3-tz all 2025.1-3 [1866 B] 4154s Get:179 http://ftpmaster.internal/ubuntu plucky/universe amd64 python3-pandas-lib amd64 2.2.3+dfsg-8 [8248 kB] 4154s Get:180 http://ftpmaster.internal/ubuntu plucky/universe amd64 python3-pandas all 2.2.3+dfsg-8 [3112 kB] 4154s Get:181 http://ftpmaster.internal/ubuntu plucky/universe amd64 python3-pluggy all 1.5.0-1 [21.0 kB] 4154s Get:182 http://ftpmaster.internal/ubuntu plucky/universe amd64 python3-pytest all 8.3.4-1 [252 kB] 4154s Get:183 http://ftpmaster.internal/ubuntu plucky/universe amd64 python3-pytest-asyncio all 0.25.1-1 [17.0 kB] 4154s Get:184 http://ftpmaster.internal/ubuntu plucky/universe amd64 python3-pytest-rerunfailures all 15.0-1 [13.9 kB] 4154s Get:185 http://ftpmaster.internal/ubuntu plucky/universe amd64 python3-pytest-timeout all 2.3.1-1 [22.1 kB] 4154s Get:186 http://ftpmaster.internal/ubuntu plucky/universe amd64 python3-sortedcollections all 2.1.0-2 [9720 B] 4154s Get:187 http://ftpmaster.internal/ubuntu plucky/universe amd64 python3-sphinx-click all 6.0.0-2 [10.2 kB] 4154s Get:188 http://ftpmaster.internal/ubuntu plucky/universe amd64 python3-sphinx-design all 0.6.1-1 [894 kB] 4154s Get:189 http://ftpmaster.internal/ubuntu plucky/universe amd64 python3-versioneer all 0.29-1 [44.0 kB] 4154s Get:190 http://ftpmaster.internal/ubuntu plucky/main amd64 tzdata-legacy all 2025a-2ubuntu1 [99.2 kB] 4154s Get:191 http://ftpmaster.internal/ubuntu plucky/universe amd64 uglifyjs all 3.17.4-2 [10.1 kB] 4155s Fetched 183 MB in 2s (92.6 MB/s) 4155s Selecting previously unselected package python3.12-minimal. 4155s (Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 108970 files and directories currently installed.) 4155s Preparing to unpack .../000-python3.12-minimal_3.12.9-1_amd64.deb ... 4155s Unpacking python3.12-minimal (3.12.9-1) ... 4155s Selecting previously unselected package fonts-lato. 4155s Preparing to unpack .../001-fonts-lato_2.015-1_all.deb ... 4155s Unpacking fonts-lato (2.015-1) ... 4155s Selecting previously unselected package python3-numpy-dev:amd64. 4155s Preparing to unpack .../002-python3-numpy-dev_1%3a2.2.3+ds-2_amd64.deb ... 4155s Unpacking python3-numpy-dev:amd64 (1:2.2.3+ds-2) ... 4155s Selecting previously unselected package libblas3:amd64. 4156s Preparing to unpack .../003-libblas3_3.12.1-2_amd64.deb ... 4156s Unpacking libblas3:amd64 (3.12.1-2) ... 4156s Selecting previously unselected package libgfortran5:amd64. 4156s Preparing to unpack .../004-libgfortran5_15-20250213-1ubuntu1_amd64.deb ... 4156s Unpacking libgfortran5:amd64 (15-20250213-1ubuntu1) ... 4156s Selecting previously unselected package liblapack3:amd64. 4156s Preparing to unpack .../005-liblapack3_3.12.1-2_amd64.deb ... 4156s Unpacking liblapack3:amd64 (3.12.1-2) ... 4156s Selecting previously unselected package python3-numpy. 4156s Preparing to unpack .../006-python3-numpy_1%3a2.2.3+ds-2_amd64.deb ... 4156s Unpacking python3-numpy (1:2.2.3+ds-2) ... 4156s Selecting previously unselected package sgml-base. 4156s Preparing to unpack .../007-sgml-base_1.31_all.deb ... 4156s Unpacking sgml-base (1.31) ... 4156s Selecting previously unselected package python3.12. 4156s Preparing to unpack .../008-python3.12_3.12.9-1_amd64.deb ... 4156s Unpacking python3.12 (3.12.9-1) ... 4156s Selecting previously unselected package m4. 4156s Preparing to unpack .../009-m4_1.4.19-5_amd64.deb ... 4156s Unpacking m4 (1.4.19-5) ... 4157s Selecting previously unselected package autoconf. 4157s Preparing to unpack .../010-autoconf_2.72-3ubuntu1_all.deb ... 4157s Unpacking autoconf (2.72-3ubuntu1) ... 4157s Selecting previously unselected package autotools-dev. 4157s Preparing to unpack .../011-autotools-dev_20220109.1_all.deb ... 4157s Unpacking autotools-dev (20220109.1) ... 4157s Selecting previously unselected package automake. 4157s Preparing to unpack .../012-automake_1%3a1.17-3ubuntu1_all.deb ... 4157s Unpacking automake (1:1.17-3ubuntu1) ... 4157s Selecting previously unselected package autopoint. 4157s Preparing to unpack .../013-autopoint_0.23.1-1_all.deb ... 4157s Unpacking autopoint (0.23.1-1) ... 4157s Selecting previously unselected package libisl23:amd64. 4157s Preparing to unpack .../014-libisl23_0.27-1_amd64.deb ... 4157s Unpacking libisl23:amd64 (0.27-1) ... 4157s Selecting previously unselected package libmpc3:amd64. 4157s Preparing to unpack .../015-libmpc3_1.3.1-1build2_amd64.deb ... 4157s Unpacking libmpc3:amd64 (1.3.1-1build2) ... 4157s Selecting previously unselected package cpp-14-x86-64-linux-gnu. 4157s Preparing to unpack .../016-cpp-14-x86-64-linux-gnu_14.2.0-17ubuntu1_amd64.deb ... 4157s Unpacking cpp-14-x86-64-linux-gnu (14.2.0-17ubuntu1) ... 4157s Selecting previously unselected package cpp-14. 4157s Preparing to unpack .../017-cpp-14_14.2.0-17ubuntu1_amd64.deb ... 4157s Unpacking cpp-14 (14.2.0-17ubuntu1) ... 4157s Selecting previously unselected package cpp-x86-64-linux-gnu. 4157s Preparing to unpack .../018-cpp-x86-64-linux-gnu_4%3a14.2.0-1ubuntu1_amd64.deb ... 4157s Unpacking cpp-x86-64-linux-gnu (4:14.2.0-1ubuntu1) ... 4157s Selecting previously unselected package cpp. 4157s Preparing to unpack .../019-cpp_4%3a14.2.0-1ubuntu1_amd64.deb ... 4157s Unpacking cpp (4:14.2.0-1ubuntu1) ... 4157s Selecting previously unselected package libcc1-0:amd64. 4157s Preparing to unpack .../020-libcc1-0_15-20250213-1ubuntu1_amd64.deb ... 4157s Unpacking libcc1-0:amd64 (15-20250213-1ubuntu1) ... 4157s Selecting previously unselected package libgomp1:amd64. 4157s Preparing to unpack .../021-libgomp1_15-20250213-1ubuntu1_amd64.deb ... 4157s Unpacking libgomp1:amd64 (15-20250213-1ubuntu1) ... 4157s Selecting previously unselected package libitm1:amd64. 4158s Preparing to unpack .../022-libitm1_15-20250213-1ubuntu1_amd64.deb ... 4158s Unpacking libitm1:amd64 (15-20250213-1ubuntu1) ... 4158s Selecting previously unselected package libasan8:amd64. 4158s Preparing to unpack .../023-libasan8_15-20250213-1ubuntu1_amd64.deb ... 4158s Unpacking libasan8:amd64 (15-20250213-1ubuntu1) ... 4158s Selecting previously unselected package liblsan0:amd64. 4158s Preparing to unpack .../024-liblsan0_15-20250213-1ubuntu1_amd64.deb ... 4158s Unpacking liblsan0:amd64 (15-20250213-1ubuntu1) ... 4158s Selecting previously unselected package libtsan2:amd64. 4158s Preparing to unpack .../025-libtsan2_15-20250213-1ubuntu1_amd64.deb ... 4158s Unpacking libtsan2:amd64 (15-20250213-1ubuntu1) ... 4158s Selecting previously unselected package libubsan1:amd64. 4158s Preparing to unpack .../026-libubsan1_15-20250213-1ubuntu1_amd64.deb ... 4158s Unpacking libubsan1:amd64 (15-20250213-1ubuntu1) ... 4158s Selecting previously unselected package libhwasan0:amd64. 4158s Preparing to unpack .../027-libhwasan0_15-20250213-1ubuntu1_amd64.deb ... 4158s Unpacking libhwasan0:amd64 (15-20250213-1ubuntu1) ... 4158s Selecting previously unselected package libquadmath0:amd64. 4158s Preparing to unpack .../028-libquadmath0_15-20250213-1ubuntu1_amd64.deb ... 4158s Unpacking libquadmath0:amd64 (15-20250213-1ubuntu1) ... 4158s Selecting previously unselected package libgcc-14-dev:amd64. 4158s Preparing to unpack .../029-libgcc-14-dev_14.2.0-17ubuntu1_amd64.deb ... 4158s Unpacking libgcc-14-dev:amd64 (14.2.0-17ubuntu1) ... 4158s Selecting previously unselected package gcc-14-x86-64-linux-gnu. 4158s Preparing to unpack .../030-gcc-14-x86-64-linux-gnu_14.2.0-17ubuntu1_amd64.deb ... 4158s Unpacking gcc-14-x86-64-linux-gnu (14.2.0-17ubuntu1) ... 4159s Selecting previously unselected package gcc-14. 4159s Preparing to unpack .../031-gcc-14_14.2.0-17ubuntu1_amd64.deb ... 4159s Unpacking gcc-14 (14.2.0-17ubuntu1) ... 4159s Selecting previously unselected package gcc-x86-64-linux-gnu. 4159s Preparing to unpack .../032-gcc-x86-64-linux-gnu_4%3a14.2.0-1ubuntu1_amd64.deb ... 4159s Unpacking gcc-x86-64-linux-gnu (4:14.2.0-1ubuntu1) ... 4159s Selecting previously unselected package gcc. 4159s Preparing to unpack .../033-gcc_4%3a14.2.0-1ubuntu1_amd64.deb ... 4159s Unpacking gcc (4:14.2.0-1ubuntu1) ... 4159s Selecting previously unselected package libstdc++-14-dev:amd64. 4159s Preparing to unpack .../034-libstdc++-14-dev_14.2.0-17ubuntu1_amd64.deb ... 4159s Unpacking libstdc++-14-dev:amd64 (14.2.0-17ubuntu1) ... 4159s Selecting previously unselected package g++-14-x86-64-linux-gnu. 4159s Preparing to unpack .../035-g++-14-x86-64-linux-gnu_14.2.0-17ubuntu1_amd64.deb ... 4159s Unpacking g++-14-x86-64-linux-gnu (14.2.0-17ubuntu1) ... 4160s Selecting previously unselected package g++-14. 4160s Preparing to unpack .../036-g++-14_14.2.0-17ubuntu1_amd64.deb ... 4160s Unpacking g++-14 (14.2.0-17ubuntu1) ... 4160s Selecting previously unselected package g++-x86-64-linux-gnu. 4160s Preparing to unpack .../037-g++-x86-64-linux-gnu_4%3a14.2.0-1ubuntu1_amd64.deb ... 4160s Unpacking g++-x86-64-linux-gnu (4:14.2.0-1ubuntu1) ... 4160s Selecting previously unselected package g++. 4160s Preparing to unpack .../038-g++_4%3a14.2.0-1ubuntu1_amd64.deb ... 4160s Unpacking g++ (4:14.2.0-1ubuntu1) ... 4160s Selecting previously unselected package build-essential. 4160s Preparing to unpack .../039-build-essential_12.10ubuntu1_amd64.deb ... 4160s Unpacking build-essential (12.10ubuntu1) ... 4160s Selecting previously unselected package libdebhelper-perl. 4160s Preparing to unpack .../040-libdebhelper-perl_13.24.1ubuntu2_all.deb ... 4160s Unpacking libdebhelper-perl (13.24.1ubuntu2) ... 4160s Selecting previously unselected package libtool. 4160s Preparing to unpack .../041-libtool_2.5.4-3build1_all.deb ... 4160s Unpacking libtool (2.5.4-3build1) ... 4160s Selecting previously unselected package dh-autoreconf. 4160s Preparing to unpack .../042-dh-autoreconf_20_all.deb ... 4160s Unpacking dh-autoreconf (20) ... 4160s Selecting previously unselected package libarchive-zip-perl. 4160s Preparing to unpack .../043-libarchive-zip-perl_1.68-1_all.deb ... 4160s Unpacking libarchive-zip-perl (1.68-1) ... 4160s Selecting previously unselected package libfile-stripnondeterminism-perl. 4160s Preparing to unpack .../044-libfile-stripnondeterminism-perl_1.14.1-2_all.deb ... 4160s Unpacking libfile-stripnondeterminism-perl (1.14.1-2) ... 4160s Selecting previously unselected package dh-strip-nondeterminism. 4160s Preparing to unpack .../045-dh-strip-nondeterminism_1.14.1-2_all.deb ... 4160s Unpacking dh-strip-nondeterminism (1.14.1-2) ... 4160s Selecting previously unselected package debugedit. 4160s Preparing to unpack .../046-debugedit_1%3a5.1-2_amd64.deb ... 4160s Unpacking debugedit (1:5.1-2) ... 4160s Selecting previously unselected package dwz. 4160s Preparing to unpack .../047-dwz_0.15-1build6_amd64.deb ... 4160s Unpacking dwz (0.15-1build6) ... 4160s Selecting previously unselected package gettext. 4160s Preparing to unpack .../048-gettext_0.23.1-1_amd64.deb ... 4160s Unpacking gettext (0.23.1-1) ... 4160s Selecting previously unselected package intltool-debian. 4160s Preparing to unpack .../049-intltool-debian_0.35.0+20060710.6_all.deb ... 4160s Unpacking intltool-debian (0.35.0+20060710.6) ... 4160s Selecting previously unselected package po-debconf. 4160s Preparing to unpack .../050-po-debconf_1.0.21+nmu1_all.deb ... 4160s Unpacking po-debconf (1.0.21+nmu1) ... 4160s Selecting previously unselected package debhelper. 4160s Preparing to unpack .../051-debhelper_13.24.1ubuntu2_all.deb ... 4160s Unpacking debhelper (13.24.1ubuntu2) ... 4161s Selecting previously unselected package dh-python. 4161s Preparing to unpack .../052-dh-python_6.20250108_all.deb ... 4161s Unpacking dh-python (6.20250108) ... 4161s Selecting previously unselected package xml-core. 4161s Preparing to unpack .../053-xml-core_0.19_all.deb ... 4161s Unpacking xml-core (0.19) ... 4161s Selecting previously unselected package docutils-common. 4161s Preparing to unpack .../054-docutils-common_0.21.2+dfsg-2_all.deb ... 4161s Unpacking docutils-common (0.21.2+dfsg-2) ... 4161s Selecting previously unselected package fonts-font-awesome. 4161s Preparing to unpack .../055-fonts-font-awesome_5.0.10+really4.7.0~dfsg-4.1_all.deb ... 4161s Unpacking fonts-font-awesome (5.0.10+really4.7.0~dfsg-4.1) ... 4161s Selecting previously unselected package fonts-glyphicons-halflings. 4161s Preparing to unpack .../056-fonts-glyphicons-halflings_1.009~3.4.1+dfsg-3_all.deb ... 4161s Unpacking fonts-glyphicons-halflings (1.009~3.4.1+dfsg-3) ... 4161s Selecting previously unselected package fonts-mathjax. 4161s Preparing to unpack .../057-fonts-mathjax_2.7.9+dfsg-1_all.deb ... 4161s Unpacking fonts-mathjax (2.7.9+dfsg-1) ... 4161s Selecting previously unselected package libargon2-1:amd64. 4161s Preparing to unpack .../058-libargon2-1_0~20190702+dfsg-4build1_amd64.deb ... 4161s Unpacking libargon2-1:amd64 (0~20190702+dfsg-4build1) ... 4161s Selecting previously unselected package libcares2:amd64. 4161s Preparing to unpack .../059-libcares2_1.34.4-2.1_amd64.deb ... 4161s Unpacking libcares2:amd64 (1.34.4-2.1) ... 4161s Selecting previously unselected package libjs-bootstrap. 4161s Preparing to unpack .../060-libjs-bootstrap_3.4.1+dfsg-3_all.deb ... 4161s Unpacking libjs-bootstrap (3.4.1+dfsg-3) ... 4161s Selecting previously unselected package libjs-jquery. 4161s Preparing to unpack .../061-libjs-jquery_3.6.1+dfsg+~3.5.14-1_all.deb ... 4161s Unpacking libjs-jquery (3.6.1+dfsg+~3.5.14-1) ... 4161s Selecting previously unselected package libjs-sortable-tablesort. 4161s Preparing to unpack .../062-libjs-sortable-tablesort_3.1.0+ds-2_all.deb ... 4161s Unpacking libjs-sortable-tablesort (3.1.0+ds-2) ... 4161s Selecting previously unselected package libjs-underscore. 4161s Preparing to unpack .../063-libjs-underscore_1.13.4~dfsg+~1.11.4-3_all.deb ... 4161s Unpacking libjs-underscore (1.13.4~dfsg+~1.11.4-3) ... 4161s Selecting previously unselected package libjs-sphinxdoc. 4161s Preparing to unpack .../064-libjs-sphinxdoc_8.1.3-4_all.deb ... 4161s Unpacking libjs-sphinxdoc (8.1.3-4) ... 4161s Selecting previously unselected package libjs-sprintf-js. 4161s Preparing to unpack .../065-libjs-sprintf-js_1.1.2+ds1+~1.1.2-1_all.deb ... 4161s Unpacking libjs-sprintf-js (1.1.2+ds1+~1.1.2-1) ... 4161s Selecting previously unselected package libjson-perl. 4161s Preparing to unpack .../066-libjson-perl_4.10000-1_all.deb ... 4161s Unpacking libjson-perl (4.10000-1) ... 4162s Selecting previously unselected package node-xtend. 4162s Preparing to unpack .../067-node-xtend_4.0.2-3_all.deb ... 4162s Unpacking node-xtend (4.0.2-3) ... 4162s Selecting previously unselected package nodejs. 4162s Preparing to unpack .../068-nodejs_20.18.1+dfsg-1ubuntu2_amd64.deb ... 4162s Unpacking nodejs (20.18.1+dfsg-1ubuntu2) ... 4162s Selecting previously unselected package node-acorn. 4162s Preparing to unpack .../069-node-acorn_8.8.1+ds+~cs25.17.7-2_all.deb ... 4162s Unpacking node-acorn (8.8.1+ds+~cs25.17.7-2) ... 4162s Selecting previously unselected package node-cjs-module-lexer. 4162s Preparing to unpack .../070-node-cjs-module-lexer_1.2.3+dfsg-1_all.deb ... 4162s Unpacking node-cjs-module-lexer (1.2.3+dfsg-1) ... 4162s Selecting previously unselected package node-balanced-match. 4162s Preparing to unpack .../071-node-balanced-match_2.0.0-1_all.deb ... 4162s Unpacking node-balanced-match (2.0.0-1) ... 4162s Selecting previously unselected package node-brace-expansion. 4162s Preparing to unpack .../072-node-brace-expansion_2.0.1+~1.1.0-1_all.deb ... 4162s Unpacking node-brace-expansion (2.0.1+~1.1.0-1) ... 4162s Selecting previously unselected package node-minimatch. 4162s Preparing to unpack .../073-node-minimatch_9.0.3-5_all.deb ... 4162s Unpacking node-minimatch (9.0.3-5) ... 4162s Selecting previously unselected package node-undici. 4162s Preparing to unpack .../074-node-undici_7.3.0+dfsg1+~cs24.12.11-1_all.deb ... 4162s Unpacking node-undici (7.3.0+dfsg1+~cs24.12.11-1) ... 4162s Selecting previously unselected package libnode115:amd64. 4162s Preparing to unpack .../075-libnode115_20.18.1+dfsg-1ubuntu2_amd64.deb ... 4162s Unpacking libnode115:amd64 (20.18.1+dfsg-1ubuntu2) ... 4162s Selecting previously unselected package libnorm1t64:amd64. 4162s Preparing to unpack .../076-libnorm1t64_1.5.9+dfsg-3.1build1_amd64.deb ... 4162s Unpacking libnorm1t64:amd64 (1.5.9+dfsg-3.1build1) ... 4162s Selecting previously unselected package libpgm-5.3-0t64:amd64. 4162s Preparing to unpack .../077-libpgm-5.3-0t64_5.3.128~dfsg-2.1build1_amd64.deb ... 4162s Unpacking libpgm-5.3-0t64:amd64 (5.3.128~dfsg-2.1build1) ... 4162s Selecting previously unselected package libsodium23:amd64. 4162s Preparing to unpack .../078-libsodium23_1.0.18-1build3_amd64.deb ... 4162s Unpacking libsodium23:amd64 (1.0.18-1build3) ... 4162s Selecting previously unselected package libzmq5:amd64. 4163s Preparing to unpack .../079-libzmq5_4.3.5-1build2_amd64.deb ... 4163s Unpacking libzmq5:amd64 (4.3.5-1build2) ... 4163s Selecting previously unselected package node-esprima. 4163s Preparing to unpack .../080-node-esprima_4.0.1+ds+~4.0.3-2_all.deb ... 4163s Unpacking node-esprima (4.0.1+ds+~4.0.3-2) ... 4163s Selecting previously unselected package node-fortawesome-fontawesome-free. 4163s Preparing to unpack .../081-node-fortawesome-fontawesome-free_6.7.2+ds1-1_all.deb ... 4163s Unpacking node-fortawesome-fontawesome-free (6.7.2+ds1-1) ... 4163s Selecting previously unselected package node-sprintf-js. 4163s Preparing to unpack .../082-node-sprintf-js_1.1.2+ds1+~1.1.2-1_all.deb ... 4163s Unpacking node-sprintf-js (1.1.2+ds1+~1.1.2-1) ... 4163s Selecting previously unselected package node-argparse. 4163s Preparing to unpack .../083-node-argparse_2.0.1-2_all.deb ... 4163s Unpacking node-argparse (2.0.1-2) ... 4163s Selecting previously unselected package node-js-yaml. 4163s Preparing to unpack .../084-node-js-yaml_4.1.0+dfsg+~4.0.5-7_all.deb ... 4163s Unpacking node-js-yaml (4.1.0+dfsg+~4.0.5-7) ... 4163s Selecting previously unselected package node-uglify-js. 4163s Preparing to unpack .../085-node-uglify-js_3.17.4-2_all.deb ... 4163s Unpacking node-uglify-js (3.17.4-2) ... 4163s Selecting previously unselected package pybuild-plugin-autopkgtest. 4163s Preparing to unpack .../086-pybuild-plugin-autopkgtest_6.20250108_all.deb ... 4163s Unpacking pybuild-plugin-autopkgtest (6.20250108) ... 4163s Selecting previously unselected package python3-packaging. 4163s Preparing to unpack .../087-python3-packaging_24.2-1_all.deb ... 4163s Unpacking python3-packaging (24.2-1) ... 4163s Selecting previously unselected package python3-pyproject-hooks. 4163s Preparing to unpack .../088-python3-pyproject-hooks_1.2.0-1_all.deb ... 4163s Unpacking python3-pyproject-hooks (1.2.0-1) ... 4163s Selecting previously unselected package python3-toml. 4163s Preparing to unpack .../089-python3-toml_0.10.2-1_all.deb ... 4163s Unpacking python3-toml (0.10.2-1) ... 4163s Selecting previously unselected package python3-wheel. 4163s Preparing to unpack .../090-python3-wheel_0.45.1-1_all.deb ... 4163s Unpacking python3-wheel (0.45.1-1) ... 4163s Selecting previously unselected package python3-build. 4163s Preparing to unpack .../091-python3-build_1.2.2-1_all.deb ... 4163s Unpacking python3-build (1.2.2-1) ... 4164s Selecting previously unselected package python3-installer. 4164s Preparing to unpack .../092-python3-installer_0.7.0+dfsg1-3_all.deb ... 4164s Unpacking python3-installer (0.7.0+dfsg1-3) ... 4164s Selecting previously unselected package pybuild-plugin-pyproject. 4164s Preparing to unpack .../093-pybuild-plugin-pyproject_6.20250108_all.deb ... 4164s Unpacking pybuild-plugin-pyproject (6.20250108) ... 4164s Selecting previously unselected package libjs-mathjax. 4164s Preparing to unpack .../094-libjs-mathjax_2.7.9+dfsg-1_all.deb ... 4164s Unpacking libjs-mathjax (2.7.9+dfsg-1) ... 4164s Selecting previously unselected package python-dask-doc. 4164s Preparing to unpack .../095-python-dask-doc_2024.12.1+dfsg-2_all.deb ... 4164s Unpacking python-dask-doc (2024.12.1+dfsg-2) ... 4165s Selecting previously unselected package sphinx-rtd-theme-common. 4165s Preparing to unpack .../096-sphinx-rtd-theme-common_3.0.2+dfsg-2_all.deb ... 4165s Unpacking sphinx-rtd-theme-common (3.0.2+dfsg-2) ... 4165s Selecting previously unselected package python-fsspec-doc. 4165s Preparing to unpack .../097-python-fsspec-doc_2025.2.0-1_all.deb ... 4165s Unpacking python-fsspec-doc (2025.2.0-1) ... 4165s Selecting previously unselected package python-numpy-doc. 4165s Preparing to unpack .../098-python-numpy-doc_1%3a2.2.3+ds-2_all.deb ... 4165s Unpacking python-numpy-doc (1:2.2.3+ds-2) ... 4166s Selecting previously unselected package python-pandas-doc. 4166s Preparing to unpack .../099-python-pandas-doc_2.2.3+dfsg-8_all.deb ... 4166s Unpacking python-pandas-doc (2.2.3+dfsg-8) ... 4168s Selecting previously unselected package python3.13-doc. 4168s Preparing to unpack .../100-python3.13-doc_3.13.2-1_all.deb ... 4168s Unpacking python3.13-doc (3.13.2-1) ... 4169s Selecting previously unselected package python3-doc. 4169s Preparing to unpack .../101-python3-doc_3.13.1-1~exp2_all.deb ... 4169s Unpacking python3-doc (3.13.1-1~exp2) ... 4169s Selecting previously unselected package sass-stylesheets-bulma. 4169s Preparing to unpack .../102-sass-stylesheets-bulma_0.9.4~ds-1_all.deb ... 4169s Unpacking sass-stylesheets-bulma (0.9.4~ds-1) ... 4169s Selecting previously unselected package python-distributed-doc. 4169s Preparing to unpack .../103-python-distributed-doc_2024.12.1+ds-1_all.deb ... 4169s Unpacking python-distributed-doc (2024.12.1+ds-1) ... 4169s Selecting previously unselected package python-tinycss2-common. 4169s Preparing to unpack .../104-python-tinycss2-common_1.4.0-1_all.deb ... 4169s Unpacking python-tinycss2-common (1.4.0-1) ... 4169s Selecting previously unselected package python3-accessible-pygments. 4169s Preparing to unpack .../105-python3-accessible-pygments_0.0.5-2_all.deb ... 4169s Unpacking python3-accessible-pygments (0.0.5-2) ... 4169s Selecting previously unselected package python3-all. 4169s Preparing to unpack .../106-python3-all_3.13.1-1~exp2_amd64.deb ... 4169s Unpacking python3-all (3.13.1-1~exp2) ... 4169s Selecting previously unselected package python3-sniffio. 4169s Preparing to unpack .../107-python3-sniffio_1.3.1-1_all.deb ... 4169s Unpacking python3-sniffio (1.3.1-1) ... 4169s Selecting previously unselected package python3-anyio. 4169s Preparing to unpack .../108-python3-anyio_4.7.0-1_all.deb ... 4169s Unpacking python3-anyio (4.7.0-1) ... 4169s Selecting previously unselected package python3-argon2. 4169s Preparing to unpack .../109-python3-argon2_21.1.0-3_amd64.deb ... 4169s Unpacking python3-argon2 (21.1.0-3) ... 4169s Selecting previously unselected package python3-dateutil. 4169s Preparing to unpack .../110-python3-dateutil_2.9.0-3_all.deb ... 4169s Unpacking python3-dateutil (2.9.0-3) ... 4169s Selecting previously unselected package python3-arrow. 4169s Preparing to unpack .../111-python3-arrow_1.3.0-1.1ubuntu1_all.deb ... 4169s Unpacking python3-arrow (1.3.0-1.1ubuntu1) ... 4169s Selecting previously unselected package python3-async-generator. 4169s Preparing to unpack .../112-python3-async-generator_1.10-4_all.deb ... 4169s Unpacking python3-async-generator (1.10-4) ... 4169s Selecting previously unselected package python3-webencodings. 4169s Preparing to unpack .../113-python3-webencodings_0.5.1-5_all.deb ... 4169s Unpacking python3-webencodings (0.5.1-5) ... 4169s Selecting previously unselected package python3-html5lib. 4169s Preparing to unpack .../114-python3-html5lib_1.2-1_all.deb ... 4169s Unpacking python3-html5lib (1.2-1) ... 4169s Selecting previously unselected package python3-bleach. 4169s Preparing to unpack .../115-python3-bleach_6.2.0-1_all.deb ... 4169s Unpacking python3-bleach (6.2.0-1) ... 4169s Selecting previously unselected package python3-soupsieve. 4170s Preparing to unpack .../116-python3-soupsieve_2.6-1_all.deb ... 4170s Unpacking python3-soupsieve (2.6-1) ... 4170s Selecting previously unselected package python3-bs4. 4170s Preparing to unpack .../117-python3-bs4_4.13.3-1_all.deb ... 4170s Unpacking python3-bs4 (4.13.3-1) ... 4170s Selecting previously unselected package python3-click. 4170s Preparing to unpack .../118-python3-click_8.1.8-1_all.deb ... 4170s Unpacking python3-click (8.1.8-1) ... 4170s Selecting previously unselected package python3-cloudpickle. 4170s Preparing to unpack .../119-python3-cloudpickle_3.1.1-1_all.deb ... 4170s Unpacking python3-cloudpickle (3.1.1-1) ... 4170s Selecting previously unselected package python3-fsspec. 4170s Preparing to unpack .../120-python3-fsspec_2025.2.0-1_all.deb ... 4170s Unpacking python3-fsspec (2025.2.0-1) ... 4170s Selecting previously unselected package python3-toolz. 4170s Preparing to unpack .../121-python3-toolz_1.0.0-2_all.deb ... 4170s Unpacking python3-toolz (1.0.0-2) ... 4170s Selecting previously unselected package python3-locket. 4170s Preparing to unpack .../122-python3-locket_1.0.0-2_all.deb ... 4170s Unpacking python3-locket (1.0.0-2) ... 4170s Selecting previously unselected package python3-partd. 4170s Preparing to unpack .../123-python3-partd_1.4.2-1_all.deb ... 4170s Unpacking python3-partd (1.4.2-1) ... 4170s Selecting previously unselected package python3-dask. 4170s Preparing to unpack .../124-python3-dask_2024.12.1+dfsg-2_all.deb ... 4170s Unpacking python3-dask (2024.12.1+dfsg-2) ... 4170s Selecting previously unselected package python3-roman. 4170s Preparing to unpack .../125-python3-roman_5.0-1_all.deb ... 4170s Unpacking python3-roman (5.0-1) ... 4170s Selecting previously unselected package python3-docutils. 4170s Preparing to unpack .../126-python3-docutils_0.21.2+dfsg-2_all.deb ... 4170s Unpacking python3-docutils (0.21.2+dfsg-2) ... 4170s Selecting previously unselected package python3-defusedxml. 4170s Preparing to unpack .../127-python3-defusedxml_0.7.1-3_all.deb ... 4170s Unpacking python3-defusedxml (0.7.1-3) ... 4170s Selecting previously unselected package sphinx-common. 4170s Preparing to unpack .../128-sphinx-common_8.1.3-4_all.deb ... 4170s Unpacking sphinx-common (8.1.3-4) ... 4170s Selecting previously unselected package python3-alabaster. 4170s Preparing to unpack .../129-python3-alabaster_0.7.16-0.1_all.deb ... 4170s Unpacking python3-alabaster (0.7.16-0.1) ... 4170s Selecting previously unselected package python3-imagesize. 4170s Preparing to unpack .../130-python3-imagesize_1.4.1-1_all.deb ... 4170s Unpacking python3-imagesize (1.4.1-1) ... 4171s Selecting previously unselected package python3-snowballstemmer. 4171s Preparing to unpack .../131-python3-snowballstemmer_2.2.0-4build1_all.deb ... 4171s Unpacking python3-snowballstemmer (2.2.0-4build1) ... 4171s Selecting previously unselected package python3-sphinx. 4171s Preparing to unpack .../132-python3-sphinx_8.1.3-4_all.deb ... 4171s Unpacking python3-sphinx (8.1.3-4) ... 4171s Selecting previously unselected package python3-pydata-sphinx-theme. 4171s Preparing to unpack .../133-python3-pydata-sphinx-theme_0.16.1+dfsg-3_all.deb ... 4171s Unpacking python3-pydata-sphinx-theme (0.16.1+dfsg-3) ... 4171s Selecting previously unselected package python3-sphinx-book-theme. 4171s Preparing to unpack .../134-python3-sphinx-book-theme_0.1.7-3_all.deb ... 4171s Unpacking python3-sphinx-book-theme (0.1.7-3) ... 4171s Selecting previously unselected package python3-dask-sphinx-theme. 4171s Preparing to unpack .../135-python3-dask-sphinx-theme_3.0.5-2_all.deb ... 4171s Unpacking python3-dask-sphinx-theme (3.0.5-2) ... 4171s Selecting previously unselected package python3-decorator. 4171s Preparing to unpack .../136-python3-decorator_5.1.1-5_all.deb ... 4171s Unpacking python3-decorator (5.1.1-5) ... 4171s Selecting previously unselected package python3-msgpack. 4171s Preparing to unpack .../137-python3-msgpack_1.0.3-3build3_amd64.deb ... 4171s Unpacking python3-msgpack (1.0.3-3build3) ... 4171s Selecting previously unselected package python3-psutil. 4171s Preparing to unpack .../138-python3-psutil_5.9.8-2build3_amd64.deb ... 4171s Unpacking python3-psutil (5.9.8-2build3) ... 4171s Selecting previously unselected package python3-sortedcontainers. 4171s Preparing to unpack .../139-python3-sortedcontainers_2.4.0-2_all.deb ... 4171s Unpacking python3-sortedcontainers (2.4.0-2) ... 4171s Selecting previously unselected package python3-tblib. 4171s Preparing to unpack .../140-python3-tblib_3.0.0-6_all.deb ... 4171s Unpacking python3-tblib (3.0.0-6) ... 4171s Selecting previously unselected package python3-tornado. 4171s Preparing to unpack .../141-python3-tornado_6.4.2-1_amd64.deb ... 4171s Unpacking python3-tornado (6.4.2-1) ... 4171s Selecting previously unselected package python3-zict. 4171s Preparing to unpack .../142-python3-zict_3.0.0-2ubuntu1_all.deb ... 4171s Unpacking python3-zict (3.0.0-2ubuntu1) ... 4171s Selecting previously unselected package python3-distributed. 4171s Preparing to unpack .../143-python3-distributed_2024.12.1+ds-1_all.deb ... 4171s Unpacking python3-distributed (2024.12.1+ds-1) ... 4171s Selecting previously unselected package python3-fastjsonschema. 4171s Preparing to unpack .../144-python3-fastjsonschema_2.21.1-1_all.deb ... 4171s Unpacking python3-fastjsonschema (2.21.1-1) ... 4172s Selecting previously unselected package python3-fqdn. 4172s Preparing to unpack .../145-python3-fqdn_1.5.1-2_all.deb ... 4172s Unpacking python3-fqdn (1.5.1-2) ... 4172s Selecting previously unselected package python3-iniconfig. 4172s Preparing to unpack .../146-python3-iniconfig_1.1.1-2_all.deb ... 4172s Unpacking python3-iniconfig (1.1.1-2) ... 4172s Selecting previously unselected package python3-isoduration. 4172s Preparing to unpack .../147-python3-isoduration_20.11.0+git20211126.ae0bd61-2_all.deb ... 4172s Unpacking python3-isoduration (20.11.0+git20211126.ae0bd61-2) ... 4172s Selecting previously unselected package python3-platformdirs. 4172s Preparing to unpack .../148-python3-platformdirs_4.3.6-1_all.deb ... 4172s Unpacking python3-platformdirs (4.3.6-1) ... 4172s Selecting previously unselected package python3-traitlets. 4172s Preparing to unpack .../149-python3-traitlets_5.14.3+really5.14.3-1_all.deb ... 4172s Unpacking python3-traitlets (5.14.3+really5.14.3-1) ... 4172s Selecting previously unselected package python3-jupyter-core. 4172s Preparing to unpack .../150-python3-jupyter-core_5.7.2-5_all.deb ... 4172s Unpacking python3-jupyter-core (5.7.2-5) ... 4172s Selecting previously unselected package python3-zmq. 4172s Preparing to unpack .../151-python3-zmq_26.2.1-1_amd64.deb ... 4172s Unpacking python3-zmq (26.2.1-1) ... 4172s Selecting previously unselected package python3-jupyter-client. 4172s Preparing to unpack .../152-python3-jupyter-client_8.6.3-2_all.deb ... 4172s Unpacking python3-jupyter-client (8.6.3-2) ... 4172s Selecting previously unselected package python3-pythonjsonlogger. 4172s Preparing to unpack .../153-python3-pythonjsonlogger_3.2.1-1_all.deb ... 4172s Unpacking python3-pythonjsonlogger (3.2.1-1) ... 4172s Selecting previously unselected package python3-rfc3339-validator. 4172s Preparing to unpack .../154-python3-rfc3339-validator_0.1.4-2_all.deb ... 4172s Unpacking python3-rfc3339-validator (0.1.4-2) ... 4172s Selecting previously unselected package python3-rfc3986-validator. 4172s Preparing to unpack .../155-python3-rfc3986-validator_0.1.1-2_all.deb ... 4172s Unpacking python3-rfc3986-validator (0.1.1-2) ... 4172s Selecting previously unselected package python3-uritemplate. 4172s Preparing to unpack .../156-python3-uritemplate_4.1.1-3_all.deb ... 4172s Unpacking python3-uritemplate (4.1.1-3) ... 4172s Selecting previously unselected package python3-webcolors. 4172s Preparing to unpack .../157-python3-webcolors_1.13-1_all.deb ... 4172s Unpacking python3-webcolors (1.13-1) ... 4172s Selecting previously unselected package python3-jupyter-events. 4172s Preparing to unpack .../158-python3-jupyter-events_0.10.0-4_all.deb ... 4172s Unpacking python3-jupyter-events (0.10.0-4) ... 4172s Selecting previously unselected package python3-ptyprocess. 4172s Preparing to unpack .../159-python3-ptyprocess_0.7.0-6_all.deb ... 4172s Unpacking python3-ptyprocess (0.7.0-6) ... 4172s Selecting previously unselected package python3-terminado. 4172s Preparing to unpack .../160-python3-terminado_0.18.1-1_all.deb ... 4172s Unpacking python3-terminado (0.18.1-1) ... 4172s Selecting previously unselected package python3-jupyter-server-terminals. 4172s Preparing to unpack .../161-python3-jupyter-server-terminals_0.5.3-2_all.deb ... 4172s Unpacking python3-jupyter-server-terminals (0.5.3-2) ... 4172s Selecting previously unselected package python3-tinycss2. 4172s Preparing to unpack .../162-python3-tinycss2_1.4.0-1_all.deb ... 4172s Unpacking python3-tinycss2 (1.4.0-1) ... 4172s Selecting previously unselected package python3-jupyterlab-pygments. 4172s Preparing to unpack .../163-python3-jupyterlab-pygments_0.2.2-3_all.deb ... 4172s Unpacking python3-jupyterlab-pygments (0.2.2-3) ... 4173s Selecting previously unselected package python3-mistune. 4173s Preparing to unpack .../164-python3-mistune_3.0.2-2_all.deb ... 4173s Unpacking python3-mistune (3.0.2-2) ... 4173s Selecting previously unselected package python3-nbformat. 4173s Preparing to unpack .../165-python3-nbformat_5.9.1-1_all.deb ... 4173s Unpacking python3-nbformat (5.9.1-1) ... 4173s Selecting previously unselected package python3-nbclient. 4173s Preparing to unpack .../166-python3-nbclient_0.8.0-2_all.deb ... 4173s Unpacking python3-nbclient (0.8.0-2) ... 4173s Selecting previously unselected package python3-pandocfilters. 4173s Preparing to unpack .../167-python3-pandocfilters_1.5.1-1_all.deb ... 4173s Unpacking python3-pandocfilters (1.5.1-1) ... 4173s Selecting previously unselected package python3-nbconvert. 4173s Preparing to unpack .../168-python3-nbconvert_7.16.6-1_all.deb ... 4173s Unpacking python3-nbconvert (7.16.6-1) ... 4173s Selecting previously unselected package python3-overrides. 4173s Preparing to unpack .../169-python3-overrides_7.7.0-2_all.deb ... 4173s Unpacking python3-overrides (7.7.0-2) ... 4173s Selecting previously unselected package python3-prometheus-client. 4173s Preparing to unpack .../170-python3-prometheus-client_0.21.1+ds1-1_all.deb ... 4173s Unpacking python3-prometheus-client (0.21.1+ds1-1) ... 4173s Selecting previously unselected package python3-send2trash. 4173s Preparing to unpack .../171-python3-send2trash_1.8.3-1_all.deb ... 4173s Unpacking python3-send2trash (1.8.3-1) ... 4173s Selecting previously unselected package python3-websocket. 4173s Preparing to unpack .../172-python3-websocket_1.8.0-2_all.deb ... 4173s Unpacking python3-websocket (1.8.0-2) ... 4173s Selecting previously unselected package python3-jupyter-server. 4173s Preparing to unpack .../173-python3-jupyter-server_2.14.2-5_all.deb ... 4173s Unpacking python3-jupyter-server (2.14.2-5) ... 4173s Selecting previously unselected package python3-tabulate. 4173s Preparing to unpack .../174-python3-tabulate_0.9.0-1_all.deb ... 4173s Unpacking python3-tabulate (0.9.0-1) ... 4173s Selecting previously unselected package python3-numpydoc. 4173s Preparing to unpack .../175-python3-numpydoc_1.8.0-1_all.deb ... 4173s Unpacking python3-numpydoc (1.8.0-1) ... 4173s Selecting previously unselected package python3-pytz. 4173s Preparing to unpack .../176-python3-pytz_2025.1-3_all.deb ... 4173s Unpacking python3-pytz (2025.1-3) ... 4173s Selecting previously unselected package python3-tz. 4173s Preparing to unpack .../177-python3-tz_2025.1-3_all.deb ... 4173s Unpacking python3-tz (2025.1-3) ... 4173s Selecting previously unselected package python3-pandas-lib:amd64. 4173s Preparing to unpack .../178-python3-pandas-lib_2.2.3+dfsg-8_amd64.deb ... 4173s Unpacking python3-pandas-lib:amd64 (2.2.3+dfsg-8) ... 4174s Selecting previously unselected package python3-pandas. 4174s Preparing to unpack .../179-python3-pandas_2.2.3+dfsg-8_all.deb ... 4174s Unpacking python3-pandas (2.2.3+dfsg-8) ... 4174s Selecting previously unselected package python3-pluggy. 4174s Preparing to unpack .../180-python3-pluggy_1.5.0-1_all.deb ... 4174s Unpacking python3-pluggy (1.5.0-1) ... 4174s Selecting previously unselected package python3-pytest. 4174s Preparing to unpack .../181-python3-pytest_8.3.4-1_all.deb ... 4174s Unpacking python3-pytest (8.3.4-1) ... 4174s Selecting previously unselected package python3-pytest-asyncio. 4174s Preparing to unpack .../182-python3-pytest-asyncio_0.25.1-1_all.deb ... 4174s Unpacking python3-pytest-asyncio (0.25.1-1) ... 4174s Selecting previously unselected package python3-pytest-rerunfailures. 4174s Preparing to unpack .../183-python3-pytest-rerunfailures_15.0-1_all.deb ... 4174s Unpacking python3-pytest-rerunfailures (15.0-1) ... 4175s Selecting previously unselected package python3-pytest-timeout. 4175s Preparing to unpack .../184-python3-pytest-timeout_2.3.1-1_all.deb ... 4175s Unpacking python3-pytest-timeout (2.3.1-1) ... 4175s Selecting previously unselected package python3-sortedcollections. 4175s Preparing to unpack .../185-python3-sortedcollections_2.1.0-2_all.deb ... 4175s Unpacking python3-sortedcollections (2.1.0-2) ... 4175s Selecting previously unselected package python3-sphinx-click. 4175s Preparing to unpack .../186-python3-sphinx-click_6.0.0-2_all.deb ... 4175s Unpacking python3-sphinx-click (6.0.0-2) ... 4175s Selecting previously unselected package python3-sphinx-design. 4175s Preparing to unpack .../187-python3-sphinx-design_0.6.1-1_all.deb ... 4175s Unpacking python3-sphinx-design (0.6.1-1) ... 4175s Selecting previously unselected package python3-versioneer. 4175s Preparing to unpack .../188-python3-versioneer_0.29-1_all.deb ... 4175s Unpacking python3-versioneer (0.29-1) ... 4175s Selecting previously unselected package tzdata-legacy. 4175s Preparing to unpack .../189-tzdata-legacy_2025a-2ubuntu1_all.deb ... 4175s Unpacking tzdata-legacy (2025a-2ubuntu1) ... 4175s Selecting previously unselected package uglifyjs. 4175s Preparing to unpack .../190-uglifyjs_3.17.4-2_all.deb ... 4175s Unpacking uglifyjs (3.17.4-2) ... 4175s Setting up dh-python (6.20250108) ... 4175s Setting up node-uglify-js (3.17.4-2) ... 4175s Setting up python3-iniconfig (1.1.1-2) ... 4175s Setting up python3-sniffio (1.3.1-1) ... 4176s Setting up python3.12-minimal (3.12.9-1) ... 4177s Setting up python3-tornado (6.4.2-1) ... 4178s Setting up libnorm1t64:amd64 (1.5.9+dfsg-3.1build1) ... 4178s Setting up python3-send2trash (1.8.3-1) ... 4178s Setting up fonts-lato (2.015-1) ... 4178s Setting up libjs-sprintf-js (1.1.2+ds1+~1.1.2-1) ... 4178s Setting up fonts-mathjax (2.7.9+dfsg-1) ... 4178s Setting up libsodium23:amd64 (1.0.18-1build3) ... 4178s Setting up python3-async-generator (1.10-4) ... 4178s Setting up libjs-mathjax (2.7.9+dfsg-1) ... 4178s Setting up python3-tblib (3.0.0-6) ... 4178s Setting up python3-anyio (4.7.0-1) ... 4179s Setting up python3-pythonjsonlogger (3.2.1-1) ... 4179s Setting up python3-defusedxml (0.7.1-3) ... 4179s Setting up libarchive-zip-perl (1.68-1) ... 4179s Setting up fonts-glyphicons-halflings (1.009~3.4.1+dfsg-3) ... 4179s Setting up python3-alabaster (0.7.16-0.1) ... 4179s Setting up libargon2-1:amd64 (0~20190702+dfsg-4build1) ... 4179s Setting up python3-overrides (7.7.0-2) ... 4180s Setting up libdebhelper-perl (13.24.1ubuntu2) ... 4180s Setting up python3.12 (3.12.9-1) ... 4181s Setting up python3-fsspec (2025.2.0-1) ... 4182s Setting up python3-rfc3339-validator (0.1.4-2) ... 4182s Setting up python3-tabulate (0.9.0-1) ... 4183s Setting up m4 (1.4.19-5) ... 4183s Setting up python3-all (3.13.1-1~exp2) ... 4183s Setting up node-cjs-module-lexer (1.2.3+dfsg-1) ... 4183s Setting up python3-pytz (2025.1-3) ... 4183s Setting up python3-sortedcontainers (2.4.0-2) ... 4183s Setting up node-fortawesome-fontawesome-free (6.7.2+ds1-1) ... 4183s Setting up python3-pandocfilters (1.5.1-1) ... 4183s Setting up libgomp1:amd64 (15-20250213-1ubuntu1) ... 4183s Setting up python3-click (8.1.8-1) ... 4184s Setting up python3-wheel (0.45.1-1) ... 4184s Setting up python3-webencodings (0.5.1-5) ... 4185s Setting up python3-platformdirs (4.3.6-1) ... 4185s Setting up python3-psutil (5.9.8-2build3) ... 4186s Setting up tzdata-legacy (2025a-2ubuntu1) ... 4186s Setting up python3-tz (2025.1-3) ... 4186s Setting up python3-cloudpickle (3.1.1-1) ... 4186s Setting up python3-uritemplate (4.1.1-3) ... 4186s Setting up python3-jupyterlab-pygments (0.2.2-3) ... 4186s Setting up python3-roman (5.0-1) ... 4187s Setting up libpgm-5.3-0t64:amd64 (5.3.128~dfsg-2.1build1) ... 4187s Setting up python3-decorator (5.1.1-5) ... 4187s Setting up python3-fqdn (1.5.1-2) ... 4187s Setting up autotools-dev (20220109.1) ... 4187s Setting up libblas3:amd64 (3.12.1-2) ... 4187s update-alternatives: using /usr/lib/x86_64-linux-gnu/blas/libblas.so.3 to provide /usr/lib/x86_64-linux-gnu/libblas.so.3 (libblas.so.3-x86_64-linux-gnu) in auto mode 4187s Setting up python3-webcolors (1.13-1) ... 4187s Setting up python3-packaging (24.2-1) ... 4188s Setting up python3-pyproject-hooks (1.2.0-1) ... 4188s Setting up node-sprintf-js (1.1.2+ds1+~1.1.2-1) ... 4188s Setting up python3-accessible-pygments (0.0.5-2) ... 4188s Setting up python3-snowballstemmer (2.2.0-4build1) ... 4189s Setting up node-balanced-match (2.0.0-1) ... 4189s Setting up node-brace-expansion (2.0.1+~1.1.0-1) ... 4189s Setting up libquadmath0:amd64 (15-20250213-1ubuntu1) ... 4189s Setting up python3-rfc3986-validator (0.1.1-2) ... 4189s Setting up libcares2:amd64 (1.34.4-2.1) ... 4189s Setting up libmpc3:amd64 (1.3.1-1build2) ... 4189s Setting up python3-numpy-dev:amd64 (1:2.2.3+ds-2) ... 4189s Setting up autopoint (0.23.1-1) ... 4189s Setting up python3-html5lib (1.2-1) ... 4190s Setting up python3-toml (0.10.2-1) ... 4190s Setting up python3-installer (0.7.0+dfsg1-3) ... 4190s Setting up libgfortran5:amd64 (15-20250213-1ubuntu1) ... 4190s Setting up autoconf (2.72-3ubuntu1) ... 4190s Setting up python3-pluggy (1.5.0-1) ... 4190s Setting up libubsan1:amd64 (15-20250213-1ubuntu1) ... 4190s Setting up python3-fastjsonschema (2.21.1-1) ... 4191s Setting up node-undici (7.3.0+dfsg1+~cs24.12.11-1) ... 4191s Setting up dwz (0.15-1build6) ... 4191s Setting up libhwasan0:amd64 (15-20250213-1ubuntu1) ... 4191s Setting up python3-traitlets (5.14.3+really5.14.3-1) ... 4191s Setting up libasan8:amd64 (15-20250213-1ubuntu1) ... 4191s Setting up python-tinycss2-common (1.4.0-1) ... 4191s Setting up libjson-perl (4.10000-1) ... 4191s Setting up python3-argon2 (21.1.0-3) ... 4191s Setting up debugedit (1:5.1-2) ... 4191s Setting up python3-toolz (1.0.0-2) ... 4192s Setting up python3-dateutil (2.9.0-3) ... 4192s Setting up sgml-base (1.31) ... 4192s Setting up python3-msgpack (1.0.3-3build3) ... 4192s Setting up python3-versioneer (0.29-1) ... 4192s Setting up node-minimatch (9.0.3-5) ... 4192s Setting up libtsan2:amd64 (15-20250213-1ubuntu1) ... 4192s Setting up libjs-jquery (3.6.1+dfsg+~3.5.14-1) ... 4192s Setting up sass-stylesheets-bulma (0.9.4~ds-1) ... 4192s Setting up node-xtend (4.0.2-3) ... 4192s Setting up libisl23:amd64 (0.27-1) ... 4192s Setting up python3-build (1.2.2-1) ... 4193s Setting up python3-zict (3.0.0-2ubuntu1) ... 4193s Setting up python3-locket (1.0.0-2) ... 4193s Setting up python3-mistune (3.0.2-2) ... 4194s Setting up python3-soupsieve (2.6-1) ... 4194s Setting up fonts-font-awesome (5.0.10+really4.7.0~dfsg-4.1) ... 4194s Setting up sphinx-rtd-theme-common (3.0.2+dfsg-2) ... 4194s Setting up python3-websocket (1.8.0-2) ... 4194s Setting up libcc1-0:amd64 (15-20250213-1ubuntu1) ... 4194s Setting up libjs-sortable-tablesort (3.1.0+ds-2) ... 4194s Setting up python3-jupyter-core (5.7.2-5) ... 4194s Setting up liblsan0:amd64 (15-20250213-1ubuntu1) ... 4194s Setting up libjs-bootstrap (3.4.1+dfsg-3) ... 4194s Setting up libitm1:amd64 (15-20250213-1ubuntu1) ... 4194s Setting up libjs-underscore (1.13.4~dfsg+~1.11.4-3) ... 4194s Setting up python3-imagesize (1.4.1-1) ... 4195s Setting up python3-ptyprocess (0.7.0-6) ... 4195s Setting up automake (1:1.17-3ubuntu1) ... 4195s update-alternatives: using /usr/bin/automake-1.17 to provide /usr/bin/automake (automake) in auto mode 4195s Setting up libfile-stripnondeterminism-perl (1.14.1-2) ... 4195s Setting up python3-partd (1.4.2-1) ... 4195s Setting up python3-sortedcollections (2.1.0-2) ... 4195s Setting up liblapack3:amd64 (3.12.1-2) ... 4195s update-alternatives: using /usr/lib/x86_64-linux-gnu/lapack/liblapack.so.3 to provide /usr/lib/x86_64-linux-gnu/liblapack.so.3 (liblapack.so.3-x86_64-linux-gnu) in auto mode 4195s Setting up gettext (0.23.1-1) ... 4195s Setting up python3-tinycss2 (1.4.0-1) ... 4195s Setting up libzmq5:amd64 (4.3.5-1build2) ... 4195s Setting up python3-arrow (1.3.0-1.1ubuntu1) ... 4196s Setting up pybuild-plugin-pyproject (6.20250108) ... 4196s Setting up python3-pytest (8.3.4-1) ... 4197s Setting up python3-dask (2024.12.1+dfsg-2) ... 4200s Setting up python3-isoduration (20.11.0+git20211126.ae0bd61-2) ... 4200s Setting up python3-nbformat (5.9.1-1) ... 4200s Setting up python3-bs4 (4.13.3-1) ... 4201s Setting up intltool-debian (0.35.0+20060710.6) ... 4201s Setting up python3-bleach (6.2.0-1) ... 4201s Setting up python3.13-doc (3.13.2-1) ... 4201s Setting up python3-prometheus-client (0.21.1+ds1-1) ... 4201s Setting up python3-distributed (2024.12.1+ds-1) ... 4204s Setting up python3-zmq (26.2.1-1) ... 4204s Setting up cpp-14-x86-64-linux-gnu (14.2.0-17ubuntu1) ... 4204s Setting up python3-numpy (1:2.2.3+ds-2) ... 4209s Setting up libjs-sphinxdoc (8.1.3-4) ... 4209s Setting up cpp-14 (14.2.0-17ubuntu1) ... 4209s Setting up python3-pytest-asyncio (0.25.1-1) ... 4209s Setting up dh-strip-nondeterminism (1.14.1-2) ... 4209s Setting up python3-terminado (0.18.1-1) ... 4209s Setting up xml-core (0.19) ... 4210s Setting up python3-jupyter-client (8.6.3-2) ... 4210s Setting up python3-jupyter-server-terminals (0.5.3-2) ... 4210s Setting up libgcc-14-dev:amd64 (14.2.0-17ubuntu1) ... 4210s Setting up python3-jupyter-events (0.10.0-4) ... 4210s Setting up libstdc++-14-dev:amd64 (14.2.0-17ubuntu1) ... 4210s Setting up python3-doc (3.13.1-1~exp2) ... 4210s Setting up cpp-x86-64-linux-gnu (4:14.2.0-1ubuntu1) ... 4210s Setting up python-numpy-doc (1:2.2.3+ds-2) ... 4210s Setting up python3-pytest-rerunfailures (15.0-1) ... 4210s Setting up python3-pytest-timeout (2.3.1-1) ... 4211s Setting up python-pandas-doc (2.2.3+dfsg-8) ... 4211s Setting up po-debconf (1.0.21+nmu1) ... 4211s Setting up python3-pandas-lib:amd64 (2.2.3+dfsg-8) ... 4211s Setting up python3-nbclient (0.8.0-2) ... 4211s Setting up python3-pandas (2.2.3+dfsg-8) ... 4223s Setting up sphinx-common (8.1.3-4) ... 4223s Setting up python-fsspec-doc (2025.2.0-1) ... 4223s Setting up python3-nbconvert (7.16.6-1) ... 4223s Setting up cpp (4:14.2.0-1ubuntu1) ... 4223s Setting up gcc-14-x86-64-linux-gnu (14.2.0-17ubuntu1) ... 4223s Setting up gcc-x86-64-linux-gnu (4:14.2.0-1ubuntu1) ... 4223s Setting up python3-jupyter-server (2.14.2-5) ... 4224s Setting up gcc-14 (14.2.0-17ubuntu1) ... 4224s Setting up g++-14-x86-64-linux-gnu (14.2.0-17ubuntu1) ... 4224s Setting up g++-x86-64-linux-gnu (4:14.2.0-1ubuntu1) ... 4224s Setting up g++-14 (14.2.0-17ubuntu1) ... 4224s Setting up libtool (2.5.4-3build1) ... 4224s Setting up gcc (4:14.2.0-1ubuntu1) ... 4224s Setting up dh-autoreconf (20) ... 4224s Setting up g++ (4:14.2.0-1ubuntu1) ... 4224s update-alternatives: using /usr/bin/g++ to provide /usr/bin/c++ (c++) in auto mode 4224s Setting up build-essential (12.10ubuntu1) ... 4224s Setting up debhelper (13.24.1ubuntu2) ... 4224s Setting up pybuild-plugin-autopkgtest (6.20250108) ... 4224s Setting up libnode115:amd64 (20.18.1+dfsg-1ubuntu2) ... 4224s Setting up nodejs (20.18.1+dfsg-1ubuntu2) ... 4224s update-alternatives: using /usr/bin/nodejs to provide /usr/bin/js (js) in auto mode 4224s Setting up node-argparse (2.0.1-2) ... 4224s Setting up node-acorn (8.8.1+ds+~cs25.17.7-2) ... 4224s Setting up node-esprima (4.0.1+ds+~4.0.3-2) ... 4224s Setting up node-js-yaml (4.1.0+dfsg+~4.0.5-7) ... 4224s Setting up uglifyjs (3.17.4-2) ... 4224s Setting up python-dask-doc (2024.12.1+dfsg-2) ... 4224s Setting up python-distributed-doc (2024.12.1+ds-1) ... 4224s Processing triggers for install-info (7.1.1-1) ... 4224s Processing triggers for libc-bin (2.40-4ubuntu1) ... 4224s Processing triggers for systemd (257.2-3ubuntu1) ... 4225s Processing triggers for man-db (2.13.0-1) ... 4227s Processing triggers for sgml-base (1.31) ... 4227s Setting up docutils-common (0.21.2+dfsg-2) ... 4227s Processing triggers for sgml-base (1.31) ... 4227s Setting up python3-docutils (0.21.2+dfsg-2) ... 4229s Setting up python3-sphinx (8.1.3-4) ... 4230s Setting up python3-sphinx-click (6.0.0-2) ... 4230s Setting up python3-sphinx-design (0.6.1-1) ... 4231s Setting up python3-numpydoc (1.8.0-1) ... 4231s Setting up python3-pydata-sphinx-theme (0.16.1+dfsg-3) ... 4231s Setting up python3-sphinx-book-theme (0.1.7-3) ... 4231s Setting up python3-dask-sphinx-theme (3.0.5-2) ... 4234s autopkgtest [00:37:17]: test pybuild-autopkgtest: pybuild-autopkgtest 4234s autopkgtest [00:37:17]: test pybuild-autopkgtest: [----------------------- 4234s pybuild-autopkgtest 4235s I: pybuild pybuild:308: mkdir -pv /tmp/autopkgtest.4PKwEm/autopkgtest_tmp/.config && printf '\173 "dataframe": \173 "query-planning": False \175 \175\n' > /tmp/autopkgtest.4PKwEm/autopkgtest_tmp/.config/dask 4235s mkdir: created directory '/tmp/autopkgtest.4PKwEm/autopkgtest_tmp/.config' 4235s I: pybuild base:311: cd /tmp/autopkgtest.4PKwEm/autopkgtest_tmp/build; cd /tmp/autopkgtest.4PKwEm/autopkgtest_tmp/build; /tmp/autopkgtest.4PKwEm/build.HSC/src/debian/run-tests /tmp/autopkgtest.4PKwEm/build.HSC/src/debian/get-test-exclusions rules python3.12 -m pytest --pyargs distributed --verbose --color=no --timeout-method=signal --timeout=300 -m "not avoid_ci" 4235s *** STARTING RUN 1: python3.12 -m pytest --pyargs distributed --verbose --color=no --timeout-method=signal --timeout=300 -m not avoid_ci -rsfE --ignore=../../../../../usr/lib/python3/dist-packages/distributed/comm/tests/test_comms.py --ignore=../../../../../usr/lib/python3/dist-packages/distributed/comm/tests/test_ws.py --ignore=../../../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_adaptive.py --ignore=../../../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_local.py --ignore=../../../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_slow_adaptive.py --ignore=../../../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_spec_cluster.py --deselect=cli/tests/test_dask_scheduler.py::test_no_dashboard --deselect=deploy/tests/test_local.py::test_localcluster_get_client --deselect=deploy/tests/test_old_ssh.py::test_cluster --deselect=deploy/tests/test_old_ssh.py::test_old_ssh_nprocs_renamed_to_n_workers --deselect=deploy/tests/test_old_ssh.py::test_nprocs_attribute_is_deprecated --deselect=deploy/tests/test_ssh.py::test_nprocs_attribute_is_deprecated --deselect=http/tests/test_core.py::test_prometheus_api_doc --deselect=tests/test_init.py::test_git_revision --deselect=tests/test_jupyter.py::test_jupyter_idle_timeout --deselect=tests/test_jupyter.py::test_jupyter_idle_timeout_returned --deselect=tests/test_jupyter.py::test_jupyter_server --deselect=tests/test_jupyter.py::test_shutsdown_cleanly --deselect=tests/test_profile.py::test_stack_overflow --deselect=tests/test_pubsub.py::test_client_worker --deselect=tests/test_queues.py::test_queue_in_task --deselect=tests/test_spill.py::test_spillbuffer_oserror --deselect=tests/test_steal.py::test_steal_twice --deselect=tests/test_utils_test.py::test_cluster --deselect=tests/test_variable.py::test_variable_in_task --deselect=tests/test_worker.py::test_process_executor_kills_process --deselect=tests/test_worker_memory.py::test_fail_to_pickle_execute_1 --deselect=tests/test_worker_state_machine.py::test_task_state_instance_are_garbage_collected --deselect=protocol/tests/test_protocol.py::test_deeply_nested_structures --deselect=protocol/tests/test_serialize.py::test_deeply_nested_structures --deselect=cli/tests/test_dask_scheduler.py::test_defaults --deselect=cli/tests/test_dask_scheduler.py::test_hostport --deselect=cli/tests/test_dask_spec.py::test_errors --deselect=cli/tests/test_dask_worker.py::test_scheduler_file --deselect=cli/tests/test_dask_worker.py::test_scheduler_file --deselect=cli/tests/test_dask_worker.py::test_scheduler_file --deselect=dashboard/tests/test_scheduler_bokeh.py::test_counters --deselect=dashboard/tests/test_worker_bokeh.py::test_counters --deselect=deploy/tests/test_local.py::test_adapt_then_manual --deselect=deploy/tests/test_local.py::test_async_with --deselect=deploy/tests/test_local.py::test_close_twice --deselect=deploy/tests/test_local.py::test_cluster_info_sync --deselect=deploy/tests/test_local.py::test_local_tls --deselect=deploy/tests/test_local.py::test_no_dangling_asyncio_tasks --deselect=deploy/tests/test_local.py::test_only_local_access --deselect=deploy/tests/test_local.py::test_remote_access --deselect=diagnostics/tests/test_progress_widgets.py::test_serializers --deselect=diagnostics/tests/test_scheduler_plugin.py::test_lifecycle --deselect=http/scheduler/tests/test_missing_bokeh.py::test_missing_bokeh --deselect=http/scheduler/tests/test_scheduler_http.py::test_metrics_when_prometheus_client_not_installed --deselect=protocol/tests/test_serialize.py::test_errors --deselect=tests/test_batched.py::test_BatchedSend --deselect=tests/test_batched.py::test_close_closed --deselect=tests/test_batched.py::test_close_twice --deselect=tests/test_batched.py::test_send_after_stream_start --deselect=tests/test_batched.py::test_send_before_close --deselect=tests/test_batched.py::test_send_before_start --deselect=tests/test_batched.py::test_sending_traffic_jam --deselect=tests/test_batched.py::test_serializers --deselect=tests/test_client.py::TestClientSecurityLoader::test_security_loader --deselect=tests/test_client.py::TestClientSecurityLoader::test_security_loader_ignored_if_explicit_security_provided --deselect=tests/test_client.py::TestClientSecurityLoader::test_security_loader_ignored_if_returns_none --deselect=tests/test_client.py::test_async_with --deselect=tests/test_client.py::test_client_is_quiet_cluster_close --deselect=tests/test_client.py::test_dashboard_link_cluster --deselect=tests/test_client.py::test_dashboard_link_inproc --deselect=tests/test_client.py::test_file_descriptors_dont_leak --deselect=tests/test_client.py::test_mixing_clients_different_scheduler --deselect=tests/test_client.py::test_quiet_client_close --deselect=tests/test_client.py::test_rebalance_sync --deselect=tests/test_client.py::test_repr_localcluster --deselect=tests/test_client.py::test_security_loader --deselect=tests/test_client.py::test_security_loader_ignored_if_explicit_security_provided --deselect=tests/test_client.py::test_security_loader_ignored_if_returns_none --deselect=tests/test_client.py::test_shutdown --deselect=tests/test_client.py::test_shutdown_is_quiet_with_cluster --deselect=tests/test_client.py::test_shutdown_localcluster --deselect=tests/test_client.py::test_shutdown_stops_callbacks --deselect=tests/test_client_loop.py::test_close_loop_sync_start_new_loop --deselect=tests/test_client_loop.py::test_close_loop_sync_use_running_loop --deselect=tests/test_core.py::test_close_fast_without_active_handlers --deselect=tests/test_core.py::test_close_grace_period_for_handlers --deselect=tests/test_core.py::test_close_properly --deselect=tests/test_core.py::test_compression --deselect=tests/test_core.py::test_connection_pool --deselect=tests/test_core.py::test_connection_pool_close_while_connecting --deselect=tests/test_core.py::test_connection_pool_detects_remote_close --deselect=tests/test_core.py::test_connection_pool_outside_cancellation --deselect=tests/test_core.py::test_connection_pool_remove --deselect=tests/test_core.py::test_connection_pool_respects_limit --deselect=tests/test_core.py::test_connection_pool_tls --deselect=tests/test_core.py::test_counters --deselect=tests/test_core.py::test_deserialize_error --deselect=tests/test_core.py::test_errors --deselect=tests/test_core.py::test_identity_inproc --deselect=tests/test_core.py::test_identity_tcp --deselect=tests/test_core.py::test_large_packets_inproc --deselect=tests/test_core.py::test_messages_are_ordered_bsend --deselect=tests/test_core.py::test_messages_are_ordered_raw --deselect=tests/test_core.py::test_ports --deselect=tests/test_core.py::test_rpc_default --deselect=tests/test_core.py::test_rpc_inproc --deselect=tests/test_core.py::test_rpc_message_lifetime_default --deselect=tests/test_core.py::test_rpc_message_lifetime_inproc --deselect=tests/test_core.py::test_rpc_message_lifetime_tcp --deselect=tests/test_core.py::test_rpc_serialization --deselect=tests/test_core.py::test_rpc_tcp --deselect=tests/test_core.py::test_rpc_tls --deselect=tests/test_core.py::test_rpc_with_many_connections_inproc --deselect=tests/test_core.py::test_rpc_with_many_connections_tcp --deselect=tests/test_core.py::test_send_recv_args --deselect=tests/test_core.py::test_send_recv_cancelled --deselect=tests/test_core.py::test_server --deselect=tests/test_core.py::test_server_comms_mark_active_handlers --deselect=tests/test_core.py::test_server_raises_on_blocked_handlers --deselect=tests/test_jupyter.py::test_jupyter_idle_timeout --deselect=tests/test_jupyter.py::test_jupyter_server --deselect=tests/test_locks.py::test_errors --deselect=tests/test_nanny.py::test_scheduler_file --deselect=tests/test_nanny.py::test_scheduler_file --deselect=tests/test_nanny.py::test_scheduler_file --deselect=tests/test_nanny.py::test_worker_uses_same_host_as_nanny --deselect=tests/test_preload.py::test_failure_doesnt_crash_scheduler --deselect=tests/test_preload.py::test_preload_import_time --deselect=tests/test_preload.py::test_preload_manager_sequence --deselect=tests/test_preload.py::test_worker_preload_text --deselect=tests/test_scheduler.py::test_allowed_failures_config --deselect=tests/test_scheduler.py::test_async_context_manager --deselect=tests/test_scheduler.py::test_dashboard_host --deselect=tests/test_scheduler.py::test_file_descriptors_dont_leak --deselect=tests/test_scheduler.py::test_finished --deselect=tests/test_scheduler.py::test_multiple_listeners --deselect=tests/test_scheduler.py::test_no_dangling_asyncio_tasks --deselect=tests/test_scheduler.py::test_scheduler_file --deselect=tests/test_scheduler.py::test_scheduler_file --deselect=tests/test_scheduler.py::test_scheduler_file --deselect=tests/test_security.py::test_require_encryption --deselect=tests/test_security.py::test_tls_listen_connect --deselect=tests/test_security.py::test_tls_temporary_credentials_functional --deselect=tests/test_semaphore.py::test_threadpoolworkers_pick_correct_ioloop --deselect=tests/test_tls_functional.py::test_security_dict_input_no_security --deselect=tests/test_utils_test.py::test_ensure_no_new_clients --deselect=tests/test_utils_test.py::test_freeze_batched_send --deselect=tests/test_utils_test.py::test_locked_comm_drop_in_replacement --deselect=tests/test_utils_test.py::test_locked_comm_intercept_read --deselect=tests/test_utils_test.py::test_locked_comm_intercept_write --deselect=tests/test_worker.py::test_host_uses_scheduler_protocol --deselect=tests/test_worker.py::test_plugin_exception --deselect=tests/test_worker.py::test_plugin_internal_exception --deselect=tests/test_worker.py::test_plugin_multiple_exceptions --deselect=tests/test_worker.py::test_scheduler_file --deselect=tests/test_worker.py::test_scheduler_file --deselect=tests/test_worker.py::test_scheduler_file --deselect=tests/test_worker_client.py::test_dont_override_default_get 4237s ============================= test session starts ============================== 4237s platform linux -- Python 3.12.9, pytest-8.3.4, pluggy-1.5.0 -- /usr/bin/python3.12 4237s cachedir: .pytest_cache 4237s rootdir: /tmp/autopkgtest.4PKwEm/autopkgtest_tmp/build 4237s configfile: pyproject.toml 4237s plugins: timeout-2.3.1, rerunfailures-15.0, anyio-4.7.0, typeguard-4.4.1 4237s timeout: 300.0s 4237s timeout method: signal 4237s timeout func_only: False 4248s collecting ... collected 3392 items / 160 deselected / 30 skipped / 3232 selected 4248s 4248s cli/tests/test_dask_scheduler.py::test_dashboard <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py SKIPPED [ 0%] 4248s cli/tests/test_dask_scheduler.py::test_dashboard_non_standard_ports <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py SKIPPED [ 0%] 4249s cli/tests/test_dask_scheduler.py::test_multiple_protocols <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py PASSED [ 0%] 4249s cli/tests/test_dask_scheduler.py::test_dashboard_allowlist <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py SKIPPED [ 0%] 4252s cli/tests/test_dask_scheduler.py::test_interface <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py PASSED [ 0%] 4254s cli/tests/test_dask_scheduler.py::test_pid_file <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py PASSED [ 0%] 4256s cli/tests/test_dask_scheduler.py::test_scheduler_port_zero <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py PASSED [ 0%] 4256s cli/tests/test_dask_scheduler.py::test_dashboard_port_zero <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py SKIPPED [ 0%] 4257s cli/tests/test_dask_scheduler.py::test_preload_file <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py PASSED [ 0%] 4258s cli/tests/test_dask_scheduler.py::test_preload_module <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py PASSED [ 0%] 4259s cli/tests/test_dask_scheduler.py::test_preload_remote_module <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py PASSED [ 0%] 4261s cli/tests/test_dask_scheduler.py::test_preload_config <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py PASSED [ 0%] 4262s cli/tests/test_dask_scheduler.py::test_preload_command <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py PASSED [ 0%] 4264s cli/tests/test_dask_scheduler.py::test_preload_command_default <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py PASSED [ 0%] 4264s cli/tests/test_dask_scheduler.py::test_version_option <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py PASSED [ 0%] 4264s cli/tests/test_dask_scheduler.py::test_idle_timeout <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py SKIPPED [ 0%] 4264s cli/tests/test_dask_scheduler.py::test_restores_signal_handler <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py SKIPPED [ 0%] 4267s cli/tests/test_dask_scheduler.py::test_multiple_workers_2 <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py PASSED [ 0%] 4270s cli/tests/test_dask_scheduler.py::test_multiple_workers <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py PASSED [ 0%] 4270s cli/tests/test_dask_scheduler.py::test_signal_handling[2] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py SKIPPED [ 0%] 4270s cli/tests/test_dask_scheduler.py::test_signal_handling[15] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py SKIPPED [ 0%] 4272s cli/tests/test_dask_scheduler.py::test_single_executable_deprecated <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py PASSED [ 0%] 4274s cli/tests/test_dask_spec.py::test_text <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_spec.py PASSED [ 0%] 4276s cli/tests/test_dask_spec.py::test_file <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_spec.py PASSED [ 0%] 4278s cli/tests/test_dask_spec.py::test_signal_handling_worker[2-Nanny] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_spec.py PASSED [ 0%] 4279s cli/tests/test_dask_spec.py::test_signal_handling_worker[2-Worker] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_spec.py PASSED [ 0%] 4281s cli/tests/test_dask_spec.py::test_signal_handling_worker[15-Nanny] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_spec.py PASSED [ 0%] 4283s cli/tests/test_dask_spec.py::test_signal_handling_worker[15-Worker] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_spec.py PASSED [ 0%] 4285s cli/tests/test_dask_spec.py::test_signal_handling_scheduler[2] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_spec.py PASSED [ 0%] 4287s cli/tests/test_dask_spec.py::test_signal_handling_scheduler[15] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_spec.py PASSED [ 0%] 4287s cli/tests/test_dask_worker.py::test_apportion_ports[args0-expect0] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 0%] 4287s cli/tests/test_dask_worker.py::test_apportion_ports[args1-expect1] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 0%] 4287s cli/tests/test_dask_worker.py::test_apportion_ports[args2-expect2] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 1%] 4287s cli/tests/test_dask_worker.py::test_apportion_ports[args3-expect3] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 1%] 4287s cli/tests/test_dask_worker.py::test_apportion_ports[args4-expect4] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 1%] 4287s cli/tests/test_dask_worker.py::test_apportion_ports[args5-expect5] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 1%] 4287s cli/tests/test_dask_worker.py::test_apportion_ports[args6-expect6] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 1%] 4287s cli/tests/test_dask_worker.py::test_apportion_ports[args7-expect7] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 1%] 4287s cli/tests/test_dask_worker.py::test_apportion_ports[args8-expect8] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 1%] 4287s cli/tests/test_dask_worker.py::test_apportion_ports[args9-expect9] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 1%] 4287s cli/tests/test_dask_worker.py::test_apportion_ports[args10-expect10] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 1%] 4287s cli/tests/test_dask_worker.py::test_apportion_ports[args11-expect11] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 1%] 4287s cli/tests/test_dask_worker.py::test_apportion_ports[args12-expect12] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 1%] 4287s cli/tests/test_dask_worker.py::test_apportion_ports[args13-expect13] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 1%] 4287s cli/tests/test_dask_worker.py::test_apportion_ports[args14-expect14] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 1%] 4287s cli/tests/test_dask_worker.py::test_apportion_ports[args15-expect15] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 1%] 4287s cli/tests/test_dask_worker.py::test_apportion_ports[args16-expect16] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 1%] 4287s cli/tests/test_dask_worker.py::test_apportion_ports[args17-expect17] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 1%] 4287s cli/tests/test_dask_worker.py::test_apportion_ports_bad <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 1%] 4287s cli/tests/test_dask_worker.py::test_nanny_worker_ports <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py SKIPPED [ 1%] 4287s cli/tests/test_dask_worker.py::test_nanny_worker_port_range <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py SKIPPED [ 1%] 4288s cli/tests/test_dask_worker.py::test_nanny_worker_port_range_too_many_workers_raises <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 1%] 4288s cli/tests/test_dask_worker.py::test_memory_limit <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py SKIPPED [ 1%] 4289s cli/tests/test_dask_worker.py::test_no_nanny <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 1%] 4289s cli/tests/test_dask_worker.py::test_resources <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py SKIPPED [ 1%] 4289s cli/tests/test_dask_worker.py::test_local_directory[--nanny] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py SKIPPED [ 1%] 4289s cli/tests/test_dask_worker.py::test_local_directory[--no-nanny] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py SKIPPED [ 1%] 4289s cli/tests/test_dask_worker.py::test_scheduler_address_env <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py SKIPPED [ 1%] 4290s cli/tests/test_dask_worker.py::test_nworkers_requires_nanny <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 1%] 4290s cli/tests/test_dask_worker.py::test_nworkers_negative <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py SKIPPED [ 1%] 4290s cli/tests/test_dask_worker.py::test_nworkers_auto <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py SKIPPED [ 1%] 4290s cli/tests/test_dask_worker.py::test_nworkers_expands_name <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py SKIPPED [ 1%] 4290s cli/tests/test_dask_worker.py::test_contact_listen_address[tcp://0.0.0.0:---nanny] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py SKIPPED [ 1%] 4290s cli/tests/test_dask_worker.py::test_contact_listen_address[tcp://0.0.0.0:---no-nanny] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py SKIPPED [ 1%] 4290s cli/tests/test_dask_worker.py::test_contact_listen_address[tcp://127.0.0.2:---nanny] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py SKIPPED [ 2%] 4290s cli/tests/test_dask_worker.py::test_contact_listen_address[tcp://127.0.0.2:---no-nanny] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py SKIPPED [ 2%] 4290s cli/tests/test_dask_worker.py::test_listen_address_ipv6[tcp://:---nanny] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py SKIPPED [ 2%] 4290s cli/tests/test_dask_worker.py::test_listen_address_ipv6[tcp://:---no-nanny] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py SKIPPED [ 2%] 4290s cli/tests/test_dask_worker.py::test_listen_address_ipv6[tcp://[::1]:---nanny] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py SKIPPED [ 2%] 4290s cli/tests/test_dask_worker.py::test_listen_address_ipv6[tcp://[::1]:---no-nanny] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py SKIPPED [ 2%] 4290s cli/tests/test_dask_worker.py::test_respect_host_listen_address[127.0.0.2---nanny] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py SKIPPED [ 2%] 4290s cli/tests/test_dask_worker.py::test_respect_host_listen_address[127.0.0.2---no-nanny] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py SKIPPED [ 2%] 4290s cli/tests/test_dask_worker.py::test_respect_host_listen_address[0.0.0.0---nanny] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py SKIPPED [ 2%] 4290s cli/tests/test_dask_worker.py::test_respect_host_listen_address[0.0.0.0---no-nanny] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py SKIPPED [ 2%] 4290s cli/tests/test_dask_worker.py::test_dashboard_non_standard_ports <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py SKIPPED [ 2%] 4290s cli/tests/test_dask_worker.py::test_version_option <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 2%] 4290s cli/tests/test_dask_worker.py::test_worker_timeout[True] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py SKIPPED [ 2%] 4290s cli/tests/test_dask_worker.py::test_worker_timeout[False] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py SKIPPED [ 2%] 4290s cli/tests/test_dask_worker.py::test_integer_names <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py SKIPPED [ 2%] 4290s cli/tests/test_dask_worker.py::test_worker_class[--nanny] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py SKIPPED [ 2%] 4290s cli/tests/test_dask_worker.py::test_worker_class[--no-nanny] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py SKIPPED [ 2%] 4290s cli/tests/test_dask_worker.py::test_preload_config <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py SKIPPED [ 2%] 4290s cli/tests/test_dask_worker.py::test_set_lifetime_stagger_via_env_var <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py SKIPPED [ 2%] 4290s cli/tests/test_dask_worker.py::test_set_lifetime_restart_via_env_var <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py SKIPPED [ 2%] 4290s cli/tests/test_dask_worker.py::test_timeout[--nanny] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py SKIPPED [ 2%] 4290s cli/tests/test_dask_worker.py::test_timeout[--no-nanny] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py SKIPPED [ 2%] 4292s cli/tests/test_dask_worker.py::test_signal_handling[2---nanny] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 2%] 4293s cli/tests/test_dask_worker.py::test_signal_handling[2---no-nanny] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 2%] 4295s cli/tests/test_dask_worker.py::test_signal_handling[15---nanny] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 2%] 4297s cli/tests/test_dask_worker.py::test_signal_handling[15---no-nanny] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 2%] 4300s cli/tests/test_dask_worker.py::test_error_during_startup[--nanny] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 2%] 4305s cli/tests/test_dask_worker.py::test_error_during_startup[--no-nanny] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 2%] 4308s cli/tests/test_dask_worker.py::test_single_executable_deprecated <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 2%] 4308s cli/tests/test_dask_worker.py::test_single_executable_works <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py SKIPPED [ 2%] 4311s cli/tests/test_tls_cli.py::test_basic <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_tls_cli.py PASSED [ 2%] 4313s cli/tests/test_tls_cli.py::test_sni <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_tls_cli.py PASSED [ 2%] 4316s cli/tests/test_tls_cli.py::test_nanny <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_tls_cli.py PASSED [ 3%] 4319s cli/tests/test_tls_cli.py::test_separate_key_cert <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_tls_cli.py PASSED [ 3%] 4322s cli/tests/test_tls_cli.py::test_use_config_file <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_tls_cli.py PASSED [ 3%] 4322s comm/tests/test_tcp.py::test_getaddrinfo_invalid_af <- ../../../../usr/lib/python3/dist-packages/distributed/comm/tests/test_tcp.py PASSED [ 3%] 4322s dashboard/tests/test_bokeh.py::test_old_import <- ../../../../usr/lib/python3/dist-packages/distributed/dashboard/tests/test_bokeh.py PASSED [ 3%] 4322s deploy/tests/test_adaptive_core.py::test_safe_target <- ../../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_adaptive_core.py PASSED [ 3%] 4322s deploy/tests/test_adaptive_core.py::test_scale_up <- ../../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_adaptive_core.py PASSED [ 3%] 4322s deploy/tests/test_adaptive_core.py::test_scale_down <- ../../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_adaptive_core.py PASSED [ 3%] 4322s deploy/tests/test_cluster.py::test_eq <- ../../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_cluster.py PASSED [ 3%] 4322s deploy/tests/test_cluster.py::test_repr <- ../../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_cluster.py PASSED [ 3%] 4325s deploy/tests/test_cluster.py::test_cluster_wait_for_worker <- ../../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_cluster.py PASSED [ 3%] 4325s deploy/tests/test_cluster.py::test_deprecated_loop_properties <- ../../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_cluster.py PASSED [ 3%] 4325s deploy/tests/test_cluster.py::test_exponential_backoff <- ../../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_cluster.py PASSED [ 3%] 4325s deploy/tests/test_cluster.py::test_sync_context_manager_used_with_async_cluster <- ../../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_cluster.py PASSED [ 3%] 4325s deploy/tests/test_deploy_utils.py::test_default_process_thread_breakdown <- ../../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_deploy_utils.py PASSED [ 3%] 4328s deploy/tests/test_subprocess.py::test_basic <- ../../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_subprocess.py PASSED [ 3%] 4331s deploy/tests/test_subprocess.py::test_n_workers <- ../../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_subprocess.py PASSED [ 3%] 4334s deploy/tests/test_subprocess.py::test_scale_up_and_down <- ../../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_subprocess.py PASSED [ 3%] 4336s deploy/tests/test_subprocess.py::test_raise_if_scheduler_fails_to_start <- ../../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_subprocess.py PASSED [ 3%] 4336s deploy/tests/test_subprocess.py::test_subprocess_cluster_does_not_depend_on_logging <- ../../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_subprocess.py SKIPPED [ 3%] 4336s deploy/tests/test_subprocess.py::test_raise_on_windows <- ../../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_subprocess.py SKIPPED [ 3%] 4338s diagnostics/tests/test_cluster_dump_plugin.py::test_cluster_dump_plugin <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_cluster_dump_plugin.py PASSED [ 3%] 4338s diagnostics/tests/test_eventstream.py::test_eventstream <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_eventstream.py SKIPPED [ 3%] 4338s diagnostics/tests/test_eventstream.py::test_eventstream_remote <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_eventstream.py PASSED [ 3%] 4338s diagnostics/tests/test_graph_layout.py::test_basic <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_graph_layout.py PASSED [ 3%] 4338s diagnostics/tests/test_graph_layout.py::test_construct_after_call <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_graph_layout.py PASSED [ 3%] 4338s diagnostics/tests/test_graph_layout.py::test_states <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_graph_layout.py PASSED [ 3%] 4338s diagnostics/tests/test_graph_layout.py::test_release_tasks <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_graph_layout.py PASSED [ 3%] 4339s diagnostics/tests/test_graph_layout.py::test_forget <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_graph_layout.py PASSED [ 3%] 4339s diagnostics/tests/test_graph_layout.py::test_unique_positions <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_graph_layout.py PASSED [ 3%] 4339s diagnostics/tests/test_graph_layout.py::test_layout_scatter <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_graph_layout.py PASSED [ 3%] 4339s diagnostics/tests/test_install_plugin.py::test_pip_install <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_install_plugin.py PASSED [ 3%] 4339s diagnostics/tests/test_install_plugin.py::test_conda_install <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_install_plugin.py PASSED [ 3%] 4339s diagnostics/tests/test_install_plugin.py::test_pip_install_fails <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_install_plugin.py PASSED [ 4%] 4339s diagnostics/tests/test_install_plugin.py::test_conda_install_fails_when_conda_not_found <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_install_plugin.py PASSED [ 4%] 4339s diagnostics/tests/test_install_plugin.py::test_conda_install_fails_when_conda_raises <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_install_plugin.py PASSED [ 4%] 4339s diagnostics/tests/test_install_plugin.py::test_conda_install_fails_on_returncode <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_install_plugin.py PASSED [ 4%] 4339s diagnostics/tests/test_install_plugin.py::test_package_install_on_worker <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_install_plugin.py SKIPPED [ 4%] 4339s diagnostics/tests/test_install_plugin.py::test_package_install_on_nanny <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_install_plugin.py SKIPPED [ 4%] 4339s diagnostics/tests/test_install_plugin.py::test_package_install_restarts_on_nanny <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_install_plugin.py SKIPPED [ 4%] 4341s diagnostics/tests/test_install_plugin.py::test_package_install_failing_does_not_restart_on_nanny <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_install_plugin.py PASSED [ 4%] 4343s diagnostics/tests/test_memory_sampler.py::test_sync <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_memory_sampler.py PASSED [ 4%] 4343s diagnostics/tests/test_memory_sampler.py::test_at_least_one_sample <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_memory_sampler.py PASSED [ 4%] 4343s diagnostics/tests/test_memory_sampler.py::test_multi_sample <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_memory_sampler.py PASSED [ 4%] 4343s diagnostics/tests/test_memory_sampler.py::test_pandas[False] <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_memory_sampler.py SKIPPED [ 4%] 4343s diagnostics/tests/test_memory_sampler.py::test_pandas[True] <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_memory_sampler.py SKIPPED [ 4%] 4344s diagnostics/tests/test_memory_sampler.py::test_pandas_multiseries[False] <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_memory_sampler.py PASSED [ 4%] 4344s diagnostics/tests/test_memory_sampler.py::test_pandas_multiseries[True] <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_memory_sampler.py PASSED [ 4%] 4346s diagnostics/tests/test_nanny_plugin.py::test_register_worker_plugin_is_deprecated <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_nanny_plugin.py PASSED [ 4%] 4347s diagnostics/tests/test_nanny_plugin.py::test_register_worker_plugin_typing_over_nanny_keyword <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_nanny_plugin.py PASSED [ 4%] 4349s diagnostics/tests/test_nanny_plugin.py::test_duck_typed_register_nanny_plugin_is_deprecated <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_nanny_plugin.py PASSED [ 4%] 4350s diagnostics/tests/test_nanny_plugin.py::test_register_idempotent_plugin <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_nanny_plugin.py PASSED [ 4%] 4352s diagnostics/tests/test_nanny_plugin.py::test_register_non_idempotent_plugin <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_nanny_plugin.py PASSED [ 4%] 4353s diagnostics/tests/test_nanny_plugin.py::test_register_plugin_with_idempotent_keyword_is_deprecated <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_nanny_plugin.py PASSED [ 4%] 4355s diagnostics/tests/test_nanny_plugin.py::test_register_plugin_with_broken_setup_to_existing_nannies_raises <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_nanny_plugin.py PASSED [ 4%] 4357s diagnostics/tests/test_nanny_plugin.py::test_plugin_with_broken_setup_on_new_nanny_logs <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_nanny_plugin.py PASSED [ 4%] 4358s diagnostics/tests/test_nanny_plugin.py::test_unregister_nanny_plugin_with_broken_teardown_raises <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_nanny_plugin.py PASSED [ 4%] 4359s diagnostics/tests/test_nanny_plugin.py::test_nanny_plugin_with_broken_teardown_logs_on_close <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_nanny_plugin.py PASSED [ 4%] 4360s diagnostics/tests/test_progress.py::test_many_Progress <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_progress.py PASSED [ 4%] 4360s diagnostics/tests/test_progress.py::test_multiprogress <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_progress.py PASSED [ 4%] 4360s diagnostics/tests/test_progress.py::test_multiprogress_cancel <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_progress.py PASSED [ 4%] 4360s diagnostics/tests/test_progress.py::test_multiprogress_with_spans <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_progress.py PASSED [ 4%] 4360s diagnostics/tests/test_progress.py::test_multiprogress_with_prefix <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_progress.py PASSED [ 4%] 4360s diagnostics/tests/test_progress.py::test_multiprogress_warns <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_progress.py PASSED [ 4%] 4360s diagnostics/tests/test_progress.py::test_robust_to_bad_plugin <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_progress.py PASSED [ 4%] 4365s diagnostics/tests/test_progress.py::test_AllProgress <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_progress.py PASSED [ 5%] 4367s diagnostics/tests/test_progress.py::test_AllProgress_lost_key <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_progress.py PASSED [ 5%] 4372s diagnostics/tests/test_progress.py::test_group_timing <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_progress.py PASSED [ 5%] 4374s diagnostics/tests/test_progressbar.py::test_text_progressbar <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_progressbar.py PASSED [ 5%] 4374s diagnostics/tests/test_progressbar.py::test_TextProgressBar_error <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_progressbar.py PASSED [ 5%] 4374s diagnostics/tests/test_progressbar.py::test_TextProgressBar_empty <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_progressbar.py PASSED [ 5%] 4376s diagnostics/tests/test_progressbar.py::test_progress_function <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_progressbar.py PASSED [ 5%] 4377s diagnostics/tests/test_progressbar.py::test_progress_function_w_kwargs <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_progressbar.py PASSED [ 5%] 4379s diagnostics/tests/test_progressbar.py::test_progress_function_warns <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_progressbar.py PASSED [ 5%] 4379s diagnostics/tests/test_progressbar.py::test_progress_function_raises <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_progressbar.py PASSED [ 5%] 4379s diagnostics/tests/test_progressbar.py::test_deprecated_loop_properties <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_progressbar.py PASSED [ 5%] 4379s diagnostics/tests/test_scheduler_plugin.py::test_simple <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_scheduler_plugin.py PASSED [ 5%] 4379s diagnostics/tests/test_scheduler_plugin.py::test_add_remove_worker <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_scheduler_plugin.py PASSED [ 5%] 4379s diagnostics/tests/test_scheduler_plugin.py::test_remove_worker_renamed_kwargs_allowed <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_scheduler_plugin.py PASSED [ 5%] 4379s diagnostics/tests/test_scheduler_plugin.py::test_remove_worker_without_kwargs_deprecated <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_scheduler_plugin.py PASSED [ 5%] 4379s diagnostics/tests/test_scheduler_plugin.py::test_async_add_remove_worker <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_scheduler_plugin.py PASSED [ 5%] 4379s diagnostics/tests/test_scheduler_plugin.py::test_async_and_sync_add_remove_worker <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_scheduler_plugin.py PASSED [ 5%] 4379s diagnostics/tests/test_scheduler_plugin.py::test_failing_async_add_remove_worker <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_scheduler_plugin.py PASSED [ 5%] 4379s diagnostics/tests/test_scheduler_plugin.py::test_failing_sync_add_remove_worker <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_scheduler_plugin.py PASSED [ 5%] 4379s diagnostics/tests/test_scheduler_plugin.py::test_register_plugin <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_scheduler_plugin.py PASSED [ 5%] 4379s diagnostics/tests/test_scheduler_plugin.py::test_register_scheduler_plugin_deprecated <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_scheduler_plugin.py PASSED [ 5%] 4379s diagnostics/tests/test_scheduler_plugin.py::test_unregister_scheduler_plugin <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_scheduler_plugin.py PASSED [ 5%] 4379s diagnostics/tests/test_scheduler_plugin.py::test_unregister_scheduler_plugin_from_client <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_scheduler_plugin.py PASSED [ 5%] 4379s diagnostics/tests/test_scheduler_plugin.py::test_register_plugin_on_scheduler <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_scheduler_plugin.py PASSED [ 5%] 4382s diagnostics/tests/test_scheduler_plugin.py::test_closing_errors_ok <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_scheduler_plugin.py PASSED [ 5%] 4382s diagnostics/tests/test_scheduler_plugin.py::test_update_graph_hook_simple <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_scheduler_plugin.py PASSED [ 5%] 4382s diagnostics/tests/test_scheduler_plugin.py::test_update_graph_hook_complex <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_scheduler_plugin.py PASSED [ 5%] 4382s diagnostics/tests/test_scheduler_plugin.py::test_scheduler_plugin_in_register_worker_plugin_overrides <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_scheduler_plugin.py PASSED [ 5%] 4383s diagnostics/tests/test_scheduler_plugin.py::test_scheduler_plugin_in_register_worker_plugin_overrides_nanny <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_scheduler_plugin.py PASSED [ 5%] 4383s diagnostics/tests/test_scheduler_plugin.py::test_register_idempotent_plugin <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_scheduler_plugin.py PASSED [ 5%] 4383s diagnostics/tests/test_scheduler_plugin.py::test_register_non_idempotent_plugin <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_scheduler_plugin.py PASSED [ 5%] 4383s diagnostics/tests/test_scheduler_plugin.py::test_register_plugin_with_idempotent_keyword_is_deprecated <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_scheduler_plugin.py PASSED [ 5%] 4383s diagnostics/tests/test_scheduler_plugin.py::test_register_idempotent_plugins_directly <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_scheduler_plugin.py PASSED [ 6%] 4383s diagnostics/tests/test_scheduler_plugin.py::test_register_non_idempotent_plugins_directly <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_scheduler_plugin.py PASSED [ 6%] 4383s diagnostics/tests/test_task_stream.py::test_TaskStreamPlugin <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_task_stream.py PASSED [ 6%] 4384s diagnostics/tests/test_task_stream.py::test_maxlen <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_task_stream.py PASSED [ 6%] 4384s diagnostics/tests/test_task_stream.py::test_collect <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_task_stream.py PASSED [ 6%] 4384s diagnostics/tests/test_task_stream.py::test_no_startstops <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_task_stream.py PASSED [ 6%] 4385s diagnostics/tests/test_task_stream.py::test_client <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_task_stream.py PASSED [ 6%] 4386s diagnostics/tests/test_task_stream.py::test_client_sync <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_task_stream.py PASSED [ 6%] 4386s diagnostics/tests/test_task_stream.py::test_get_task_stream_plot <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_task_stream.py SKIPPED [ 6%] 4388s diagnostics/tests/test_task_stream.py::test_get_task_stream_save <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_task_stream.py SKIPPED [ 6%] 4388s diagnostics/tests/test_worker_plugin.py::test_create_with_client <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_worker_plugin.py PASSED [ 6%] 4388s diagnostics/tests/test_worker_plugin.py::test_remove_with_client <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_worker_plugin.py PASSED [ 6%] 4388s diagnostics/tests/test_worker_plugin.py::test_remove_with_client_raises <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_worker_plugin.py PASSED [ 6%] 4388s diagnostics/tests/test_worker_plugin.py::test_create_on_construction <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_worker_plugin.py PASSED [ 6%] 4388s diagnostics/tests/test_worker_plugin.py::test_normal_task_transitions_called <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_worker_plugin.py PASSED [ 6%] 4389s diagnostics/tests/test_worker_plugin.py::test_failing_task_transitions_called <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_worker_plugin.py PASSED [ 6%] 4389s diagnostics/tests/test_worker_plugin.py::test_superseding_task_transitions_called <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_worker_plugin.py PASSED [ 6%] 4389s diagnostics/tests/test_worker_plugin.py::test_dependent_tasks <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_worker_plugin.py PASSED [ 6%] 4389s diagnostics/tests/test_worker_plugin.py::test_empty_plugin <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_worker_plugin.py PASSED [ 6%] 4389s diagnostics/tests/test_worker_plugin.py::test_default_name <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_worker_plugin.py PASSED [ 6%] 4389s diagnostics/tests/test_worker_plugin.py::test_assert_no_warning_no_overload <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_worker_plugin.py PASSED [ 6%] 4389s diagnostics/tests/test_worker_plugin.py::test_WorkerPlugin_overwrite <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_worker_plugin.py PASSED [ 6%] 4389s diagnostics/tests/test_worker_plugin.py::test_register_worker_plugin_is_deprecated <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_worker_plugin.py PASSED [ 6%] 4389s diagnostics/tests/test_worker_plugin.py::test_register_worker_plugin_typing_over_nanny_keyword <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_worker_plugin.py PASSED [ 6%] 4389s diagnostics/tests/test_worker_plugin.py::test_duck_typed_register_worker_plugin_is_deprecated <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_worker_plugin.py PASSED [ 6%] 4389s diagnostics/tests/test_worker_plugin.py::test_register_idempotent_plugin <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_worker_plugin.py PASSED [ 6%] 4389s diagnostics/tests/test_worker_plugin.py::test_register_non_idempotent_plugin <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_worker_plugin.py PASSED [ 6%] 4389s diagnostics/tests/test_worker_plugin.py::test_register_plugin_with_idempotent_keyword_is_deprecated <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_worker_plugin.py PASSED [ 6%] 4389s diagnostics/tests/test_worker_plugin.py::test_register_plugin_with_broken_setup_to_existing_workers_raises <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_worker_plugin.py PASSED [ 6%] 4390s diagnostics/tests/test_worker_plugin.py::test_plugin_with_broken_setup_on_new_worker_logs <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_worker_plugin.py PASSED [ 6%] 4390s diagnostics/tests/test_worker_plugin.py::test_unregister_worker_plugin_with_broken_teardown_raises <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_worker_plugin.py PASSED [ 6%] 4390s diagnostics/tests/test_worker_plugin.py::test_plugin_with_broken_teardown_logs_on_close <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_worker_plugin.py PASSED [ 6%] 4390s http/scheduler/tests/test_missing_bokeh.py::test_bokeh_version_too_low <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_missing_bokeh.py SKIPPED [ 6%] 4390s http/scheduler/tests/test_missing_bokeh.py::test_bokeh_version_too_high <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_missing_bokeh.py SKIPPED [ 7%] 4390s http/scheduler/tests/test_scheduler_http.py::test_connect <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 7%] 4390s http/scheduler/tests/test_scheduler_http.py::test_worker_404 <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 7%] 4390s http/scheduler/tests/test_scheduler_http.py::test_prefix <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py SKIPPED [ 7%] 4390s http/scheduler/tests/test_scheduler_http.py::test_prometheus <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 7%] 4390s http/scheduler/tests/test_scheduler_http.py::test_prometheus_collect_client_connections_totals <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 7%] 4391s http/scheduler/tests/test_scheduler_http.py::test_prometheus_collect_task_states <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 7%] 4391s http/scheduler/tests/test_scheduler_http.py::test_prometheus_collect_task_groups <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 7%] 4391s http/scheduler/tests/test_scheduler_http.py::test_prometheus_collect_task_prefix_counts <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 7%] 4391s http/scheduler/tests/test_scheduler_http.py::test_prometheus_collect_worker_totals <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 7%] 4392s http/scheduler/tests/test_scheduler_http.py::test_prometheus_collect_worker_states <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 7%] 4392s http/scheduler/tests/test_scheduler_http.py::test_health <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py SKIPPED [ 7%] 4392s http/scheduler/tests/test_scheduler_http.py::test_sitemap <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 7%] 4392s http/scheduler/tests/test_scheduler_http.py::test_task_page[1_0] <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 7%] 4392s http/scheduler/tests/test_scheduler_http.py::test_task_page[1_1] <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 7%] 4392s http/scheduler/tests/test_scheduler_http.py::test_task_page[x] <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 7%] 4392s http/scheduler/tests/test_scheduler_http.py::test_task_page[a+b] <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 7%] 4392s http/scheduler/tests/test_scheduler_http.py::test_task_page[a b] <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 7%] 4392s http/scheduler/tests/test_scheduler_http.py::test_task_page[key5] <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 7%] 4393s http/scheduler/tests/test_scheduler_http.py::test_task_page[key6] <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 7%] 4393s http/scheduler/tests/test_scheduler_http.py::test_task_page[key7] <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 7%] 4393s http/scheduler/tests/test_scheduler_http.py::test_task_page[key8] <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 7%] 4393s http/scheduler/tests/test_scheduler_http.py::test_task_page[(] <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 7%] 4393s http/scheduler/tests/test_scheduler_http.py::test_task_page[[] <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 7%] 4393s http/scheduler/tests/test_scheduler_http.py::test_task_page['] <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 7%] 4393s http/scheduler/tests/test_scheduler_http.py::test_task_page["] <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 7%] 4393s http/scheduler/tests/test_scheduler_http.py::test_task_page[123] <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 7%] 4393s http/scheduler/tests/test_scheduler_http.py::test_task_page[key14] <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 7%] 4393s http/scheduler/tests/test_scheduler_http.py::test_task_page[key15] <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 7%] 4394s http/scheduler/tests/test_scheduler_http.py::test_task_page[key16] <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 7%] 4394s http/scheduler/tests/test_scheduler_http.py::test_task_page[key17] <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 7%] 4394s http/scheduler/tests/test_scheduler_http.py::test_task_page[key18] <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 7%] 4394s http/scheduler/tests/test_scheduler_http.py::test_call_stack_page[1_0] <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 8%] 4394s http/scheduler/tests/test_scheduler_http.py::test_call_stack_page[1_1] <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 8%] 4394s http/scheduler/tests/test_scheduler_http.py::test_call_stack_page[x] <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 8%] 4394s http/scheduler/tests/test_scheduler_http.py::test_call_stack_page[a+b] <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 8%] 4394s http/scheduler/tests/test_scheduler_http.py::test_call_stack_page[a b] <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 8%] 4394s http/scheduler/tests/test_scheduler_http.py::test_call_stack_page[key5] <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 8%] 4395s http/scheduler/tests/test_scheduler_http.py::test_call_stack_page[key6] <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 8%] 4395s http/scheduler/tests/test_scheduler_http.py::test_call_stack_page[key7] <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 8%] 4395s http/scheduler/tests/test_scheduler_http.py::test_call_stack_page[key8] <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 8%] 4395s http/scheduler/tests/test_scheduler_http.py::test_call_stack_page[(] <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 8%] 4395s http/scheduler/tests/test_scheduler_http.py::test_call_stack_page[[] <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 8%] 4395s http/scheduler/tests/test_scheduler_http.py::test_call_stack_page['] <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 8%] 4395s http/scheduler/tests/test_scheduler_http.py::test_call_stack_page["] <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 8%] 4395s http/scheduler/tests/test_scheduler_http.py::test_call_stack_page[123] <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 8%] 4395s http/scheduler/tests/test_scheduler_http.py::test_call_stack_page[key14] <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 8%] 4396s http/scheduler/tests/test_scheduler_http.py::test_call_stack_page[key15] <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 8%] 4396s http/scheduler/tests/test_scheduler_http.py::test_call_stack_page[key16] <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 8%] 4396s http/scheduler/tests/test_scheduler_http.py::test_call_stack_page[key17] <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 8%] 4396s http/scheduler/tests/test_scheduler_http.py::test_call_stack_page[key18] <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 8%] 4396s http/scheduler/tests/test_scheduler_http.py::test_allow_websocket_origin <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py SKIPPED [ 8%] 4396s http/scheduler/tests/test_scheduler_http.py::test_eventstream <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 8%] 4396s http/scheduler/tests/test_scheduler_http.py::test_api_disabled_by_default <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 8%] 4396s http/scheduler/tests/test_scheduler_http.py::test_api <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py SKIPPED [ 8%] 4396s http/scheduler/tests/test_scheduler_http.py::test_retire_workers <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py SKIPPED [ 8%] 4396s http/scheduler/tests/test_scheduler_http.py::test_get_workers <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py SKIPPED [ 8%] 4396s http/scheduler/tests/test_scheduler_http.py::test_adaptive_target <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py SKIPPED [ 8%] 4396s http/scheduler/tests/test_scheduler_http.py::test_check_idle <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py SKIPPED [ 8%] 4397s http/scheduler/tests/test_semaphore_http.py::test_prometheus <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_semaphore_http.py PASSED [ 8%] 4397s http/scheduler/tests/test_semaphore_http.py::test_prometheus_without_semaphore_extension <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_semaphore_http.py PASSED [ 8%] 4397s http/scheduler/tests/test_stealing_http.py::test_prometheus <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_stealing_http.py PASSED [ 8%] 4397s http/scheduler/tests/test_stealing_http.py::test_prometheus_collect_count_total_by_cost_multipliers <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_stealing_http.py PASSED [ 8%] 4398s http/scheduler/tests/test_stealing_http.py::test_prometheus_collect_cost_total_by_cost_multipliers <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_stealing_http.py PASSED [ 8%] 4398s http/scheduler/tests/test_stealing_http.py::test_prometheus_without_stealing_extension <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_stealing_http.py PASSED [ 9%] 4398s http/tests/test_core.py::test_scheduler <- ../../../../usr/lib/python3/dist-packages/distributed/http/tests/test_core.py PASSED [ 9%] 4398s http/tests/test_routing.py::test_basic <- ../../../../usr/lib/python3/dist-packages/distributed/http/tests/test_routing.py PASSED [ 9%] 4398s http/worker/tests/test_worker_http.py::test_prometheus <- ../../../../usr/lib/python3/dist-packages/distributed/http/worker/tests/test_worker_http.py PASSED [ 9%] 4398s http/worker/tests/test_worker_http.py::test_metrics_when_prometheus_client_not_installed <- ../../../../usr/lib/python3/dist-packages/distributed/http/worker/tests/test_worker_http.py PASSED [ 9%] 4399s http/worker/tests/test_worker_http.py::test_prometheus_collect_task_states <- ../../../../usr/lib/python3/dist-packages/distributed/http/worker/tests/test_worker_http.py PASSED [ 9%] 4399s http/worker/tests/test_worker_http.py::test_health <- ../../../../usr/lib/python3/dist-packages/distributed/http/worker/tests/test_worker_http.py SKIPPED [ 9%] 4399s http/worker/tests/test_worker_http.py::test_sitemap <- ../../../../usr/lib/python3/dist-packages/distributed/http/worker/tests/test_worker_http.py SKIPPED [ 9%] 4399s http/worker/tests/test_worker_http.py::test_prometheus_collect_memory_metrics <- ../../../../usr/lib/python3/dist-packages/distributed/http/worker/tests/test_worker_http.py PASSED [ 9%] 4399s http/worker/tests/test_worker_http.py::test_prometheus_collect_memory_metrics_spill_disabled <- ../../../../usr/lib/python3/dist-packages/distributed/http/worker/tests/test_worker_http.py PASSED [ 9%] 4399s http/worker/tests/test_worker_http.py::test_prometheus_collect_memory_metrics_bogus_sizeof <- ../../../../usr/lib/python3/dist-packages/distributed/http/worker/tests/test_worker_http.py SKIPPED [ 9%] 4399s protocol/tests/test_collection.py::test_serialize_collection[y0-dask-tuple] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_collection.py PASSED [ 9%] 4399s protocol/tests/test_collection.py::test_serialize_collection[y0-dask-dict] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_collection.py PASSED [ 9%] 4399s protocol/tests/test_collection.py::test_serialize_collection[y0-dask-list] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_collection.py PASSED [ 9%] 4399s protocol/tests/test_collection.py::test_serialize_collection[y1-pickle-tuple] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_collection.py PASSED [ 9%] 4399s protocol/tests/test_collection.py::test_serialize_collection[y1-pickle-dict] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_collection.py PASSED [ 9%] 4399s protocol/tests/test_collection.py::test_serialize_collection[y1-pickle-list] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_collection.py PASSED [ 9%] 4399s protocol/tests/test_collection.py::test_serialize_collection[None-pickle-tuple] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_collection.py PASSED [ 9%] 4399s protocol/tests/test_collection.py::test_serialize_collection[None-pickle-dict] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_collection.py PASSED [ 9%] 4399s protocol/tests/test_collection.py::test_serialize_collection[None-pickle-list] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_collection.py PASSED [ 9%] 4399s protocol/tests/test_collection.py::test_large_collections_serialize_simply <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_collection.py PASSED [ 9%] 4399s protocol/tests/test_collection.py::test_nested_types <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_collection.py PASSED [ 9%] 4399s protocol/tests/test_collection_cuda.py::test_serialize_cupy[50-cuda-tuple] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_collection_cuda.py SKIPPED [ 9%] 4399s protocol/tests/test_collection_cuda.py::test_serialize_cupy[50-cuda-dict] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_collection_cuda.py SKIPPED [ 9%] 4399s protocol/tests/test_collection_cuda.py::test_serialize_cupy[None-pickle-tuple] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_collection_cuda.py SKIPPED [ 9%] 4399s protocol/tests/test_collection_cuda.py::test_serialize_cupy[None-pickle-dict] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_collection_cuda.py SKIPPED [ 9%] 4399s protocol/tests/test_collection_cuda.py::test_serialize_pandas_pandas[df20-cuda-tuple] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_collection_cuda.py SKIPPED [ 9%] 4399s protocol/tests/test_collection_cuda.py::test_serialize_pandas_pandas[df20-cuda-dict] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_collection_cuda.py SKIPPED [ 9%] 4399s protocol/tests/test_collection_cuda.py::test_serialize_pandas_pandas[None-pickle-tuple] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_collection_cuda.py SKIPPED [ 9%] 4399s protocol/tests/test_collection_cuda.py::test_serialize_pandas_pandas[None-pickle-dict] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_collection_cuda.py SKIPPED [ 9%] 4399s protocol/tests/test_compression.py::test_get_compression_settings <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py PASSED [ 9%] 4399s protocol/tests/test_compression.py::test_auto_compression <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py PASSED [ 9%] 4399s protocol/tests/test_compression.py::test_compression_1 <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py PASSED [ 9%] 4399s protocol/tests/test_compression.py::test_compression_2 <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py PASSED [ 10%] 4399s protocol/tests/test_compression.py::test_compression_3 <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py PASSED [ 10%] 4399s protocol/tests/test_compression.py::test_compression_without_deserialization <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py PASSED [ 10%] 4399s protocol/tests/test_compression.py::test_lz4_decompression_avoids_deep_copy <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py SKIPPED [ 10%] 4399s protocol/tests/test_compression.py::test_maybe_compress[None-bytes] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py PASSED [ 10%] 4399s protocol/tests/test_compression.py::test_maybe_compress[None-memoryview] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py PASSED [ 10%] 4399s protocol/tests/test_compression.py::test_maybe_compress[zlib-bytes] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py PASSED [ 10%] 4399s protocol/tests/test_compression.py::test_maybe_compress[zlib-memoryview] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py PASSED [ 10%] 4399s protocol/tests/test_compression.py::test_maybe_compress[lz4-bytes] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py SKIPPED [ 10%] 4399s protocol/tests/test_compression.py::test_maybe_compress[lz4-memoryview] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py SKIPPED [ 10%] 4399s protocol/tests/test_compression.py::test_maybe_compress[snappy-bytes] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py SKIPPED [ 10%] 4399s protocol/tests/test_compression.py::test_maybe_compress[snappy-memoryview] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py SKIPPED [ 10%] 4399s protocol/tests/test_compression.py::test_maybe_compress[zstd-bytes] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py SKIPPED [ 10%] 4399s protocol/tests/test_compression.py::test_maybe_compress[zstd-memoryview] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py SKIPPED [ 10%] 4399s protocol/tests/test_compression.py::test_maybe_compress_sample[None] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py PASSED [ 10%] 4399s protocol/tests/test_compression.py::test_maybe_compress_sample[zlib] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py PASSED [ 10%] 4399s protocol/tests/test_compression.py::test_maybe_compress_sample[lz4] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py SKIPPED [ 10%] 4399s protocol/tests/test_compression.py::test_maybe_compress_sample[snappy] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py SKIPPED [ 10%] 4399s protocol/tests/test_compression.py::test_maybe_compress_sample[zstd] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py SKIPPED [ 10%] 4399s protocol/tests/test_compression.py::test_maybe_compress_memoryviews[None] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py PASSED [ 10%] 4400s protocol/tests/test_compression.py::test_maybe_compress_memoryviews[zlib] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py PASSED [ 10%] 4400s protocol/tests/test_compression.py::test_maybe_compress_memoryviews[lz4] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py SKIPPED [ 10%] 4400s protocol/tests/test_compression.py::test_maybe_compress_memoryviews[snappy] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py SKIPPED [ 10%] 4400s protocol/tests/test_compression.py::test_maybe_compress_memoryviews[zstd] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py SKIPPED [ 10%] 4400s protocol/tests/test_compression.py::test_maybe_compress_auto <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py PASSED [ 10%] 4400s protocol/tests/test_compression.py::test_compression_thread_safety[None-bytes] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py SKIPPED [ 10%] 4400s protocol/tests/test_compression.py::test_compression_thread_safety[None-memoryview] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py SKIPPED [ 10%] 4400s protocol/tests/test_compression.py::test_compression_thread_safety[zlib-bytes] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py SKIPPED [ 10%] 4400s protocol/tests/test_compression.py::test_compression_thread_safety[zlib-memoryview] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py SKIPPED [ 10%] 4400s protocol/tests/test_compression.py::test_compression_thread_safety[lz4-bytes] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py SKIPPED [ 10%] 4400s protocol/tests/test_compression.py::test_compression_thread_safety[lz4-memoryview] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py SKIPPED [ 10%] 4400s protocol/tests/test_compression.py::test_compression_thread_safety[snappy-bytes] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py SKIPPED [ 10%] 4400s protocol/tests/test_compression.py::test_compression_thread_safety[snappy-memoryview] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py SKIPPED [ 11%] 4400s protocol/tests/test_compression.py::test_compression_thread_safety[zstd-bytes] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py SKIPPED [ 11%] 4400s protocol/tests/test_compression.py::test_compression_thread_safety[zstd-memoryview] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py SKIPPED [ 11%] 4400s protocol/tests/test_compression.py::test_large_messages[None] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py SKIPPED [ 11%] 4400s protocol/tests/test_compression.py::test_large_messages[zlib] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py SKIPPED [ 11%] 4400s protocol/tests/test_compression.py::test_large_messages[lz4] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py SKIPPED [ 11%] 4400s protocol/tests/test_compression.py::test_large_messages[snappy] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py SKIPPED [ 11%] 4400s protocol/tests/test_compression.py::test_large_messages[zstd] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py SKIPPED [ 11%] 4400s protocol/tests/test_compression.py::test_loads_without_deserialization_avoids_compression <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py PASSED [ 11%] 4400s protocol/tests/test_compression.py::test_compress_remote_comms <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py PASSED [ 11%] 4400s protocol/tests/test_compression.py::test_disable_compression_on_localhost[None] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py PASSED [ 11%] 4400s protocol/tests/test_compression.py::test_disable_compression_on_localhost[127.0.0.1] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py PASSED [ 11%] 4400s protocol/tests/test_compression.py::test_disable_compression_on_localhost[localhost] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py PASSED [ 11%] 4401s protocol/tests/test_highlevelgraph.py::test_combo_of_layer_types <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_highlevelgraph.py PASSED [ 11%] 4401s protocol/tests/test_highlevelgraph.py::test_blockwise <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_highlevelgraph.py PASSED [ 11%] 4401s protocol/tests/test_highlevelgraph.py::test_shuffle <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_highlevelgraph.py PASSED [ 11%] 4402s protocol/tests/test_highlevelgraph.py::test_array_annotations <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_highlevelgraph.py PASSED [ 11%] 4402s protocol/tests/test_highlevelgraph.py::test_dataframe_annotations <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_highlevelgraph.py PASSED [ 11%] 4402s protocol/tests/test_numpy.py::test_serialize <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 11%] 4402s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x0] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 11%] 4402s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x1] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 11%] 4402s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x2] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 11%] 4402s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x3] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 11%] 4402s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x4] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 11%] 4402s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x5] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 11%] 4402s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x6] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 11%] 4402s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x7] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 11%] 4402s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x8] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 11%] 4402s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x9] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 11%] 4402s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x10] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 11%] 4402s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x11] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 11%] 4402s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x12] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 11%] 4402s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x13] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 12%] 4402s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x14] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 12%] 4402s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x15] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 12%] 4402s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x16] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 12%] 4402s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x17] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 12%] 4402s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x18] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 12%] 4402s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x19] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 12%] 4402s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x20] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 12%] 4402s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x21] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 12%] 4402s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x22] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 12%] 4402s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x23] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 12%] 4402s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x24] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 12%] 4402s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x25] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 12%] 4402s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x26] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 12%] 4402s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x27] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 12%] 4402s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x28] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 12%] 4402s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x29] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 12%] 4402s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x30] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 12%] 4402s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x31] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 12%] 4402s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x32] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 12%] 4402s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x33] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 12%] 4402s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x34] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 12%] 4402s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x35] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 12%] 4402s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x36] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 12%] 4402s protocol/tests/test_numpy.py::test_dumps_numpy_writable[True] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 12%] 4402s protocol/tests/test_numpy.py::test_dumps_numpy_writable[False] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 12%] 4402s protocol/tests/test_numpy.py::test_serialize_numpy_ma_masked_array[x0] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 12%] 4402s protocol/tests/test_numpy.py::test_serialize_numpy_ma_masked_array[x1] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 12%] 4402s protocol/tests/test_numpy.py::test_serialize_numpy_ma_masked_array[x2] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 12%] 4402s protocol/tests/test_numpy.py::test_serialize_numpy_ma_masked_array[x3] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 12%] 4402s protocol/tests/test_numpy.py::test_serialize_numpy_ma_masked_array[x4] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 12%] 4402s protocol/tests/test_numpy.py::test_serialize_numpy_ma_masked_array[x5] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 12%] 4402s protocol/tests/test_numpy.py::test_serialize_numpy_ma_masked <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 12%] 4402s protocol/tests/test_numpy.py::test_dumps_serialize_numpy_custom_dtype <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py SKIPPED [ 13%] 4402s protocol/tests/test_numpy.py::test_memmap <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 13%] 4402s protocol/tests/test_numpy.py::test_dumps_serialize_numpy_large <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py SKIPPED [ 13%] 4402s protocol/tests/test_numpy.py::test_itemsize[f8-8] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 13%] 4402s protocol/tests/test_numpy.py::test_itemsize[i4-4] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 13%] 4402s protocol/tests/test_numpy.py::test_itemsize[c16-16] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 13%] 4402s protocol/tests/test_numpy.py::test_itemsize[b-1] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 13%] 4402s protocol/tests/test_numpy.py::test_itemsize[S3-3] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 13%] 4402s protocol/tests/test_numpy.py::test_itemsize[M8[us]-8] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 13%] 4402s protocol/tests/test_numpy.py::test_itemsize[M8[s]-8] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 13%] 4402s protocol/tests/test_numpy.py::test_itemsize[U3-12] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 13%] 4402s protocol/tests/test_numpy.py::test_itemsize[dt8-12] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 13%] 4402s protocol/tests/test_numpy.py::test_itemsize[dt9-4] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 13%] 4402s protocol/tests/test_numpy.py::test_itemsize[dt10-8] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 13%] 4402s protocol/tests/test_numpy.py::test_itemsize[dt11-88] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 13%] 4402s protocol/tests/test_numpy.py::test_itemsize[dt12-8] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 13%] 4403s protocol/tests/test_numpy.py::test_compress_numpy <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 13%] 4403s protocol/tests/test_numpy.py::test_compress_memoryview <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 13%] 4403s protocol/tests/test_numpy.py::test_dumps_large <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 13%] 4403s protocol/tests/test_numpy.py::test_zero_strided_numpy_array[True-x0] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 13%] 4403s protocol/tests/test_numpy.py::test_zero_strided_numpy_array[True-x1] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 13%] 4403s protocol/tests/test_numpy.py::test_zero_strided_numpy_array[True-x2] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 13%] 4403s protocol/tests/test_numpy.py::test_zero_strided_numpy_array[True-x3] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 13%] 4403s protocol/tests/test_numpy.py::test_zero_strided_numpy_array[False-x0] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 13%] 4403s protocol/tests/test_numpy.py::test_zero_strided_numpy_array[False-x1] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 13%] 4403s protocol/tests/test_numpy.py::test_zero_strided_numpy_array[False-x2] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 13%] 4403s protocol/tests/test_numpy.py::test_zero_strided_numpy_array[False-x3] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 13%] 4403s protocol/tests/test_numpy.py::test_non_zero_strided_array <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 13%] 4403s protocol/tests/test_numpy.py::test_serialize_writeable_array_readonly_base_object <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 13%] 4403s protocol/tests/test_pandas.py::test_dumps_serialize_pandas[df0] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pandas.py PASSED [ 13%] 4403s protocol/tests/test_pandas.py::test_dumps_serialize_pandas[df1] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pandas.py PASSED [ 13%] 4403s protocol/tests/test_pandas.py::test_dumps_serialize_pandas[df2] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pandas.py PASSED [ 13%] 4403s protocol/tests/test_pandas.py::test_dumps_serialize_pandas[df3] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pandas.py PASSED [ 14%] 4403s protocol/tests/test_pandas.py::test_dumps_serialize_pandas[df4] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pandas.py PASSED [ 14%] 4403s protocol/tests/test_pandas.py::test_dumps_serialize_pandas[df5] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pandas.py PASSED [ 14%] 4403s protocol/tests/test_pandas.py::test_dumps_serialize_pandas[df6] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pandas.py PASSED [ 14%] 4403s protocol/tests/test_pandas.py::test_dumps_serialize_pandas[df7] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pandas.py PASSED [ 14%] 4403s protocol/tests/test_pandas.py::test_dumps_serialize_pandas[df8] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pandas.py PASSED [ 14%] 4403s protocol/tests/test_pandas.py::test_dumps_serialize_pandas[df9] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pandas.py PASSED [ 14%] 4403s protocol/tests/test_pandas.py::test_dumps_serialize_pandas[df10] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pandas.py PASSED [ 14%] 4403s protocol/tests/test_pandas.py::test_dumps_serialize_pandas[df11] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pandas.py PASSED [ 14%] 4403s protocol/tests/test_pandas.py::test_dumps_serialize_pandas[df12] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pandas.py PASSED [ 14%] 4403s protocol/tests/test_pandas.py::test_dumps_serialize_pandas[df13] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pandas.py PASSED [ 14%] 4403s protocol/tests/test_pandas.py::test_dumps_serialize_pandas[df14] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pandas.py PASSED [ 14%] 4403s protocol/tests/test_pandas.py::test_dumps_serialize_pandas[df15] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pandas.py PASSED [ 14%] 4403s protocol/tests/test_pandas.py::test_dumps_serialize_pandas[df16] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pandas.py PASSED [ 14%] 4403s protocol/tests/test_pandas.py::test_dumps_serialize_pandas[df17] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pandas.py PASSED [ 14%] 4403s protocol/tests/test_pandas.py::test_dumps_serialize_pandas[df18] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pandas.py PASSED [ 14%] 4403s protocol/tests/test_pandas.py::test_dumps_serialize_pandas[df19] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pandas.py PASSED [ 14%] 4403s protocol/tests/test_pandas.py::test_dumps_serialize_pandas[df20] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pandas.py PASSED [ 14%] 4403s protocol/tests/test_pandas.py::test_dumps_serialize_pandas[df21] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pandas.py PASSED [ 14%] 4403s protocol/tests/test_pandas.py::test_dumps_serialize_pandas[df22] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pandas.py PASSED [ 14%] 4403s protocol/tests/test_pandas.py::test_dumps_serialize_pandas[df23] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pandas.py PASSED [ 14%] 4403s protocol/tests/test_pandas.py::test_dumps_serialize_pandas[df24] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pandas.py PASSED [ 14%] 4403s protocol/tests/test_pandas.py::test_dumps_serialize_pandas[df25] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pandas.py PASSED [ 14%] 4403s protocol/tests/test_pandas.py::test_dumps_pandas_writable <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pandas.py PASSED [ 14%] 4403s protocol/tests/test_pickle.py::test_pickle_data[4] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pickle.py PASSED [ 14%] 4403s protocol/tests/test_pickle.py::test_pickle_data[5] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pickle.py PASSED [ 14%] 4403s protocol/tests/test_pickle.py::test_pickle_out_of_band[4] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pickle.py PASSED [ 14%] 4403s protocol/tests/test_pickle.py::test_pickle_out_of_band[5] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pickle.py PASSED [ 14%] 4403s protocol/tests/test_pickle.py::test_pickle_empty[4] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pickle.py PASSED [ 14%] 4403s protocol/tests/test_pickle.py::test_pickle_empty[5] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pickle.py PASSED [ 14%] 4403s protocol/tests/test_pickle.py::test_pickle_numpy[4] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pickle.py PASSED [ 14%] 4403s protocol/tests/test_pickle.py::test_pickle_numpy[5] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pickle.py PASSED [ 14%] 4403s protocol/tests/test_pickle.py::test_pickle_functions[4] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pickle.py PASSED [ 15%] 4403s protocol/tests/test_pickle.py::test_pickle_functions[5] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pickle.py PASSED [ 15%] 4403s protocol/tests/test_pickle.py::test_pickle_by_value_when_registered <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pickle.py PASSED [ 15%] 4403s protocol/tests/test_pickle.py::test_allow_pickle_if_registered_in_dask_serialize <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pickle.py PASSED [ 15%] 4403s protocol/tests/test_pickle.py::test_nopickle_nested <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pickle.py PASSED [ 15%] 4403s protocol/tests/test_pickle.py::test_pickle_functions_in_main <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pickle.py SKIPPED [ 15%] 4403s protocol/tests/test_pickle.py::test_pickle_zero_copy_read_only_flag[dask] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pickle.py PASSED [ 15%] 4403s protocol/tests/test_pickle.py::test_pickle_zero_copy_read_only_flag[pickle] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pickle.py PASSED [ 15%] 4403s protocol/tests/test_protocol.py::test_protocol <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol.py PASSED [ 15%] 4403s protocol/tests/test_protocol.py::test_small <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol.py PASSED [ 15%] 4403s protocol/tests/test_protocol.py::test_small_and_big <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol.py PASSED [ 15%] 4403s protocol/tests/test_protocol.py::test_large_bytes[bytes] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol.py PASSED [ 15%] 4403s protocol/tests/test_protocol.py::test_large_bytes[memoryview] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol.py PASSED [ 15%] 4403s protocol/tests/test_protocol.py::test_large_messages_map <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol.py PASSED [ 15%] 4403s protocol/tests/test_protocol.py::test_loads_deserialize_False <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol.py PASSED [ 15%] 4403s protocol/tests/test_protocol.py::test_dumps_loads_Serialize <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol.py PASSED [ 15%] 4403s protocol/tests/test_protocol.py::test_dumps_loads_Serialized <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol.py PASSED [ 15%] 4403s protocol/tests/test_protocol.py::test_preserve_header[serializers0] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol.py PASSED [ 15%] 4403s protocol/tests/test_protocol.py::test_preserve_header[serializers1] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol.py PASSED [ 15%] 4403s protocol/tests/test_protocol.py::test_sizeof_serialize[Serialize-Serialized0] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol.py PASSED [ 15%] 4403s protocol/tests/test_protocol.py::test_sizeof_serialize[Serialize-Serialized1] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol.py PASSED [ 15%] 4403s protocol/tests/test_protocol.py::test_sizeof_serialize[ToPickle-Pickled] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol.py PASSED [ 15%] 4403s protocol/tests/test_protocol.py::test_fallback_to_pickle <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol.py PASSED [ 15%] 4403s protocol/tests/test_protocol.py::test_large_payload[bytes] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol.py SKIPPED [ 15%] 4403s protocol/tests/test_protocol.py::test_large_payload[str] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol.py SKIPPED [ 15%] 4403s protocol/tests/test_protocol.py::test_large_payload[ext] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol.py SKIPPED [ 15%] 4403s protocol/tests/test_protocol_utils.py::test_pack_frames <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol_utils.py PASSED [ 15%] 4403s protocol/tests/test_protocol_utils.py::test_unpack_frames_remainder[456] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol_utils.py PASSED [ 15%] 4403s protocol/tests/test_protocol_utils.py::test_unpack_frames_remainder[] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol_utils.py PASSED [ 15%] 4403s protocol/tests/test_protocol_utils.py::test_unpack_frames_partial <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol_utils.py PASSED [ 15%] 4403s protocol/tests/test_protocol_utils.py::TestMergeMemroyviews::test_empty <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol_utils.py PASSED [ 15%] 4403s protocol/tests/test_protocol_utils.py::TestMergeMemroyviews::test_one <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol_utils.py PASSED [ 15%] 4403s protocol/tests/test_protocol_utils.py::TestMergeMemroyviews::test_parts[slices0] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol_utils.py PASSED [ 15%] 4403s protocol/tests/test_protocol_utils.py::TestMergeMemroyviews::test_parts[slices1] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol_utils.py PASSED [ 16%] 4403s protocol/tests/test_protocol_utils.py::TestMergeMemroyviews::test_parts[slices2] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol_utils.py PASSED [ 16%] 4403s protocol/tests/test_protocol_utils.py::TestMergeMemroyviews::test_parts[slices3] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol_utils.py PASSED [ 16%] 4403s protocol/tests/test_protocol_utils.py::TestMergeMemroyviews::test_parts[slices4] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol_utils.py PASSED [ 16%] 4403s protocol/tests/test_protocol_utils.py::TestMergeMemroyviews::test_parts[slices5] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol_utils.py PASSED [ 16%] 4403s protocol/tests/test_protocol_utils.py::TestMergeMemroyviews::test_parts[slices6] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol_utils.py PASSED [ 16%] 4403s protocol/tests/test_protocol_utils.py::TestMergeMemroyviews::test_parts[slices7] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol_utils.py PASSED [ 16%] 4403s protocol/tests/test_protocol_utils.py::TestMergeMemroyviews::test_parts[slices8] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol_utils.py PASSED [ 16%] 4403s protocol/tests/test_protocol_utils.py::TestMergeMemroyviews::test_parts[slices9] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol_utils.py PASSED [ 16%] 4403s protocol/tests/test_protocol_utils.py::TestMergeMemroyviews::test_readonly_buffer <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol_utils.py PASSED [ 16%] 4403s protocol/tests/test_protocol_utils.py::TestMergeMemroyviews::test_catch_non_memoryview <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol_utils.py PASSED [ 16%] 4403s protocol/tests/test_protocol_utils.py::TestMergeMemroyviews::test_catch_gaps[slices0] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol_utils.py PASSED [ 16%] 4403s protocol/tests/test_protocol_utils.py::TestMergeMemroyviews::test_catch_gaps[slices1] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol_utils.py PASSED [ 16%] 4403s protocol/tests/test_protocol_utils.py::TestMergeMemroyviews::test_catch_gaps[slices2] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol_utils.py PASSED [ 16%] 4403s protocol/tests/test_protocol_utils.py::TestMergeMemroyviews::test_catch_different_buffer <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol_utils.py PASSED [ 16%] 4403s protocol/tests/test_protocol_utils.py::TestMergeMemroyviews::test_catch_different_non_contiguous <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol_utils.py PASSED [ 16%] 4403s protocol/tests/test_protocol_utils.py::TestMergeMemroyviews::test_catch_multidimensional <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol_utils.py PASSED [ 16%] 4403s protocol/tests/test_protocol_utils.py::TestMergeMemroyviews::test_catch_different_formats <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol_utils.py PASSED [ 16%] 4403s protocol/tests/test_serialize.py::test_dumps_serialize <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 16%] 4403s protocol/tests/test_serialize.py::test_serialize_bytestrings <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 16%] 4403s protocol/tests/test_serialize.py::test_serialize_empty_array <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 16%] 4403s protocol/tests/test_serialize.py::test_serialize_arrays[b] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 16%] 4403s protocol/tests/test_serialize.py::test_serialize_arrays[B] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 16%] 4403s protocol/tests/test_serialize.py::test_serialize_arrays[h] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 16%] 4403s protocol/tests/test_serialize.py::test_serialize_arrays[H] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 16%] 4403s protocol/tests/test_serialize.py::test_serialize_arrays[i] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 16%] 4403s protocol/tests/test_serialize.py::test_serialize_arrays[I] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 16%] 4403s protocol/tests/test_serialize.py::test_serialize_arrays[l] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 16%] 4403s protocol/tests/test_serialize.py::test_serialize_arrays[L] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 16%] 4403s protocol/tests/test_serialize.py::test_serialize_arrays[q] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 16%] 4403s protocol/tests/test_serialize.py::test_serialize_arrays[Q] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 16%] 4403s protocol/tests/test_serialize.py::test_serialize_arrays[f] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 16%] 4403s protocol/tests/test_serialize.py::test_serialize_arrays[d] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 17%] 4403s protocol/tests/test_serialize.py::test_Serialize <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 17%] 4403s protocol/tests/test_serialize.py::test_Serialized <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 17%] 4403s protocol/tests/test_serialize.py::test_nested_deserialize <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 17%] 4403s protocol/tests/test_serialize.py::test_serialize_iterate_collection <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 17%] 4403s protocol/tests/test_serialize.py::test_object_in_graph <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 17%] 4403s protocol/tests/test_serialize.py::test_scatter <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 17%] 4404s protocol/tests/test_serialize.py::test_inter_worker_comms <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 17%] 4404s protocol/tests/test_serialize.py::test_empty <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 17%] 4404s protocol/tests/test_serialize.py::test_empty_loads <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 17%] 4404s protocol/tests/test_serialize.py::test_empty_loads_deep <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 17%] 4405s protocol/tests/test_serialize.py::test_serialize_bytes[kwargs0] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 17%] 4406s protocol/tests/test_serialize.py::test_serialize_bytes[kwargs1] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 17%] 4406s protocol/tests/test_serialize.py::test_serialize_bytes_numpy[kwargs0] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 17%] 4406s protocol/tests/test_serialize.py::test_serialize_bytes_numpy[kwargs1] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 17%] 4406s protocol/tests/test_serialize.py::test_deserialize_bytes_zero_copy_read_only <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 17%] 4406s protocol/tests/test_serialize.py::test_deserialize_bytes_zero_copy_writeable <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 17%] 4406s protocol/tests/test_serialize.py::test_serialize_list_compress <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 17%] 4406s protocol/tests/test_serialize.py::test_malicious_exception <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 17%] 4406s protocol/tests/test_serialize.py::test_err_on_bad_deserializer <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 17%] 4407s protocol/tests/test_serialize.py::test_context_specific_serialization <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 17%] 4407s protocol/tests/test_serialize.py::test_context_specific_serialization_class <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 17%] 4407s protocol/tests/test_serialize.py::test_serialize_raises <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 17%] 4407s protocol/tests/test_serialize.py::test_different_compression_families <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 17%] 4407s protocol/tests/test_serialize.py::test_frame_split <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 17%] 4407s protocol/tests/test_serialize.py::test_check_dask_serializable[data0-False] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 17%] 4407s protocol/tests/test_serialize.py::test_check_dask_serializable[data1-False] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 17%] 4407s protocol/tests/test_serialize.py::test_check_dask_serializable[data2-False] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 17%] 4407s protocol/tests/test_serialize.py::test_check_dask_serializable[data3-False] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 17%] 4407s protocol/tests/test_serialize.py::test_check_dask_serializable[data4-False] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 17%] 4407s protocol/tests/test_serialize.py::test_check_dask_serializable[data5-True] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 17%] 4407s protocol/tests/test_serialize.py::test_check_dask_serializable[data6-True] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 17%] 4407s protocol/tests/test_serialize.py::test_check_dask_serializable[data7-True] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py XFAIL [ 18%] 4407s protocol/tests/test_serialize.py::test_check_dask_serializable[data8-True] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 18%] 4407s protocol/tests/test_serialize.py::test_check_dask_serializable[data9-True] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 18%] 4407s protocol/tests/test_serialize.py::test_check_dask_serializable[data10-True] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 18%] 4407s protocol/tests/test_serialize.py::test_check_dask_serializable[data11-True] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 18%] 4407s protocol/tests/test_serialize.py::test_check_dask_serializable[data12-True] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 18%] 4407s protocol/tests/test_serialize.py::test_serialize_lists[serializers0] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 18%] 4407s protocol/tests/test_serialize.py::test_serialize_lists[serializers1] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 18%] 4407s protocol/tests/test_serialize.py::test_serialize_lists[serializers2] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 18%] 4407s protocol/tests/test_serialize.py::test_serialize_lists[serializers3] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 18%] 4407s protocol/tests/test_serialize.py::test_deser_memoryview[data_in0] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 18%] 4407s protocol/tests/test_serialize.py::test_deser_memoryview[data_in1] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 18%] 4407s protocol/tests/test_serialize.py::test_ser_memoryview_object <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 18%] 4407s protocol/tests/test_serialize.py::test_ser_empty_1d_memoryview <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 18%] 4407s protocol/tests/test_serialize.py::test_ser_empty_nd_memoryview <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 18%] 4409s protocol/tests/test_serialize.py::test_large_pickled_object <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 18%] 4409s protocol/tests/test_serialize.py::test__is_msgpack_serializable <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 18%] 4409s protocol/tests/test_to_pickle.py::test_ToPickle <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_to_pickle.py PASSED [ 18%] 4409s protocol/tests/test_utils.py::test_host_array <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_utils.py PASSED [ 18%] 4409s protocol/tests/test_utils.py::test_host_array_from_buffers <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_utils.py PASSED [ 18%] 4409s protocol/tests/test_utils.py::test_host_array_from_buffers_numpy <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_utils.py PASSED [ 18%] 4409s protocol/tests/test_utils_test.py::test_get_host_array <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_utils_test.py PASSED [ 18%] 4410s shuffle/tests/test_buffer.py::test_memory_limit[big_payloads0] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_buffer.py PASSED [ 18%] 4410s shuffle/tests/test_buffer.py::test_memory_limit[big_payloads1] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_buffer.py PASSED [ 18%] 4410s shuffle/tests/test_buffer.py::test_memory_limit[big_payloads2] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_buffer.py PASSED [ 18%] 4411s shuffle/tests/test_buffer.py::test_memory_limit[big_payloads3] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_buffer.py PASSED [ 18%] 4411s shuffle/tests/test_buffer.py::test_memory_limit_blocked_exception <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_buffer.py PASSED [ 18%] 4411s shuffle/tests/test_comm_buffer.py::test_basic <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_comm_buffer.py PASSED [ 18%] 4411s shuffle/tests/test_comm_buffer.py::test_exceptions <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_comm_buffer.py PASSED [ 18%] 4411s shuffle/tests/test_comm_buffer.py::test_slow_send <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_comm_buffer.py PASSED [ 18%] 4411s shuffle/tests/test_comm_buffer.py::test_concurrent_puts <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_comm_buffer.py PASSED [ 18%] 4411s shuffle/tests/test_comm_buffer.py::test_concurrent_puts_error <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_comm_buffer.py PASSED [ 18%] 4411s shuffle/tests/test_core.py::test_mean_shard_size <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_core.py PASSED [ 18%] 4411s shuffle/tests/test_core.py::test_mean_shard_size_numpy <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_core.py PASSED [ 19%] 4411s shuffle/tests/test_disk_buffer.py::test_basic <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_disk_buffer.py PASSED [ 19%] 4411s shuffle/tests/test_disk_buffer.py::test_read_before_flush <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_disk_buffer.py PASSED [ 19%] 4411s shuffle/tests/test_disk_buffer.py::test_many[2] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_disk_buffer.py PASSED [ 19%] 4411s shuffle/tests/test_disk_buffer.py::test_many[100] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_disk_buffer.py PASSED [ 19%] 4412s shuffle/tests/test_disk_buffer.py::test_many[1000] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_disk_buffer.py PASSED [ 19%] 4412s shuffle/tests/test_disk_buffer.py::test_exceptions <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_disk_buffer.py PASSED [ 19%] 4412s shuffle/tests/test_disk_buffer.py::test_high_pressure_flush_with_exception <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_disk_buffer.py PASSED [ 19%] 4412s shuffle/tests/test_limiter.py::test_limiter_basic <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_limiter.py PASSED [ 19%] 4412s shuffle/tests/test_limiter.py::test_unlimited_limiter <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_limiter.py PASSED [ 19%] 4412s shuffle/tests/test_limiter.py::test_limiter_concurrent_decrease_releases_waiter <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_limiter.py PASSED [ 19%] 4412s shuffle/tests/test_limiter.py::test_limiter_statistics <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_limiter.py PASSED [ 19%] 4412s shuffle/tests/test_limiter.py::test_limiter_no_limit_no_statistics <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_limiter.py PASSED [ 19%] 4412s shuffle/tests/test_memory_buffer.py::test_basic <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_memory_buffer.py PASSED [ 19%] 4412s shuffle/tests/test_memory_buffer.py::test_read_before_flush <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_memory_buffer.py PASSED [ 19%] 4412s shuffle/tests/test_memory_buffer.py::test_many[2] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_memory_buffer.py PASSED [ 19%] 4412s shuffle/tests/test_memory_buffer.py::test_many[100] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_memory_buffer.py PASSED [ 19%] 4413s shuffle/tests/test_memory_buffer.py::test_many[1000] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_memory_buffer.py PASSED [ 19%] 4413s shuffle/tests/test_pickle.py::test_pickle <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_pickle.py PASSED [ 19%] 4413s shuffle/tests/test_pickle.py::test_pickle_numpy <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_pickle.py PASSED [ 19%] 4413s shuffle/tests/test_pickle.py::test_pickle_zero_copy <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_pickle.py PASSED [ 19%] 4413s shuffle/tests/test_read_write_lock.py::test_basic <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_read_write_lock.py PASSED [ 19%] 4413s shuffle/tests/test_read_write_lock.py::test_lock_timeout <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_read_write_lock.py PASSED [ 19%] 4413s shuffle/tests/test_read_write_lock.py::test_concurrent_reads_are_allowed <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_read_write_lock.py PASSED [ 19%] 4413s shuffle/tests/test_read_write_lock.py::test_read_blocks_write <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_read_write_lock.py PASSED [ 19%] 4413s shuffle/tests/test_read_write_lock.py::test_write_blocks_read <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_read_write_lock.py PASSED [ 19%] 4413s shuffle/tests/test_read_write_lock.py::test_write_blocks_write <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_read_write_lock.py PASSED [ 19%] 4413s shuffle/tests/test_read_write_lock.py::test_write_preferred_over_read <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_read_write_lock.py PASSED [ 19%] 4413s shuffle/tests/test_rechunk.py::test_lowlevel_rechunk[True-True-1] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 19%] 4413s shuffle/tests/test_rechunk.py::test_lowlevel_rechunk[True-True-10] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 19%] 4413s shuffle/tests/test_rechunk.py::test_lowlevel_rechunk[True-False-1] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 19%] 4414s shuffle/tests/test_rechunk.py::test_lowlevel_rechunk[True-False-10] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 19%] 4414s shuffle/tests/test_rechunk.py::test_lowlevel_rechunk[False-True-1] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 20%] 4414s shuffle/tests/test_rechunk.py::test_lowlevel_rechunk[False-True-10] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 20%] 4414s shuffle/tests/test_rechunk.py::test_lowlevel_rechunk[False-False-1] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 20%] 4414s shuffle/tests/test_rechunk.py::test_lowlevel_rechunk[False-False-10] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 20%] 4414s shuffle/tests/test_rechunk.py::test_rechunk_configuration[tasks-tasks] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 20%] 4414s shuffle/tests/test_rechunk.py::test_rechunk_configuration[tasks-p2p] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 20%] 4415s shuffle/tests/test_rechunk.py::test_rechunk_configuration[tasks-None] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 20%] 4415s shuffle/tests/test_rechunk.py::test_rechunk_configuration[p2p-tasks] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 20%] 4415s shuffle/tests/test_rechunk.py::test_rechunk_configuration[p2p-p2p] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 20%] 4415s shuffle/tests/test_rechunk.py::test_rechunk_configuration[p2p-None] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 20%] 4415s shuffle/tests/test_rechunk.py::test_rechunk_configuration[None-tasks] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 20%] 4416s shuffle/tests/test_rechunk.py::test_rechunk_configuration[None-p2p] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 20%] 4416s shuffle/tests/test_rechunk.py::test_rechunk_configuration[None-None] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 20%] 4417s shuffle/tests/test_rechunk.py::test_rechunk_heuristic[new0-p2p] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 20%] 4418s shuffle/tests/test_rechunk.py::test_rechunk_heuristic[new1-tasks] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 20%] 4420s shuffle/tests/test_rechunk.py::test_rechunk_heuristic[new2-tasks] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 20%] 4421s shuffle/tests/test_rechunk.py::test_rechunk_heuristic[new3-p2p] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 20%] 4421s shuffle/tests/test_rechunk.py::test_cull_p2p_rechunk_independent_partitions <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 20%] 4421s shuffle/tests/test_rechunk.py::test_cull_p2p_rechunking_single_chunk <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 20%] 4422s shuffle/tests/test_rechunk.py::test_cull_p2p_rechunk_overlapping_partitions <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 20%] 4422s shuffle/tests/test_rechunk.py::test_rechunk_2d[True] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 20%] 4423s shuffle/tests/test_rechunk.py::test_rechunk_2d[False] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 20%] 4423s shuffle/tests/test_rechunk.py::test_rechunk_4d[True] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 20%] 4423s shuffle/tests/test_rechunk.py::test_rechunk_4d[False] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 20%] 4423s shuffle/tests/test_rechunk.py::test_rechunk_expand <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 20%] 4423s shuffle/tests/test_rechunk.py::test_rechunk_expand2 <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 20%] 4429s shuffle/tests/test_rechunk.py::test_rechunk_method <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 20%] 4429s shuffle/tests/test_rechunk.py::test_rechunk_blockshape <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 20%] 4429s shuffle/tests/test_rechunk.py::test_dtype <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 20%] 4429s shuffle/tests/test_rechunk.py::test_rechunk_with_dict <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 20%] 4429s shuffle/tests/test_rechunk.py::test_rechunk_with_empty_input <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 20%] 4429s shuffle/tests/test_rechunk.py::test_rechunk_with_null_dimensions <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 20%] 4429s shuffle/tests/test_rechunk.py::test_rechunk_with_integer <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 21%] 4430s shuffle/tests/test_rechunk.py::test_rechunk_0d <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 21%] 4430s shuffle/tests/test_rechunk.py::test_rechunk_empty_array[arr0] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 21%] 4430s shuffle/tests/test_rechunk.py::test_rechunk_empty_array[arr1] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 21%] 4430s shuffle/tests/test_rechunk.py::test_rechunk_empty_array[arr2] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 21%] 4430s shuffle/tests/test_rechunk.py::test_rechunk_empty <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 21%] 4430s shuffle/tests/test_rechunk.py::test_rechunk_zero_dim_array <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 21%] 4430s shuffle/tests/test_rechunk.py::test_rechunk_zero_dim_array_II <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 21%] 4430s shuffle/tests/test_rechunk.py::test_rechunk_same <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 21%] 4430s shuffle/tests/test_rechunk.py::test_rechunk_same_fully_unknown <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 21%] 4430s shuffle/tests/test_rechunk.py::test_rechunk_same_fully_unknown_floats <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 21%] 4430s shuffle/tests/test_rechunk.py::test_rechunk_same_partially_unknown <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 21%] 4431s shuffle/tests/test_rechunk.py::test_rechunk_with_zero_placeholders <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 21%] 4431s shuffle/tests/test_rechunk.py::test_rechunk_minus_one <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 21%] 4431s shuffle/tests/test_rechunk.py::test_rechunk_warning <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 21%] 4431s shuffle/tests/test_rechunk.py::test_rechunk_unknown_from_pandas <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 21%] 4431s shuffle/tests/test_rechunk.py::test_rechunk_unknown_from_array <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 21%] 4432s shuffle/tests/test_rechunk.py::test_rechunk_with_fully_unknown_dimension[x0-chunks0] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 21%] 4432s shuffle/tests/test_rechunk.py::test_rechunk_with_fully_unknown_dimension[x1-chunks1] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 21%] 4432s shuffle/tests/test_rechunk.py::test_rechunk_with_fully_unknown_dimension[x2-chunks2] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 21%] 4434s shuffle/tests/test_rechunk.py::test_rechunk_with_fully_unknown_dimension[x3-chunks3] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 21%] 4436s shuffle/tests/test_rechunk.py::test_rechunk_with_fully_unknown_dimension[x4-chunks4] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 21%] 4439s shuffle/tests/test_rechunk.py::test_rechunk_with_fully_unknown_dimension[x5-chunks5] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 21%] 4439s shuffle/tests/test_rechunk.py::test_rechunk_with_fully_unknown_dimension[x6-chunks6] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 21%] 4440s shuffle/tests/test_rechunk.py::test_rechunk_with_fully_unknown_dimension[x7-chunks7] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 21%] 4440s shuffle/tests/test_rechunk.py::test_rechunk_with_fully_unknown_dimension[x8-chunks8] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 21%] 4440s shuffle/tests/test_rechunk.py::test_rechunk_with_fully_unknown_dimension[x9-chunks9] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 21%] 4441s shuffle/tests/test_rechunk.py::test_rechunk_with_fully_unknown_dimension[x10-chunks10] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 21%] 4441s shuffle/tests/test_rechunk.py::test_rechunk_with_fully_unknown_dimension[x11-chunks11] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 21%] 4442s shuffle/tests/test_rechunk.py::test_rechunk_with_partially_unknown_dimension[x0-chunks0] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 21%] 4443s shuffle/tests/test_rechunk.py::test_rechunk_with_partially_unknown_dimension[x1-chunks1] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 21%] 4443s shuffle/tests/test_rechunk.py::test_rechunk_with_partially_unknown_dimension[x2-chunks2] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 21%] 4447s shuffle/tests/test_rechunk.py::test_rechunk_with_partially_unknown_dimension[x3-chunks3] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 21%] 4451s shuffle/tests/test_rechunk.py::test_rechunk_with_partially_unknown_dimension[x4-chunks4] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 22%] 4456s shuffle/tests/test_rechunk.py::test_rechunk_with_partially_unknown_dimension[x5-chunks5] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 22%] 4456s shuffle/tests/test_rechunk.py::test_rechunk_with_partially_unknown_dimension[x6-chunks6] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 22%] 4456s shuffle/tests/test_rechunk.py::test_rechunk_with_partially_unknown_dimension[x7-chunks7] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 22%] 4457s shuffle/tests/test_rechunk.py::test_rechunk_with_partially_unknown_dimension[x8-chunks8] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 22%] 4457s shuffle/tests/test_rechunk.py::test_rechunk_with_partially_unknown_dimension[x9-chunks9] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 22%] 4457s shuffle/tests/test_rechunk.py::test_rechunk_with_partially_unknown_dimension[x10-chunks10] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 22%] 4458s shuffle/tests/test_rechunk.py::test_rechunk_with_partially_unknown_dimension[x11-chunks11] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 22%] 4458s shuffle/tests/test_rechunk.py::test_rechunk_with_fully_unknown_dimension_explicit[new_chunks0] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 22%] 4459s shuffle/tests/test_rechunk.py::test_rechunk_with_fully_unknown_dimension_explicit[new_chunks1] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 22%] 4459s shuffle/tests/test_rechunk.py::test_rechunk_with_fully_unknown_dimension_explicit[new_chunks2] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 22%] 4459s shuffle/tests/test_rechunk.py::test_rechunk_unknown_raises <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 22%] 4459s shuffle/tests/test_rechunk.py::test_rechunk_zero_dim <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 22%] 4461s shuffle/tests/test_rechunk.py::test_rechunk_empty_chunks <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 22%] 4461s shuffle/tests/test_rechunk.py::test_rechunk_avoid_needless_chunking <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 22%] 4461s shuffle/tests/test_rechunk.py::test_rechunk_auto_1d[100-1-10-expected0] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 22%] 4461s shuffle/tests/test_rechunk.py::test_rechunk_auto_1d[100-50-10-expected1] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 22%] 4461s shuffle/tests/test_rechunk.py::test_rechunk_auto_1d[100-100-10-expected2] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 22%] 4461s shuffle/tests/test_rechunk.py::test_rechunk_auto_1d[20-7-10-expected3] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 22%] 4461s shuffle/tests/test_rechunk.py::test_rechunk_auto_1d[20-chunks4-5-expected4] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 22%] 4461s shuffle/tests/test_rechunk.py::test_rechunk_auto_2d <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 22%] 4461s shuffle/tests/test_rechunk.py::test_rechunk_auto_3d <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 22%] 4462s shuffle/tests/test_rechunk.py::test_rechunk_auto_image_stack[100] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 22%] 4462s shuffle/tests/test_rechunk.py::test_rechunk_auto_image_stack[1000] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 22%] 4462s shuffle/tests/test_rechunk.py::test_rechunk_down <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 22%] 4462s shuffle/tests/test_rechunk.py::test_rechunk_zero <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 22%] 4462s shuffle/tests/test_rechunk.py::test_rechunk_bad_keys <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 22%] 4462s shuffle/tests/test_rechunk.py::test_rechunk_with_zero <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 22%] 4462s shuffle/tests/test_rechunk.py::test_split_axes_1 <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 22%] 4462s shuffle/tests/test_rechunk.py::test_split_axes_2 <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 22%] 4462s shuffle/tests/test_rechunk.py::test_split_axes_nan <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 22%] 4462s shuffle/tests/test_rechunk.py::test_split_axes_nan_single <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 22%] 4462s shuffle/tests/test_rechunk.py::test_split_axes_nan_long <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 23%] 4462s shuffle/tests/test_rechunk.py::test_split_axes_with_nonzero <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 23%] 4462s shuffle/tests/test_rechunk.py::test_split_axes_with_zero <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 23%] 4462s shuffle/tests/test_rechunk.py::test_preserve_writeable_flag <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 23%] 4463s shuffle/tests/test_rechunk.py::test_rechunk_in_memory_shards_dont_share_buffer <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 23%] 4463s shuffle/tests/test_rechunk.py::test_pick_worker_homogeneous_distribution[1] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 23%] 4463s shuffle/tests/test_rechunk.py::test_pick_worker_homogeneous_distribution[2] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 23%] 4463s shuffle/tests/test_rechunk.py::test_pick_worker_homogeneous_distribution[41] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 23%] 4463s shuffle/tests/test_rechunk.py::test_pick_worker_homogeneous_distribution[50] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 23%] 4463s shuffle/tests/test_rechunk.py::test_partial_rechunk_homogeneous_distribution <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py SKIPPED [ 23%] 4463s shuffle/tests/test_rechunk.py::test_partial_rechunk_taskgroups <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 23%] 4463s shuffle/tests/test_rechunk.py::test_calculate_prechunking_1d[old0-new0-expected0] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 23%] 4463s shuffle/tests/test_rechunk.py::test_calculate_prechunking_1d[old1-new1-expected1] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 23%] 4463s shuffle/tests/test_rechunk.py::test_calculate_prechunking_1d[old2-new2-expected2] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 23%] 4463s shuffle/tests/test_rechunk.py::test_calculate_prechunking_1d[old3-new3-expected3] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 23%] 4463s shuffle/tests/test_rechunk.py::test_calculate_prechunking_1d[old4-new4-expected4] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 23%] 4463s shuffle/tests/test_rechunk.py::test_calculate_prechunking_2d[old0-new0-expected0] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 23%] 4463s shuffle/tests/test_rechunk.py::test_calculate_prechunking_2d[old1-new1-expected1] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 23%] 4463s shuffle/tests/test_rechunk.py::test_calculate_prechunking_2d[old2-new2-expected2] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 23%] 4463s shuffle/tests/test_rechunk.py::test_calculate_prechunking_2d[old3-new3-expected3] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 23%] 4463s shuffle/tests/test_rechunk.py::test_calculate_prechunking_2d[old4-new4-expected4] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 23%] 4463s shuffle/tests/test_rechunk.py::test_calculate_prechunking_2d[old5-new5-expected5] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 23%] 4463s shuffle/tests/test_rechunk.py::test_calculate_prechunking_3d[old0-new0-expected0] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 23%] 4463s shuffle/tests/test_rechunk.py::test_calculate_prechunking_3d[old1-new1-expected1] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 23%] 4463s shuffle/tests/test_rechunk.py::test_calculate_prechunking_3d[old2-new2-expected2] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 23%] 4463s shuffle/tests/test_rechunk.py::test_calculate_prechunking_3d[old3-new3-expected3] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 23%] 4463s shuffle/tests/test_rechunk.py::test_calculate_prechunking_concatenation[1 B-expected0] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 23%] 4463s shuffle/tests/test_rechunk.py::test_calculate_prechunking_concatenation[20 B-expected1] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 23%] 4463s shuffle/tests/test_rechunk.py::test_calculate_prechunking_concatenation[40 B-expected2] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 23%] 4463s shuffle/tests/test_rechunk.py::test_calculate_prechunking_concatenation[100 B-expected3] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 23%] 4463s shuffle/tests/test_rechunk.py::test_calculate_prechunking_does_not_concatenate_object_type <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 23%] 4463s shuffle/tests/test_rechunk.py::test_calculate_prechunking_splitting[old0-new0-expected0] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 23%] 4463s shuffle/tests/test_rechunk.py::test_calculate_prechunking_splitting[old1-new1-expected1] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 24%] 4463s shuffle/tests/test_rechunk.py::test_calculate_prechunking_splitting[old2-new2-expected2] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 24%] 4467s shuffle/tests/test_rechunk.py::test_homogeneously_schedule_unpack <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 24%] 4468s shuffle/tests/test_rechunk.py::test_rechunk_datetime[tasks] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 24%] 4468s shuffle/tests/test_rechunk.py::test_rechunk_datetime[p2p] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 24%] 4468s shuffle/tests/test_shuffle_plugins.py::test_installation_on_worker <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_shuffle_plugins.py PASSED [ 24%] 4468s shuffle/tests/test_shuffle_plugins.py::test_installation_on_scheduler <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_shuffle_plugins.py PASSED [ 24%] 4468s tests/test_active_memory_manager.py::test_no_policies <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 24%] 4469s tests/test_active_memory_manager.py::test_drop <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 24%] 4469s tests/test_active_memory_manager.py::test_start_stop <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 24%] 4470s tests/test_active_memory_manager.py::test_auto_start <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 24%] 4470s tests/test_active_memory_manager.py::test_add_policy <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 24%] 4471s tests/test_active_memory_manager.py::test_multi_start <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 24%] 4471s tests/test_active_memory_manager.py::test_not_registered <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 24%] 4473s tests/test_active_memory_manager.py::test_client_proxy_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 24%] 4473s tests/test_active_memory_manager.py::test_client_proxy_async <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 24%] 4473s tests/test_active_memory_manager.py::test_drop_not_in_memory <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 24%] 4474s tests/test_active_memory_manager.py::test_drop_with_waiter <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 24%] 4474s tests/test_active_memory_manager.py::test_double_drop <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 24%] 4475s tests/test_active_memory_manager.py::test_double_drop_stress <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 24%] 4475s tests/test_active_memory_manager.py::test_drop_from_worker_with_least_free_memory <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 24%] 4475s tests/test_active_memory_manager.py::test_drop_with_candidates <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 24%] 4476s tests/test_active_memory_manager.py::test_drop_with_empty_candidates <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 24%] 4476s tests/test_active_memory_manager.py::test_drop_from_candidates_without_key <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 24%] 4476s tests/test_active_memory_manager.py::test_drop_with_bad_candidates <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 24%] 4477s tests/test_active_memory_manager.py::test_drop_prefers_paused_workers <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 24%] 4477s tests/test_active_memory_manager.py::test_drop_with_paused_workers_with_running_tasks_1 <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 24%] 4477s tests/test_active_memory_manager.py::test_drop_with_paused_workers_with_running_tasks_2 <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 24%] 4477s tests/test_active_memory_manager.py::test_drop_with_paused_workers_with_running_tasks_3_4[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 24%] 4478s tests/test_active_memory_manager.py::test_drop_with_paused_workers_with_running_tasks_3_4[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 24%] 4478s tests/test_active_memory_manager.py::test_drop_with_paused_workers_with_running_tasks_5 <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 24%] 4478s tests/test_active_memory_manager.py::test_replicate <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 24%] 4478s tests/test_active_memory_manager.py::test_replicate_not_in_memory <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 25%] 4478s tests/test_active_memory_manager.py::test_double_replicate_stress <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 25%] 4479s tests/test_active_memory_manager.py::test_replicate_to_worker_with_most_free_memory <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 25%] 4479s tests/test_active_memory_manager.py::test_replicate_with_candidates <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 25%] 4479s tests/test_active_memory_manager.py::test_replicate_with_empty_candidates <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 25%] 4480s tests/test_active_memory_manager.py::test_replicate_to_candidates_with_key <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 25%] 4480s tests/test_active_memory_manager.py::test_replicate_avoids_paused_workers_1 <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 25%] 4480s tests/test_active_memory_manager.py::test_replicate_avoids_paused_workers_2 <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 25%] 4480s tests/test_active_memory_manager.py::test_bad_measure <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 25%] 4481s tests/test_active_memory_manager.py::test_ReduceReplicas <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 25%] 4481s tests/test_active_memory_manager.py::test_ReduceReplicas_with_waiters[0-0-0-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 25%] 4482s tests/test_active_memory_manager.py::test_ReduceReplicas_with_waiters[1-0-0-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 25%] 4482s tests/test_active_memory_manager.py::test_ReduceReplicas_with_waiters[0-0-1-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 25%] 4483s tests/test_active_memory_manager.py::test_ReduceReplicas_with_waiters[2-0-0-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 25%] 4483s tests/test_active_memory_manager.py::test_ReduceReplicas_with_waiters[1-1-0-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 25%] 4484s tests/test_active_memory_manager.py::test_ReduceReplicas_with_waiters[1-1-1-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 25%] 4484s tests/test_active_memory_manager.py::test_ReduceReplicas_with_waiters[1-1-2-4] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 25%] 4485s tests/test_active_memory_manager.py::test_ReduceReplicas_with_waiters[2-1-1-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 25%] 4485s tests/test_active_memory_manager.py::test_ReduceReplicas_with_waiters[1-1-17-4] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 25%] 4486s tests/test_active_memory_manager.py::test_ReduceReplicas_with_waiters[17-1-1-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 25%] 4486s tests/test_active_memory_manager.py::test_ReduceReplicas_with_waiters[18-1-1-4] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 25%] 4486s tests/test_active_memory_manager.py::test_RetireWorker_amm_on_off[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 25%] 4486s tests/test_active_memory_manager.py::test_RetireWorker_amm_on_off[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 25%] 4487s tests/test_active_memory_manager.py::test_RetireWorker_no_extension <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 25%] 4487s tests/test_active_memory_manager.py::test_RetireWorker_no_remove <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 25%] 4487s tests/test_active_memory_manager.py::test_RetireWorker_with_ReduceReplicas[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 25%] 4487s tests/test_active_memory_manager.py::test_RetireWorker_with_ReduceReplicas[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 25%] 4487s tests/test_active_memory_manager.py::test_RetireWorker_all_replicas_are_being_retired <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 25%] 4488s tests/test_active_memory_manager.py::test_RetireWorker_no_recipients <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 25%] 4488s tests/test_active_memory_manager.py::test_RetireWorker_all_recipients_are_paused <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 25%] 4489s tests/test_active_memory_manager.py::test_RetireWorker_new_keys_arrive_after_all_keys_moved_away <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 25%] 4489s tests/test_active_memory_manager.py::test_RetireWorker_faulty_recipient <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 25%] 4490s tests/test_active_memory_manager.py::test_RetireWorker_mass <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 25%] 4490s tests/test_active_memory_manager.py::test_RetireWorker_incremental <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 26%] 4491s tests/test_active_memory_manager.py::test_dont_drop_actors <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 26%] 4491s tests/test_active_memory_manager.py::test_dont_replicate_actors <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 26%] 4491s tests/test_active_memory_manager.py::test_RetireWorker_with_actor[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 26%] 4491s tests/test_active_memory_manager.py::test_RetireWorker_with_actor[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 26%] 4491s tests/test_active_memory_manager.py::test_RetireWorker_with_actor_proxy <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 26%] 4491s tests/test_active_memory_manager.py::test_noamm_stress <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py SKIPPED [ 26%] 4491s tests/test_active_memory_manager.py::test_drop_stress <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py SKIPPED [ 26%] 4491s tests/test_active_memory_manager.py::test_ReduceReplicas_stress <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py SKIPPED [ 26%] 4491s tests/test_active_memory_manager.py::test_RetireWorker_stress[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py SKIPPED [ 26%] 4492s tests/test_active_memory_manager.py::test_RetireWorker_stress[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py SKIPPED [ 26%] 4492s tests/test_actor.py::test_client_actions[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 26%] 4492s tests/test_actor.py::test_client_actions[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 26%] 4492s tests/test_actor.py::test_worker_actions[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 26%] 4492s tests/test_actor.py::test_worker_actions[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 26%] 4492s tests/test_actor.py::test_Actor <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 26%] 4493s tests/test_actor.py::test_linear_access <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py XFAILges rather than 4493s rpc) [ 26%] 4493s tests/test_actor.py::test_exceptions_create <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 26%] 4493s tests/test_actor.py::test_exceptions_method <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 26%] 4493s tests/test_actor.py::test_gc <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 26%] 4494s tests/test_actor.py::test_track_dependencies <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 26%] 4494s tests/test_actor.py::test_future <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 26%] 4494s tests/test_actor.py::test_future_dependencies <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 26%] 4496s tests/test_actor.py::test_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 26%] 4498s tests/test_actor.py::test_timeout <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 26%] 4498s tests/test_actor.py::test_failed_worker <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 26%] 4498s tests/test_actor.py::test_numpy_roundtrip <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 26%] 4498s tests/test_actor.py::test_numpy_roundtrip_getattr <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 26%] 4498s tests/test_actor.py::test_repr <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 26%] 4499s tests/test_actor.py::test_dir <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 26%] 4499s tests/test_actor.py::test_many_computations <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 26%] 4499s tests/test_actor.py::test_thread_safety <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 26%] 4499s tests/test_actor.py::test_Actors_create_dependencies <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 27%] 4499s tests/test_actor.py::test_load_balance <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 27%] 4500s tests/test_actor.py::test_load_balance_map <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 27%] 4500s tests/test_actor.py::test_compute <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 27%] 4502s tests/test_actor.py::test_compute_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 27%] 4502s tests/test_actor.py::test_actors_in_profile <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 27%] 4502s tests/test_actor.py::test_waiter <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 27%] 4502s tests/test_actor.py::test_worker_actor_handle_is_weakref <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 27%] 4504s tests/test_actor.py::test_worker_actor_handle_is_weakref_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 27%] 4506s tests/test_actor.py::test_worker_actor_handle_is_weakref_from_compute_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 27%] 4508s tests/test_actor.py::test_one_thread_deadlock <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 27%] 4510s tests/test_actor.py::test_one_thread_deadlock_timeout <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 27%] 4512s tests/test_actor.py::test_one_thread_deadlock_sync_client <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 27%] 4512s tests/test_actor.py::test_async_deadlock <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 27%] 4514s tests/test_actor.py::test_exception <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 27%] 4514s tests/test_actor.py::test_exception_async <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 27%] 4516s tests/test_actor.py::test_as_completed <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 27%] 4516s tests/test_actor.py::test_actor_future_awaitable <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 27%] 4517s tests/test_actor.py::test_actor_future_awaitable_deadlock <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 27%] 4517s tests/test_actor.py::test_serialize_with_pickle <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 27%] 4517s tests/test_actor.py::test_worker_client_async <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 27%] 4517s tests/test_actor.py::test_worker_client_separate_thread <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 27%] 4517s tests/test_actor.py::test_get_worker <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 27%] 4517s tests/test_as_completed.py::test_as_completed_async <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_as_completed.py PASSED [ 27%] 4519s tests/test_as_completed.py::test_as_completed_timeout_async <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_as_completed.py PASSED [ 27%] 4521s tests/test_as_completed.py::test_as_completed_timeout_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_as_completed.py PASSED [ 27%] 4524s tests/test_as_completed.py::test_as_completed_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_as_completed.py PASSED [ 27%] 4526s tests/test_as_completed.py::test_as_completed_with_non_futures <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_as_completed.py PASSED [ 27%] 4528s tests/test_as_completed.py::test_as_completed_add <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_as_completed.py PASSED [ 27%] 4530s tests/test_as_completed.py::test_as_completed_update <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_as_completed.py PASSED [ 27%] 4531s tests/test_as_completed.py::test_as_completed_repeats <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_as_completed.py PASSED [ 27%] 4533s tests/test_as_completed.py::test_as_completed_is_empty <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_as_completed.py PASSED [ 27%] 4533s tests/test_as_completed.py::test_as_completed_cancel <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_as_completed.py PASSED [ 28%] 4535s tests/test_as_completed.py::test_as_completed_cancel_last <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_as_completed.py PASSED [ 28%] 4536s tests/test_as_completed.py::test_async_for_py2_equivalent <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_as_completed.py PASSED [ 28%] 4536s tests/test_as_completed.py::test_as_completed_error_async <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_as_completed.py PASSED [ 28%] 4538s tests/test_as_completed.py::test_as_completed_error <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_as_completed.py PASSED [ 28%] 4540s tests/test_as_completed.py::test_as_completed_with_results <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_as_completed.py PASSED [ 28%] 4540s tests/test_as_completed.py::test_as_completed_with_results_async <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_as_completed.py PASSED [ 28%] 4542s tests/test_as_completed.py::test_as_completed_with_results_no_raise <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_as_completed.py PASSED [ 28%] 4542s tests/test_as_completed.py::test_str <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_as_completed.py PASSED [ 28%] 4542s tests/test_as_completed.py::test_as_completed_with_results_no_raise_async <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_as_completed.py PASSED [ 28%] 4542s tests/test_as_completed.py::test_clear <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_as_completed.py PASSED [ 28%] 4542s tests/test_async_task_group.py::test_async_task_group_initialization <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_async_task_group.py PASSED [ 28%] 4542s tests/test_async_task_group.py::test_async_task_group_call_soon_executes_task_in_background <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_async_task_group.py PASSED [ 28%] 4543s tests/test_async_task_group.py::test_async_task_group_call_later_executes_delayed_task_in_background <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_async_task_group.py PASSED [ 28%] 4543s tests/test_async_task_group.py::test_async_task_group_close_closes <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_async_task_group.py PASSED [ 28%] 4543s tests/test_async_task_group.py::test_async_task_group_close_does_not_cancel_existing_tasks <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_async_task_group.py PASSED [ 28%] 4544s tests/test_async_task_group.py::test_async_task_group_close_prohibits_new_tasks <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_async_task_group.py PASSED [ 28%] 4544s tests/test_async_task_group.py::test_async_task_group_stop_disallows_shutdown <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_async_task_group.py PASSED [ 28%] 4544s tests/test_async_task_group.py::test_async_task_group_stop_cancels_long_running <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_async_task_group.py PASSED [ 28%] 4544s tests/test_asyncio.py::test_rlock <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_asyncio.py PASSED [ 28%] 4544s tests/test_asyncio.py::test_rlock_nonreentrant <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_asyncio.py PASSED [ 28%] 4544s tests/test_asyncio.py::test_rlock_none <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_asyncio.py PASSED [ 28%] 4544s tests/test_asyncio.py::test_rlock_release_on_raise <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_asyncio.py PASSED [ 28%] 4545s tests/test_asyncprocess.py::test_simple <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_asyncprocess.py PASSED [ 28%] 4546s tests/test_asyncprocess.py::test_exitcode <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_asyncprocess.py PASSED [ 28%] 4547s tests/test_asyncprocess.py::test_sigint_from_same_process <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_asyncprocess.py PASSED [ 28%] 4547s tests/test_asyncprocess.py::test_sigterm_from_parent_process <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_asyncprocess.py PASSED [ 28%] 4547s tests/test_asyncprocess.py::test_terminate <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_asyncprocess.py PASSED [ 28%] 4548s tests/test_asyncprocess.py::test_close <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_asyncprocess.py PASSED [ 28%] 4550s tests/test_asyncprocess.py::test_exit_callback <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_asyncprocess.py PASSED [ 28%] 4551s tests/test_asyncprocess.py::test_child_main_thread <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_asyncprocess.py PASSED [ 28%] 4554s tests/test_asyncprocess.py::test_num_fds <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_asyncprocess.py PASSED [ 28%] 4554s tests/test_asyncprocess.py::test_terminate_after_stop <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_asyncprocess.py PASSED [ 28%] 4555s tests/test_asyncprocess.py::test_kill <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_asyncprocess.py PASSED [ 29%] 4558s tests/test_asyncprocess.py::test_asyncprocess_child_teardown_on_parent_exit <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_asyncprocess.py PASSED [ 29%] 4558s tests/test_batched.py::test_close_not_started <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_batched.py PASSED [ 29%] 4558s tests/test_batched.py::test_stress <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_batched.py SKIPPED [ 29%] 4558s tests/test_batched.py::test_large_traffic_jam <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_batched.py SKIPPED [ 29%] 4558s tests/test_cancelled_state.py::test_abort_execution_release <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 29%] 4558s tests/test_cancelled_state.py::test_abort_execution_reschedule <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 29%] 4558s tests/test_cancelled_state.py::test_abort_execution_add_as_dependency <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 29%] 4558s tests/test_cancelled_state.py::test_abort_execution_to_fetch <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 29%] 4559s tests/test_cancelled_state.py::test_worker_stream_died_during_comm <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 29%] 4559s tests/test_cancelled_state.py::test_flight_to_executing_via_cancelled_resumed <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 29%] 4559s tests/test_cancelled_state.py::test_executing_cancelled_error <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 29%] 4559s tests/test_cancelled_state.py::test_flight_cancelled_error <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 29%] 4559s tests/test_cancelled_state.py::test_in_flight_lost_after_resumed <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 29%] 4559s tests/test_cancelled_state.py::test_cancelled_error <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 29%] 4560s tests/test_cancelled_state.py::test_cancelled_error_with_resources <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 29%] 4560s tests/test_cancelled_state.py::test_cancelled_resumed_after_flight_with_dependencies <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 29%] 4560s tests/test_cancelled_state.py::test_cancelled_resumed_after_flight_with_dependencies_workerstate <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 29%] 4560s tests/test_cancelled_state.py::test_resumed_cancelled_handle_compute[True-True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 29%] 4560s tests/test_cancelled_state.py::test_resumed_cancelled_handle_compute[True-False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 29%] 4561s tests/test_cancelled_state.py::test_resumed_cancelled_handle_compute[False-True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 29%] 4561s tests/test_cancelled_state.py::test_resumed_cancelled_handle_compute[False-False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 29%] 4561s tests/test_cancelled_state.py::test_cancelled_handle_compute[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 29%] 4562s tests/test_cancelled_state.py::test_cancelled_handle_compute[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 29%] 4562s tests/test_cancelled_state.py::test_cancelled_task_error_rejected <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 29%] 4563s tests/test_cancelled_state.py::test_deadlock_cancelled_after_inflight_before_gather_from_worker[True-resumed] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 29%] 4563s tests/test_cancelled_state.py::test_deadlock_cancelled_after_inflight_before_gather_from_worker[True-cancelled] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 29%] 4563s tests/test_cancelled_state.py::test_workerstate_executing_to_executing[executing] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 29%] 4563s tests/test_cancelled_state.py::test_workerstate_executing_to_executing[long-running] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 29%] 4563s tests/test_cancelled_state.py::test_workerstate_flight_to_flight <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 29%] 4563s tests/test_cancelled_state.py::test_workerstate_executing_skips_fetch_on_success[executing] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 29%] 4563s tests/test_cancelled_state.py::test_workerstate_executing_skips_fetch_on_success[long-running] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 29%] 4563s tests/test_cancelled_state.py::test_workerstate_executing_failure_to_fetch[executing] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 30%] 4563s tests/test_cancelled_state.py::test_workerstate_executing_failure_to_fetch[long-running] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 30%] 4563s tests/test_cancelled_state.py::test_workerstate_flight_skips_executing_on_success <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 30%] 4563s tests/test_cancelled_state.py::test_workerstate_flight_failure_to_executing[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 30%] 4563s tests/test_cancelled_state.py::test_workerstate_flight_failure_to_executing[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 30%] 4563s tests/test_cancelled_state.py::test_workerstate_resumed_fetch_to_cancelled_to_executing[executing] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 30%] 4563s tests/test_cancelled_state.py::test_workerstate_resumed_fetch_to_cancelled_to_executing[long-running] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 30%] 4563s tests/test_cancelled_state.py::test_workerstate_resumed_fetch_to_executing[executing] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 30%] 4563s tests/test_cancelled_state.py::test_workerstate_resumed_fetch_to_executing[long-running] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 30%] 4563s tests/test_cancelled_state.py::test_workerstate_resumed_waiting_to_flight <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 30%] 4564s tests/test_cancelled_state.py::test_execute_preamble_early_cancel[executing-False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 30%] 4564s tests/test_cancelled_state.py::test_execute_preamble_early_cancel[executing-True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 30%] 4564s tests/test_cancelled_state.py::test_execute_preamble_early_cancel[resumed-False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 30%] 4564s tests/test_cancelled_state.py::test_execute_preamble_early_cancel[resumed-True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 30%] 4564s tests/test_cancelled_state.py::test_cancel_with_dependencies_in_memory[ExecuteSuccessEvent-False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 30%] 4564s tests/test_cancelled_state.py::test_cancel_with_dependencies_in_memory[ExecuteSuccessEvent-True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 30%] 4564s tests/test_cancelled_state.py::test_cancel_with_dependencies_in_memory[ExecuteFailureEvent-False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 30%] 4564s tests/test_cancelled_state.py::test_cancel_with_dependencies_in_memory[ExecuteFailureEvent-True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 30%] 4564s tests/test_cancelled_state.py::test_cancel_with_dependencies_in_memory[RescheduleEvent-False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 30%] 4564s tests/test_cancelled_state.py::test_cancel_with_dependencies_in_memory[RescheduleEvent-True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 30%] 4564s tests/test_cancelled_state.py::test_secede_cancelled_or_resumed_workerstate[ExecuteSuccessEvent-False-False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 30%] 4564s tests/test_cancelled_state.py::test_secede_cancelled_or_resumed_workerstate[ExecuteSuccessEvent-False-True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 30%] 4564s tests/test_cancelled_state.py::test_secede_cancelled_or_resumed_workerstate[ExecuteSuccessEvent-True-False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 30%] 4564s tests/test_cancelled_state.py::test_secede_cancelled_or_resumed_workerstate[ExecuteSuccessEvent-True-True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 30%] 4564s tests/test_cancelled_state.py::test_secede_cancelled_or_resumed_workerstate[ExecuteFailureEvent-False-False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 30%] 4564s tests/test_cancelled_state.py::test_secede_cancelled_or_resumed_workerstate[ExecuteFailureEvent-False-True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 30%] 4564s tests/test_cancelled_state.py::test_secede_cancelled_or_resumed_workerstate[ExecuteFailureEvent-True-False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 30%] 4564s tests/test_cancelled_state.py::test_secede_cancelled_or_resumed_workerstate[ExecuteFailureEvent-True-True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 30%] 4564s tests/test_cancelled_state.py::test_secede_cancelled_or_resumed_workerstate[RescheduleEvent-False-False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 30%] 4564s tests/test_cancelled_state.py::test_secede_cancelled_or_resumed_workerstate[RescheduleEvent-False-True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 30%] 4564s tests/test_cancelled_state.py::test_secede_cancelled_or_resumed_workerstate[RescheduleEvent-True-False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 30%] 4564s tests/test_cancelled_state.py::test_secede_cancelled_or_resumed_workerstate[RescheduleEvent-True-True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 30%] 4564s tests/test_cancelled_state.py::test_secede_cancelled_or_resumed_scheduler <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 31%] 4564s tests/test_cancelled_state.py::test_workerstate_remove_replica_of_cancelled_task_dependency <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 31%] 4570s tests/test_chaos.py::test_KillWorker[sys.exit] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_chaos.py PASSED [ 31%] 4571s tests/test_chaos.py::test_KillWorker[graceful] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_chaos.py PASSED [ 31%] 4577s tests/test_chaos.py::test_KillWorker[segfault] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_chaos.py PASSED [ 31%] 4577s tests/test_client.py::test_submit <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 31%] 4578s tests/test_client.py::test_map <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 31%] 4578s tests/test_client.py::test_map_empty <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 31%] 4578s tests/test_client.py::test_map_keynames <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 31%] 4578s tests/test_client.py::test_map_retries <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 31%] 4579s tests/test_client.py::test_map_batch_size <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 31%] 4580s tests/test_client.py::test_custom_key_with_batches <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 31%] 4580s tests/test_client.py::test_compute_retries <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 31%] 4580s tests/test_client.py::test_compute_retries_annotations <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 31%] 4582s tests/test_client.py::test_retries_get <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 31%] 4582s tests/test_client.py::test_persist_retries <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 31%] 4582s tests/test_client.py::test_persist_retries_annotations <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 31%] 4583s tests/test_client.py::test_retries_dask_array <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 31%] 4583s tests/test_client.py::test_future_repr <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 31%] 4583s tests/test_client.py::test_future_tuple_repr <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 31%] 4583s tests/test_client.py::test_Future_exception <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 31%] 4585s tests/test_client.py::test_Future_exception_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 31%] 4586s tests/test_client.py::test_Future_release <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 31%] 4588s tests/test_client.py::test_Future_release_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 31%] 4590s tests/test_client.py::test_short_tracebacks[result] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 31%] 4592s tests/test_client.py::test_short_tracebacks[gather] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 31%] 4592s tests/test_client.py::test_short_tracebacks_async[await] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 31%] 4592s tests/test_client.py::test_short_tracebacks_async[result] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 31%] 4593s tests/test_client.py::test_short_tracebacks_async[gather] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 31%] 4593s tests/test_client.py::test_map_naming <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 31%] 4593s tests/test_client.py::test_submit_naming <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 31%] 4593s tests/test_client.py::test_exceptions <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 31%] 4593s tests/test_client.py::test_gc <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 31%] 4595s tests/test_client.py::test_thread <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 32%] 4598s tests/test_client.py::test_sync_exceptions <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 32%] 4598s tests/test_client.py::test_gather <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 32%] 4598s tests/test_client.py::test_gather_mismatched_client <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 32%] 4598s tests/test_client.py::test_gather_lost <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 32%] 4601s tests/test_client.py::test_gather_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 32%] 4601s tests/test_client.py::test_gather_strict <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 32%] 4601s tests/test_client.py::test_gather_skip <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 32%] 4602s tests/test_client.py::test_limit_concurrent_gathering <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 32%] 4602s tests/test_client.py::test_get <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 32%] 4605s tests/test_client.py::test_get_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 32%] 4607s tests/test_client.py::test_no_future_references <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 32%] 4609s tests/test_client.py::test_get_sync_optimize_graph_passes_through <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 32%] 4609s tests/test_client.py::test_gather_errors <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 32%] 4610s tests/test_client.py::test_wait <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 32%] 4610s tests/test_client.py::test_wait_first_completed <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 32%] 4610s tests/test_client.py::test_wait_timeout <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 32%] 4612s tests/test_client.py::test_wait_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 32%] 4615s tests/test_client.py::test_wait_informative_error_for_timeouts <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 32%] 4615s tests/test_client.py::test_garbage_collection <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 32%] 4615s tests/test_client.py::test_garbage_collection_with_scatter <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 32%] 4615s tests/test_client.py::test_recompute_released_key <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 32%] 4615s tests/test_client.py::test_long_tasks_dont_trigger_timeout <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py SKIPPED [ 32%] 4616s tests/test_client.py::test_tokenize_on_futures <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 32%] 4616s tests/test_client.py::test_restrictions_submit <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 32%] 4616s tests/test_client.py::test_restrictions_ip_port <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 32%] 4616s tests/test_client.py::test_restrictions_map <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 32%] 4616s tests/test_client.py::test_restrictions_get <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 32%] 4616s tests/test_client.py::test_restrictions_get_annotate <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 32%] 4617s tests/test_client.py::test_remove_worker <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 32%] 4617s tests/test_client.py::test_errors_dont_block <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 32%] 4617s tests/test_client.py::test_submit_quotes <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 32%] 4617s tests/test_client.py::test_map_quotes <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 33%] 4618s tests/test_client.py::test_two_consecutive_clients_share_results <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 33%] 4618s tests/test_client.py::test_submit_then_get_with_Future <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 33%] 4618s tests/test_client.py::test_aliases <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 33%] 4618s tests/test_client.py::test_aliases_2 <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 33%] 4618s tests/test_client.py::test_scatter <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 33%] 4619s tests/test_client.py::test_scatter_types <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 33%] 4619s tests/test_client.py::test_scatter_non_list <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 33%] 4619s tests/test_client.py::test_scatter_tokenize_local <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 33%] 4619s tests/test_client.py::test_scatter_singletons <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 33%] 4619s tests/test_client.py::test_scatter_typename <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 33%] 4619s tests/test_client.py::test_scatter_hash <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 33%] 4620s tests/test_client.py::test_scatter_hash_2 <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 33%] 4620s tests/test_client.py::test_get_releases_data <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 33%] 4622s tests/test_client.py::test_current <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 33%] 4624s tests/test_client.py::test_current_nested <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 33%] 4624s tests/test_client.py::test_current_nested_async <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 33%] 4624s tests/test_client.py::test_current_concurrent <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 33%] 4624s tests/test_client.py::test_context_manager_used_from_different_tasks <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 33%] 4626s tests/test_client.py::test_context_manager_used_from_different_threads <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 33%] 4628s tests/test_client.py::test_global_clients <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 33%] 4629s tests/test_client.py::test_exception_on_exception <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 33%] 4629s tests/test_client.py::test_get_task_prefix_states <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 33%] 4629s tests/test_client.py::test_get_nbytes <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 33%] 4629s tests/test_client.py::test_nbytes_determines_worker <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 33%] 4629s tests/test_client.py::test_if_intermediates_clear_on_error <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 33%] 4629s tests/test_client.py::test_pragmatic_move_small_data_to_large_data <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 33%] 4630s tests/test_client.py::test_get_with_non_list_key <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 33%] 4630s tests/test_client.py::test_get_with_error <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 33%] 4632s tests/test_client.py::test_get_with_error_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 33%] 4632s tests/test_client.py::test_directed_scatter <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 33%] 4632s tests/test_client.py::test_scatter_direct <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 33%] 4633s tests/test_client.py::test_scatter_direct_2 <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 34%] 4633s tests/test_client.py::test_scatter_direct_numpy <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 34%] 4633s tests/test_client.py::test_scatter_direct_broadcast <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 34%] 4633s tests/test_client.py::test_scatter_direct_balanced <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 34%] 4634s tests/test_client.py::test_scatter_direct_broadcast_target <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 34%] 4634s tests/test_client.py::test_scatter_direct_empty <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 34%] 4634s tests/test_client.py::test_scatter_direct_spread_evenly <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 34%] 4636s tests/test_client.py::test_scatter_gather_sync[True-True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 34%] 4638s tests/test_client.py::test_scatter_gather_sync[True-False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 34%] 4640s tests/test_client.py::test_scatter_gather_sync[False-True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 34%] 4642s tests/test_client.py::test_scatter_gather_sync[False-False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 34%] 4643s tests/test_client.py::test_gather_direct <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 34%] 4643s tests/test_client.py::test_many_submits_spread_evenly <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 34%] 4643s tests/test_client.py::test_traceback <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 34%] 4643s tests/test_client.py::test_get_traceback <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 34%] 4643s tests/test_client.py::test_gather_traceback <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 34%] 4645s tests/test_client.py::test_traceback_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 34%] 4646s tests/test_client.py::test_upload_file <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 34%] 4646s tests/test_client.py::test_upload_file_refresh_delayed <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 34%] 4646s tests/test_client.py::test_upload_file_no_extension <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 34%] 4647s tests/test_client.py::test_upload_file_zip <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 34%] 4647s tests/test_client.py::test_upload_file_egg <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py SKIPPED [ 34%] 4647s tests/test_client.py::test_upload_large_file <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 34%] 4649s tests/test_client.py::test_upload_file_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 34%] 4649s tests/test_client.py::test_upload_file_exception <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 34%] 4652s tests/test_client.py::test_upload_file_exception_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 34%] 4652s tests/test_client.py::test_upload_file_load <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 34%] 4652s tests/test_client.py::test_upload_file_new_worker <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 34%] 4652s tests/test_client.py::test_multiple_clients <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py SKIPPED [ 34%] 4652s tests/test_client.py::test_async_compute <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 34%] 4653s tests/test_client.py::test_async_compute_with_scatter <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 34%] 4655s tests/test_client.py::test_sync_compute <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 34%] 4655s tests/test_client.py::test_remote_scatter_gather <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 34%] 4655s tests/test_client.py::test_remote_submit_on_Future <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 35%] 4657s tests/test_client.py::test_start_is_idempotent <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 35%] 4657s tests/test_client.py::test_client_with_scheduler <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 35%] 4658s tests/test_client.py::test_allow_restrictions <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 35%] 4658s tests/test_client.py::test_bad_address <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 35%] 4658s tests/test_client.py::test_informative_error_on_cluster_type <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 35%] 4658s tests/test_client.py::test_long_error <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 35%] 4658s tests/test_client.py::test_map_on_futures_with_kwargs <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 35%] 4658s tests/test_client.py::test_badly_serialized_input_stderr <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py SKIPPED [ 35%] 4660s tests/test_client.py::test_repr[str] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 35%] 4662s tests/test_client.py::test_repr[repr] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 35%] 4665s tests/test_client.py::test_repr[func2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 35%] 4665s tests/test_client.py::test_repr_async <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 35%] 4665s tests/test_client.py::test_repr_no_memory_limit <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 35%] 4665s tests/test_client.py::test_forget_simple <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 35%] 4665s tests/test_client.py::test_forget_complex <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 35%] 4666s tests/test_client.py::test_forget_in_flight <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 35%] 4666s tests/test_client.py::test_forget_errors <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 35%] 4668s tests/test_client.py::test_repr_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 35%] 4668s tests/test_client.py::test_multi_client <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 35%] 4670s tests/test_client.py::test_cleanup_after_broken_client_connection <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 35%] 4670s tests/test_client.py::test_multi_garbage_collection <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 35%] 4670s tests/test_client.py::test__broadcast <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 35%] 4670s tests/test_client.py::test__broadcast_integer <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 35%] 4670s tests/test_client.py::test__broadcast_dict <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 35%] 4671s tests/test_client.py::test_proxy <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 35%] 4672s tests/test_client.py::test_cancel <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 35%] 4672s tests/test_client.py::test_cancel_tuple_key <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 35%] 4672s tests/test_client.py::test_cancel_multi_client <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 35%] 4672s tests/test_client.py::test_cancel_before_known_to_scheduler <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 35%] 4672s tests/test_client.py::test_cancel_collection <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 35%] 4674s tests/test_client.py::test_cancel_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 35%] 4675s tests/test_client.py::test_future_type <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 36%] 4675s tests/test_client.py::test_traceback_clean <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 36%] 4675s tests/test_client.py::test_map_differnet_lengths <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 36%] 4677s tests/test_client.py::test_Future_exception_sync_2 <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 36%] 4677s tests/test_client.py::test_async_persist <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 36%] 4677s tests/test_client.py::test_persist_async <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 36%] 4679s tests/test_client.py::test_persist <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 36%] 4679s tests/test_client.py::test_long_traceback <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 36%] 4680s tests/test_client.py::test_wait_on_collections <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 36%] 4680s tests/test_client.py::test_futures_of_get <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 36%] 4680s tests/test_client.py::test_futures_of_class <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 36%] 4680s tests/test_client.py::test_futures_of_cancelled_raises <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 36%] 4680s tests/test_client.py::test_balance_tasks_by_stacks <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py SKIPPED [ 36%] 4680s tests/test_client.py::test_run <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 36%] 4680s tests/test_client.py::test_run_handles_picklable_data <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 36%] 4683s tests/test_client.py::test_run_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 36%] 4683s tests/test_client.py::test_run_coroutine <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 36%] 4685s tests/test_client.py::test_run_coroutine_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 36%] 4685s tests/test_client.py::test_run_exception <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 36%] 4686s tests/test_client.py::test_run_rpc_error <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 36%] 4689s tests/test_client.py::test_diagnostic_ui <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 36%] 4691s tests/test_client.py::test_diagnostic_nbytes_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 36%] 4692s tests/test_client.py::test_diagnostic_nbytes <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 36%] 4692s tests/test_client.py::test_worker_aliases <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 36%] 4694s tests/test_client.py::test_persist_get_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 36%] 4695s tests/test_client.py::test_persist_get[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 36%] 4695s tests/test_client.py::test_persist_get[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 36%] 4697s tests/test_client.py::test_client_num_fds <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 36%] 4698s tests/test_client.py::test_startup_close_startup <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 36%] 4700s tests/test_client.py::test_startup_close_startup_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 36%] 4700s tests/test_client.py::test_badly_serialized_exceptions <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 36%] 4700s tests/test_client.py::test_rebalance <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 36%] 4701s tests/test_client.py::test_rebalance_workers_and_keys <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 37%] 4701s tests/test_client.py::test_rebalance_unprepared <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 37%] 4701s tests/test_client.py::test_receive_lost_key <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 37%] 4702s tests/test_client.py::test_unrunnable_task_runs <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 37%] 4704s tests/test_client.py::test_add_worker_after_tasks <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 37%] 4704s tests/test_client.py::test_workers_register_indirect_data <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 37%] 4704s tests/test_client.py::test_submit_on_cancelled_future <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 37%] 4705s tests/test_client.py::test_replicate <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 37%] 4705s tests/test_client.py::test_replicate_tuple_keys <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 37%] 4706s tests/test_client.py::test_replicate_workers <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 37%] 4706s tests/test_client.py::test_replicate_tree_branching <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 37%] 4707s tests/test_client.py::test_client_replicate <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 37%] 4707s tests/test_client.py::test_client_replicate_host <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 37%] 4709s tests/test_client.py::test_client_replicate_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 37%] 4710s tests/test_client.py::test_task_load_adapts_quickly <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 37%] 4710s tests/test_client.py::test_even_load_after_fast_functions <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 37%] 4710s tests/test_client.py::test_even_load_on_startup <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 37%] 4710s tests/test_client.py::test_contiguous_load <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py SKIPPED [ 37%] 4710s tests/test_client.py::test_balanced_with_submit <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 37%] 4711s tests/test_client.py::test_balanced_with_submit_and_resident_data <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 37%] 4711s tests/test_client.py::test_scheduler_saturates_cores <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 37%] 4711s tests/test_client.py::test_scheduler_saturates_cores_random <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 37%] 4712s tests/test_client.py::test_cancel_clears_processing <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 37%] 4714s tests/test_client.py::test_default_get <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 37%] 4714s tests/test_client.py::test_get_scheduler_default_client_config_interleaving <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 37%] 4715s tests/test_client.py::test_ensure_default_client <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 37%] 4715s tests/test_client.py::test_set_as_default <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 37%] 4715s tests/test_client.py::test_get_foo <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 37%] 4715s tests/test_client.py::test_get_foo_lost_keys <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 37%] 4715s tests/test_client.py::test_bad_tasks_fail <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py SKIPPED [ 37%] 4718s tests/test_client.py::test_get_processing_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 37%] 4720s tests/test_client.py::test_close_idempotent <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 37%] 4722s tests/test_client.py::test_get_returns_early <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 37%] 4722s tests/test_client.py::test_Client_clears_references_after_restart <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py SKIPPED [ 38%] 4725s tests/test_client.py::test_get_stops_work_after_error <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 38%] 4727s tests/test_client.py::test_as_completed_list <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 38%] 4729s tests/test_client.py::test_as_completed_results <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 38%] 4732s tests/test_client.py::test_as_completed_batches[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 38%] 4734s tests/test_client.py::test_as_completed_batches[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 38%] 4737s tests/test_client.py::test_as_completed_next_batch <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 38%] 4737s tests/test_client.py::test_status <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 38%] 4737s tests/test_client.py::test_persist_optimize_graph <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 38%] 4738s tests/test_client.py::test_scatter_raises_if_no_workers <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 38%] 4738s tests/test_client.py::test_reconnect <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py SKIPPED [ 38%] 4738s tests/test_client.py::test_reconnect_timeout <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 38%] 4739s tests/test_client.py::test_idempotence <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 38%] 4741s tests/test_client.py::test_scheduler_info <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 38%] 4743s tests/test_client.py::test_write_scheduler_file <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 38%] 4746s tests/test_client.py::test_get_versions_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 38%] 4747s tests/test_client.py::test_get_versions_async <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 38%] 4747s tests/test_client.py::test_get_versions_rpc_error <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 38%] 4750s tests/test_client.py::test_threaded_get_within_distributed <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 38%] 4750s tests/test_client.py::test_lose_scattered_data <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 38%] 4750s tests/test_client.py::test_partially_lose_scattered_data <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 38%] 4750s tests/test_client.py::test_scatter_compute_lose <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 38%] 4751s tests/test_client.py::test_scatter_compute_store_lose <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 38%] 4751s tests/test_client.py::test_scatter_compute_store_lose_processing <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 38%] 4751s tests/test_client.py::test_temp_default_client <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 38%] 4752s tests/test_client.py::test_as_current <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 38%] 4754s tests/test_client.py::test_as_current_is_thread_local <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 38%] 4754s tests/test_client.py::test_as_current_is_task_local <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 38%] 4755s tests/test_client.py::test_persist_workers_annotate <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 38%] 4755s tests/test_client.py::test_persist_workers_annotate2 <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 38%] 4755s tests/test_client.py::test_persist_workers <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 38%] 4755s tests/test_client.py::test_compute_workers_annotate <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 38%] 4756s tests/test_client.py::test_compute_workers <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 39%] 4756s tests/test_client.py::test_compute_nested_containers <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 39%] 4756s tests/test_client.py::test_scatter_type <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 39%] 4757s tests/test_client.py::test_retire_workers_2 <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 39%] 4757s tests/test_client.py::test_retire_many_workers <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 39%] 4758s tests/test_client.py::test_weight_occupancy_against_data_movement <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 39%] 4758s tests/test_client.py::test_distribute_tasks_by_nthreads <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 39%] 4759s tests/test_client.py::test_add_done_callback <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 39%] 4759s tests/test_client.py::test_normalize_collection <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 39%] 4759s tests/test_client.py::test_normalize_collection_dask_array <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 39%] 4759s tests/test_client.py::test_normalize_collection_with_released_futures <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py SKIPPED [ 39%] 4759s tests/test_client.py::test_auto_normalize_collection <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py XPASS [ 39%] 4762s tests/test_client.py::test_auto_normalize_collection_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py XPASS [ 39%] 4763s tests/test_client.py::test_interleave_computations <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 39%] 4763s tests/test_client.py::test_interleave_computations_map <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py SKIPPED [ 39%] 4763s tests/test_client.py::test_scatter_dict_workers <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 39%] 4763s tests/test_client.py::test_client_timeout <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py SKIPPED [ 39%] 4763s tests/test_client.py::test_submit_list_kwargs <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 39%] 4763s tests/test_client.py::test_map_list_kwargs <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 39%] 4765s tests/test_client.py::test_recreate_error_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 39%] 4767s tests/test_client.py::test_recreate_error_not_error <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 39%] 4769s tests/test_client.py::test_recreate_task_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 39%] 4770s tests/test_client.py::test_retire_workers <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 39%] 4770s tests/test_client.py::test_restart_workers <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py SKIPPED [ 39%] 4770s tests/test_client.py::test_restart_workers_no_nanny_raises <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 39%] 4770s tests/test_client.py::test_restart_workers_kill_timeout[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py SKIPPED [ 39%] 4770s tests/test_client.py::test_restart_workers_kill_timeout[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py SKIPPED [ 39%] 4770s tests/test_client.py::test_restart_workers_restart_timeout[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py SKIPPED [ 39%] 4770s tests/test_client.py::test_restart_workers_restart_timeout[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py SKIPPED [ 39%] 4770s tests/test_client.py::test_restart_workers_exception <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py SKIPPED [ 39%] 4770s tests/test_client.py::test_restart_workers_by_name[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py SKIPPED [ 39%] 4770s tests/test_client.py::test_restart_workers_by_name[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py SKIPPED [ 39%] 4770s tests/test_client.py::test_robust_unserializable <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 40%] 4770s tests/test_client.py::test_robust_undeserializable <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 40%] 4770s tests/test_client.py::test_robust_undeserializable_function <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 40%] 4771s tests/test_client.py::test_fire_and_forget <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 40%] 4771s tests/test_client.py::test_fire_and_forget_err <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 40%] 4771s tests/test_client.py::test_close <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 40%] 4775s tests/test_client.py::test_threadsafe <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 40%] 4775s tests/test_client.py::test_threadsafe_get <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py SKIPPED [ 40%] 4775s tests/test_client.py::test_threadsafe_compute <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py SKIPPED [ 40%] 4775s tests/test_client.py::test_identity <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 40%] 4776s tests/test_client.py::test_get_client <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 40%] 4776s tests/test_client.py::test_get_client_no_cluster <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 40%] 4776s tests/test_client.py::test_serialize_collections <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 40%] 4776s tests/test_client.py::test_secede_simple <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 40%] 4777s tests/test_client.py::test_secede_balances <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 40%] 4777s tests/test_client.py::test_long_running_not_in_occupancy[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 40%] 4777s tests/test_client.py::test_long_running_not_in_occupancy[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 40%] 4777s tests/test_client.py::test_long_running_removal_clean[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 40%] 4777s tests/test_client.py::test_long_running_removal_clean[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 40%] 4778s tests/test_client.py::test_sub_submit_priority <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 40%] 4780s tests/test_client.py::test_get_client_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 40%] 4781s tests/test_client.py::test_serialize_collections_of_futures <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 40%] 4783s tests/test_client.py::test_serialize_collections_of_futures_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 40%] 4787s tests/test_client.py::test_dynamic_workloads_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 40%] 4787s tests/test_client.py::test_dynamic_workloads_sync_random <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py SKIPPED [ 40%] 4787s tests/test_client.py::test_bytes_keys <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 40%] 4788s tests/test_client.py::test_unicode_ascii_keys <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 40%] 4788s tests/test_client.py::test_unicode_keys <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 40%] 4790s tests/test_client.py::test_use_synchronous_client_in_async_context <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 40%] 4793s tests/test_client.py::test_quiet_quit_when_cluster_leaves <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 40%] 4793s tests/test_client.py::test_call_stack_future <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 40%] 4794s tests/test_client.py::test_call_stack_all <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 40%] 4796s tests/test_client.py::test_call_stack_collections <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 40%] 4798s tests/test_client.py::test_call_stack_collections_all <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 41%] 4798s tests/test_client.py::test_profile <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 41%] 4799s tests/test_client.py::test_profile_disabled <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 41%] 4800s tests/test_client.py::test_profile_keys <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 41%] 4800s tests/test_client.py::test_client_with_name <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 41%] 4800s tests/test_client.py::test_client_async_before_loop_starts <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 41%] 4800s tests/test_client.py::test_nested_compute <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py SKIPPED [ 41%] 4801s tests/test_client.py::test_task_metadata <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 41%] 4803s tests/test_client.py::test_logs <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 41%] 4804s tests/test_client.py::test_logs_from_worker_submodules <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 41%] 4804s tests/test_client.py::test_avoid_delayed_finalize <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 41%] 4805s tests/test_client.py::test_config_scheduler_address <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 41%] 4805s tests/test_client.py::test_warn_when_submitting_large_values <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 41%] 4805s tests/test_client.py::test_warn_when_submitting_large_values_memoryview <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 41%] 4805s tests/test_client.py::test_unhashable_function <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 41%] 4806s tests/test_client.py::test_client_name <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 41%] 4808s tests/test_client.py::test_client_doesnt_close_given_loop <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 41%] 4808s tests/test_client.py::test_quiet_scheduler_loss <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py SKIPPED [ 41%] 4810s tests/test_client.py::test_dashboard_link <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 41%] 4810s tests/test_client.py::test_client_timeout_2 <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 41%] 4810s tests/test_client.py::test_turn_off_pickle[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 41%] 4810s tests/test_client.py::test_turn_off_pickle[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 41%] 4810s tests/test_client.py::test_de_serialization <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 41%] 4810s tests/test_client.py::test_de_serialization_none <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 41%] 4811s tests/test_client.py::test_client_repr_closed <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 41%] 4811s tests/test_client.py::test_client_repr_closed_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py SKIPPED [ 41%] 4811s tests/test_client.py::test_nested_prioritization <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py XPASS [ 41%] 4811s tests/test_client.py::test_scatter_error_cancel <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 41%] 4812s tests/test_client.py::test_scatter_and_replicate_avoid_paused_workers[False-False-False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 41%] 4812s tests/test_client.py::test_scatter_and_replicate_avoid_paused_workers[False-False-True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 41%] 4813s tests/test_client.py::test_scatter_and_replicate_avoid_paused_workers[False-True-False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 41%] 4814s tests/test_client.py::test_scatter_and_replicate_avoid_paused_workers[False-True-True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 41%] 4814s tests/test_client.py::test_scatter_and_replicate_avoid_paused_workers[True-False-False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 42%] 4815s tests/test_client.py::test_scatter_and_replicate_avoid_paused_workers[True-False-True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 42%] 4815s tests/test_client.py::test_scatter_and_replicate_avoid_paused_workers[True-True-False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 42%] 4816s tests/test_client.py::test_scatter_and_replicate_avoid_paused_workers[True-True-True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 42%] 4816s tests/test_client.py::test_scatter_and_replicate_avoid_paused_workers[10-False-False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 42%] 4817s tests/test_client.py::test_scatter_and_replicate_avoid_paused_workers[10-False-True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 42%] 4818s tests/test_client.py::test_scatter_and_replicate_avoid_paused_workers[10-True-False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 42%] 4819s tests/test_client.py::test_scatter_and_replicate_avoid_paused_workers[10-True-True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 42%] 4819s tests/test_client.py::test_no_threads_lingering <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py XPASS [ 42%] 4819s tests/test_client.py::test_direct_async <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 42%] 4821s tests/test_client.py::test_direct_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 42%] 4821s tests/test_client.py::test_mixing_clients_same_scheduler <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 42%] 4822s tests/test_client.py::test_tuple_keys <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 42%] 4822s tests/test_client.py::test_multiple_scatter <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 42%] 4822s tests/test_client.py::test_map_large_kwargs_in_graph <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 42%] 4822s tests/test_client.py::test_retry <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 42%] 4823s tests/test_client.py::test_retry_dependencies <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 42%] 4823s tests/test_client.py::test_released_dependencies <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 42%] 4823s tests/test_client.py::test_profile_bokeh <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py SKIPPED [ 42%] 4824s tests/test_client.py::test_get_mix_futures_and_SubgraphCallable <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 42%] 4824s tests/test_client.py::test_get_mix_futures_and_SubgraphCallable_dask_dataframe <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 42%] 4826s tests/test_client.py::test_direct_to_workers <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 42%] 4827s tests/test_client.py::test_instances <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 42%] 4827s tests/test_client.py::test_wait_for_workers <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 42%] 4829s tests/test_client.py::test_config_inherited_by_subprocess <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 42%] 4830s tests/test_client.py::test_futures_of_sorted <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 42%] 4832s tests/test_client.py::test_profile_server <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 42%] 4833s tests/test_client.py::test_profile_server_disabled <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 42%] 4834s tests/test_client.py::test_await_future <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 42%] 4834s tests/test_client.py::test_as_completed_async_for <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 42%] 4834s tests/test_client.py::test_as_completed_async_for_results <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 42%] 4834s tests/test_client.py::test_as_completed_async_for_cancel <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 42%] 4836s tests/test_client.py::test_client_sync_with_async_def <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 43%] 4836s tests/test_client.py::test_dont_hold_on_to_large_messages <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py SKIPPED [ 43%] 4836s tests/test_client.py::test_run_on_scheduler_async_def <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 43%] 4837s tests/test_client.py::test_run_on_scheduler_async_def_wait <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 43%] 4837s tests/test_client.py::test_performance_report[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py SKIPPED [ 43%] 4837s tests/test_client.py::test_performance_report[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py SKIPPED [ 43%] 4837s tests/test_client.py::test_as_completed_condition_loop <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 43%] 4837s tests/test_client.py::test_mixed_compression <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py SKIPPED [ 43%] 4840s tests/test_client.py::test_futures_in_subgraphs <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 43%] 4840s tests/test_client.py::test_get_task_metadata <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 43%] 4840s tests/test_client.py::test_get_task_metadata_multiple <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 43%] 4840s tests/test_client.py::test_register_worker_plugin_instance_required <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 43%] 4840s tests/test_client.py::test_register_worker_plugin_exception <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 43%] 4841s tests/test_client.py::test_annotations_task_state <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 43%] 4841s tests/test_client.py::test_annotations_compute_time[compute] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 43%] 4841s tests/test_client.py::test_annotations_compute_time[persist] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 43%] 4841s tests/test_client.py::test_annotations_survive_optimization <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py XFAIL [ 43%] 4842s tests/test_client.py::test_annotations_priorities <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 43%] 4842s tests/test_client.py::test_annotations_workers <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 43%] 4842s tests/test_client.py::test_annotations_retries <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 43%] 4842s tests/test_client.py::test_annotations_blockwise_unpack <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 43%] 4842s tests/test_client.py::test_annotations_resources <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 43%] 4843s tests/test_client.py::test_annotations_resources_culled <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 43%] 4843s tests/test_client.py::test_annotations_loose_restrictions <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 43%] 4843s tests/test_client.py::test_annotations_submit_map <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 43%] 4843s tests/test_client.py::test_annotations_global_vs_local <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 43%] 4844s tests/test_client.py::test_workers_collection_restriction <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 43%] 4844s tests/test_client.py::test_get_client_functions_spawn_clusters <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py SKIPPED [ 43%] 4844s tests/test_client.py::test_computation_code_walk_frames <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 43%] 4844s tests/test_client.py::test_computation_ignore_ipython_frames[2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py SKIPPED [ 43%] 4844s tests/test_client.py::test_computation_ignore_ipython_frames[3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py SKIPPED [ 43%] 4844s tests/test_client.py::test_computation_store_annotations <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 43%] 4846s tests/test_client.py::test_computation_object_code_dask_compute <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 43%] 4848s tests/test_client.py::test_computation_object_code_dask_compute_no_frames_default <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 44%] 4851s tests/test_client.py::test_computation_object_code_not_available <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py SKIPPED [ 44%] 4851s tests/test_client.py::test_computation_object_code_dask_persist <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 44%] 4851s tests/test_client.py::test_computation_object_code_client_submit_simple <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 44%] 4851s tests/test_client.py::test_computation_object_code_client_submit_list_comp <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 44%] 4852s tests/test_client.py::test_computation_object_code_client_submit_dict_comp <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 44%] 4852s tests/test_client.py::test_computation_object_code_client_map <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 44%] 4852s tests/test_client.py::test_computation_object_code_client_compute <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 44%] 4852s tests/test_client.py::test_upload_directory <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py SKIPPED [ 44%] 4852s tests/test_client.py::test_duck_typed_register_plugin_raises <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 44%] 4853s tests/test_client.py::test_exception_text <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 44%] 4853s tests/test_client.py::test_async_task <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 44%] 4853s tests/test_client.py::test_async_task_with_partial <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 44%] 4853s tests/test_client.py::test_warn_manual <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 44%] 4854s tests/test_client.py::test_warn_remote <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 44%] 4855s tests/test_client.py::test_print_remote <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 44%] 4857s tests/test_client.py::test_print_manual <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 44%] 4859s tests/test_client.py::test_print_manual_bad_args <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 44%] 4861s tests/test_client.py::test_print_non_msgpack_serializable <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 44%] 4861s tests/test_client.py::test_print_local <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 44%] 4862s tests/test_client.py::test_forward_logging <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 44%] 4865s tests/test_client.py::test_dump_cluster_state_write_from_scheduler <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 44%] 4867s tests/test_client.py::test_dump_cluster_state_sync[msgpack-True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 44%] 4869s tests/test_client.py::test_dump_cluster_state_sync[msgpack-False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 44%] 4873s tests/test_client.py::test_dump_cluster_state_sync[yaml-True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 44%] 4876s tests/test_client.py::test_dump_cluster_state_sync[yaml-False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 44%] 4876s tests/test_client.py::test_dump_cluster_state_async[msgpack-True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 44%] 4877s tests/test_client.py::test_dump_cluster_state_async[msgpack-False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 44%] 4877s tests/test_client.py::test_dump_cluster_state_async[yaml-True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 44%] 4878s tests/test_client.py::test_dump_cluster_state_async[yaml-False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 44%] 4878s tests/test_client.py::test_dump_cluster_state_json[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 44%] 4878s tests/test_client.py::test_dump_cluster_state_json[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 44%] 4880s tests/test_client.py::test_dump_cluster_state_exclude_default <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 45%] 4880s tests/test_client.py::test_benchmark_hardware_no_workers <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 45%] 4880s tests/test_client.py::test_wait_for_workers_updates_info <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 45%] 4880s tests/test_client.py::test_quiet_close_process[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py SKIPPED [ 45%] 4880s tests/test_client.py::test_quiet_close_process[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py SKIPPED [ 45%] 4880s tests/test_client.py::test_deprecated_loop_properties <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 45%] 4880s tests/test_client.py::test_fast_close_on_aexit_failure <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 45%] 4881s tests/test_client.py::test_wait_for_workers_n_workers_value_check[None-ValueError] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 45%] 4881s tests/test_client.py::test_wait_for_workers_n_workers_value_check[0-ValueError] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 45%] 4881s tests/test_client.py::test_wait_for_workers_n_workers_value_check[1.0-ValueError] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 45%] 4881s tests/test_client.py::test_wait_for_workers_n_workers_value_check[1-None] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 45%] 4881s tests/test_client.py::test_wait_for_workers_n_workers_value_check[2-None] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 45%] 4882s tests/test_client.py::test_unpacks_remotedata_namedtuple[PlainNamedTuple-args0-kwargs0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 45%] 4882s tests/test_client.py::test_unpacks_remotedata_namedtuple[NewArgsNamedTuple-args1-kwargs1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 45%] 4882s tests/test_client.py::test_unpacks_remotedata_namedtuple[NewArgsExNamedTuple-args2-kwargs2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 45%] 4882s tests/test_client.py::test_resolves_future_in_namedtuple[PlainNamedTuple-args0-kwargs0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 45%] 4882s tests/test_client.py::test_resolves_future_in_namedtuple[NewArgsNamedTuple-args1-kwargs1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 45%] 4883s tests/test_client.py::test_resolves_future_in_namedtuple[NewArgsExNamedTuple-args2-kwargs2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 45%] 4883s tests/test_client.py::test_resolves_future_in_dict <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 45%] 4883s tests/test_client.py::test_gather_race_vs_AMM[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 45%] 4884s tests/test_client.py::test_gather_race_vs_AMM[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 45%] 4886s tests/test_client.py::test_client_disconnect_exception_on_cancelled_futures <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 45%] 4886s tests/test_client.py::test_scheduler_restart_exception_on_cancelled_futures <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py SKIPPED [ 45%] 4886s tests/test_client.py::test_release_persisted_collection <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 45%] 4888s tests/test_client.py::test_release_persisted_collection_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 45%] 4888s tests/test_client.py::test_worker_clients_do_not_claim_ownership_of_serialize_futures[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py SKIPPED [ 45%] 4888s tests/test_client.py::test_worker_clients_do_not_claim_ownership_of_serialize_futures[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py SKIPPED [ 45%] 4891s tests/test_client_executor.py::test_submit <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client_executor.py PASSED [ 45%] 4893s tests/test_client_executor.py::test_as_completed <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client_executor.py PASSED [ 45%] 4895s tests/test_client_executor.py::test_wait <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client_executor.py PASSED [ 45%] 4897s tests/test_client_executor.py::test_cancellation <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client_executor.py PASSED [ 45%] 4900s tests/test_client_executor.py::test_cancellation_wait <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client_executor.py PASSED [ 45%] 4903s tests/test_client_executor.py::test_cancellation_as_completed <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client_executor.py PASSED [ 46%] 4903s tests/test_client_executor.py::test_map <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client_executor.py SKIPPED [ 46%] 4905s tests/test_client_executor.py::test_pure <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client_executor.py PASSED [ 46%] 4907s tests/test_client_executor.py::test_workers <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client_executor.py PASSED [ 46%] 4910s tests/test_client_executor.py::test_unsupported_arguments <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client_executor.py PASSED [ 46%] 4912s tests/test_client_executor.py::test_retries <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client_executor.py PASSED [ 46%] 4916s tests/test_client_executor.py::test_shutdown_wait <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client_executor.py PASSED [ 46%] 4918s tests/test_client_executor.py::test_shutdown_nowait <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client_executor.py PASSED [ 46%] 4918s tests/test_cluster_dump.py::test_tuple_to_list[input0-expected0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cluster_dump.py PASSED [ 46%] 4918s tests/test_cluster_dump.py::test_tuple_to_list[input1-expected1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cluster_dump.py PASSED [ 46%] 4918s tests/test_cluster_dump.py::test_tuple_to_list[input2-expected2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cluster_dump.py PASSED [ 46%] 4918s tests/test_cluster_dump.py::test_tuple_to_list[foo-foo] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cluster_dump.py PASSED [ 46%] 4918s tests/test_cluster_dump.py::test_write_state_msgpack <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cluster_dump.py PASSED [ 46%] 4919s tests/test_cluster_dump.py::test_write_state_yaml <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cluster_dump.py PASSED [ 46%] 4919s tests/test_cluster_dump.py::test_cluster_dump_state <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cluster_dump.py PASSED [ 46%] 4919s tests/test_cluster_dump.py::test_cluster_dump_story <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cluster_dump.py PASSED [ 46%] 4920s tests/test_cluster_dump.py::test_cluster_dump_to_yamls <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cluster_dump.py PASSED [ 46%] 4920s tests/test_collections.py::test_lru <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_collections.py PASSED [ 46%] 4920s tests/test_collections.py::test_heapset <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_collections.py PASSED [ 46%] 4920s tests/test_collections.py::test_heapset_sorted_flag_left <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_collections.py PASSED [ 46%] 4920s tests/test_collections.py::test_heapset_sorted_flag_right <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_collections.py PASSED [ 46%] 4920s tests/test_collections.py::test_heapset_popright[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_collections.py PASSED [ 46%] 4920s tests/test_collections.py::test_heapset_popright[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_collections.py PASSED [ 46%] 4920s tests/test_collections.py::test_heapset_pickle <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_collections.py PASSED [ 46%] 4920s tests/test_collections.py::test_heapset_sort_duplicate <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_collections.py PASSED [ 46%] 4920s tests/test_collections.py::test_sum_mappings <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_collections.py PASSED [ 46%] 4920s tests/test_compatibility.py::test_randbytes <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_compatibility.py PASSED [ 46%] 4920s tests/test_compatibility.py::test_randbytes_seed <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_compatibility.py PASSED [ 46%] 4920s tests/test_computations.py::test_computations <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_computations.py PASSED [ 46%] 4920s tests/test_computations.py::test_computations_futures <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_computations.py PASSED [ 46%] 4920s tests/test_computations.py::test_computations_no_workers <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_computations.py PASSED [ 46%] 4921s tests/test_computations.py::test_computations_no_resources <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_computations.py PASSED [ 46%] 4921s tests/test_computations.py::test_computations_long_running <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_computations.py PASSED [ 46%] 4921s tests/test_config.py::test_logging_default[config0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_config.py PASSED [ 47%] 4921s tests/test_config.py::test_logging_default[None] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_config.py PASSED [ 47%] 4922s tests/test_config.py::test_logging_simple_under_distributed <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_config.py PASSED [ 47%] 4923s tests/test_config.py::test_logging_simple <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_config.py PASSED [ 47%] 4924s tests/test_config.py::test_logging_extended <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_config.py PASSED [ 47%] 4925s tests/test_config.py::test_default_logging_does_not_override_basic_config <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_config.py PASSED [ 47%] 4926s tests/test_config.py::test_basic_config_does_not_override_default_logging <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_config.py PASSED [ 47%] 4926s tests/test_config.py::test_logging_mutual_exclusive <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_config.py PASSED [ 47%] 4926s tests/test_config.py::test_logging_file_config <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_config.py PASSED [ 47%] 4927s tests/test_config.py::test_schema <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_config.py PASSED [ 47%] 4927s tests/test_config.py::test_schema_is_complete <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_config.py PASSED [ 47%] 4927s tests/test_config.py::test_uvloop_event_loop <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_config.py SKIPPED [ 47%] 4927s tests/test_config.py::test_deprecations_on_set[args0-kwargs0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_config.py PASSED [ 47%] 4927s tests/test_config.py::test_deprecations_on_set[args1-kwargs1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_config.py PASSED [ 47%] 4927s tests/test_config.py::test_deprecations_on_set[args2-kwargs2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_config.py PASSED [ 47%] 4927s tests/test_config.py::test_deprecations_on_env_variables <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_config.py PASSED [ 47%] 4927s tests/test_config.py::test_deprecations_on_yaml[allowed-failures] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_config.py PASSED [ 47%] 4927s tests/test_config.py::test_deprecations_on_yaml[allowed_failures] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_config.py PASSED [ 47%] 4927s tests/test_core.py::test_rpc_inputs <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_core.py PASSED [ 47%] 4927s tests/test_core.py::test_large_packets_tcp <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_core.py SKIPPED [ 47%] 4927s tests/test_core.py::test_connect_raises <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_core.py PASSED [ 47%] 4927s tests/test_core.py::test_coerce_to_address <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_core.py PASSED [ 47%] 4927s tests/test_core.py::test_remove_cancels_connect_attempts <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_core.py PASSED [ 47%] 4927s tests/test_core.py::test_remove_cancels_connect_before_task_running <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_core.py PASSED [ 47%] 4927s tests/test_core.py::test_ticks <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_core.py SKIPPED [ 47%] 4928s tests/test_core.py::test_tick_logging <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_core.py SKIPPED [ 47%] 4928s tests/test_core.py::test_rpc_closed_exception <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_core.py PASSED [ 47%] 4928s tests/test_core.py::test_thread_id <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_core.py PASSED [ 47%] 4928s tests/test_core.py::test_expects_comm <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_core.py PASSED [ 47%] 4928s tests/test_core.py::test_async_listener_stop <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_core.py PASSED [ 47%] 4928s tests/test_core.py::test_large_payload <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_core.py SKIPPED [ 47%] 4928s tests/test_counter.py::test_digest[Counter-] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_counter.py PASSED [ 47%] 4928s tests/test_counter.py::test_digest[None-] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_counter.py SKIPPED [ 48%] 4928s tests/test_counter.py::test_counter <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_counter.py PASSED [ 48%] 4929s tests/test_dask_collections.py::test_dataframes <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_dask_collections.py PASSED [ 48%] 4930s tests/test_dask_collections.py::test_dask_array_collections <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_dask_collections.py PASSED [ 48%] 4930s tests/test_dask_collections.py::test_bag_groupby_tasks_default <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_dask_collections.py PASSED [ 48%] 4932s tests/test_dask_collections.py::test_bag_groupby_key_hashing <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_dask_collections.py PASSED [ 48%] 4936s tests/test_dask_collections.py::test_dataframe_set_index_sync[wait] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_dask_collections.py PASSED [ 48%] 4939s tests/test_dask_collections.py::test_dataframe_set_index_sync[] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_dask_collections.py PASSED [ 48%] 4942s tests/test_dask_collections.py::test_loc_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_dask_collections.py PASSED [ 48%] 4945s tests/test_dask_collections.py::test_rolling_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_dask_collections.py PASSED [ 48%] 4945s tests/test_dask_collections.py::test_loc <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_dask_collections.py PASSED [ 48%] 4950s tests/test_dask_collections.py::test_dataframe_groupby_tasks <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_dask_collections.py PASSED [ 48%] 4950s tests/test_dask_collections.py::test_sparse_arrays <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_dask_collections.py SKIPPED [ 48%] 4950s tests/test_dask_collections.py::test_delayed_none <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_dask_collections.py PASSED [ 48%] 4953s tests/test_dask_collections.py::test_tuple_futures_arg[tuple] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_dask_collections.py PASSED [ 48%] 4956s tests/test_dask_collections.py::test_tuple_futures_arg[list] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_dask_collections.py PASSED [ 48%] 4956s tests/test_deadline.py::test_deadline <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_deadline.py PASSED [ 48%] 4956s tests/test_deadline.py::test_infinite_deadline <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_deadline.py PASSED [ 48%] 4956s tests/test_deadline.py::test_deadline_progress <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_deadline.py PASSED [ 48%] 4957s tests/test_deadline.py::test_deadline_expiration <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_deadline.py PASSED [ 48%] 4957s tests/test_deadline.py::test_deadline_expiration_async <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_deadline.py PASSED [ 48%] 4958s tests/test_diskutils.py::test_workdir_simple <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_diskutils.py PASSED [ 48%] 4960s tests/test_diskutils.py::test_two_workspaces_in_same_directory <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_diskutils.py PASSED [ 48%] 4961s tests/test_diskutils.py::test_workspace_process_crash <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_diskutils.py PASSED [ 48%] 4961s tests/test_diskutils.py::test_workspace_rmtree_failure <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_diskutils.py PASSED [ 48%] 4962s tests/test_diskutils.py::test_locking_disabled <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_diskutils.py PASSED [ 48%] 4962s tests/test_diskutils.py::test_workspace_concurrency <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_diskutils.py SKIPPED [ 48%] 4962s tests/test_diskutils.py::test_unwritable_base_dir <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_diskutils.py PASSED [ 48%] 4962s tests/test_event_logging.py::test_log_event <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_event_logging.py PASSED [ 48%] 4962s tests/test_event_logging.py::test_log_events <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_event_logging.py PASSED [ 48%] 4962s tests/test_event_logging.py::test_log_event_e2e <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_event_logging.py PASSED [ 48%] 4963s tests/test_event_logging.py::test_log_event_multiple_clients <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_event_logging.py PASSED [ 48%] 4963s tests/test_event_logging.py::test_events_subscribe_topic <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_event_logging.py PASSED [ 49%] 4963s tests/test_event_logging.py::test_events_subscribe_topic_cancelled <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_event_logging.py PASSED [ 49%] 4963s tests/test_event_logging.py::test_topic_subscribe_unsubscribe <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_event_logging.py PASSED [ 49%] 4965s tests/test_event_logging.py::test_events_all_servers_use_same_channel <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_event_logging.py PASSED [ 49%] 4965s tests/test_event_logging.py::test_events_unsubscribe_raises_if_unknown <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_event_logging.py PASSED [ 49%] 4968s tests/test_event_logging.py::test_log_event_msgpack <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_event_logging.py PASSED [ 49%] 4968s tests/test_event_logging.py::test_configurable_events_log_length <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_event_logging.py PASSED [ 49%] 4970s tests/test_event_logging.py::test_log_event_on_nanny <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_event_logging.py PASSED [ 49%] 4970s tests/test_event_logging.py::test_log_event_on_worker <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_event_logging.py PASSED [ 49%] 4970s tests/test_event_logging.py::test_log_event_plugin <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_event_logging.py PASSED [ 49%] 4970s tests/test_event_logging.py::test_log_event_plugin_multiple_topics <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_event_logging.py PASSED [ 49%] 4971s tests/test_events.py::test_event_on_workers <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_events.py PASSED [ 49%] 4971s tests/test_events.py::test_default_event <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_events.py PASSED [ 49%] 4971s tests/test_events.py::test_set_not_set <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_events.py PASSED [ 49%] 4972s tests/test_events.py::test_set_not_set_many_events <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_events.py PASSED [ 49%] 4972s tests/test_events.py::test_timeout <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_events.py PASSED [ 49%] 4975s tests/test_events.py::test_event_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_events.py PASSED [ 49%] 4975s tests/test_events.py::test_event_types <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_events.py PASSED [ 49%] 4975s tests/test_events.py::test_serializable <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_events.py PASSED [ 49%] 4976s tests/test_events.py::test_two_events_on_workers <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_events.py PASSED [ 49%] 4976s tests/test_events.py::test_unpickle_without_client <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_events.py PASSED [ 49%] 4976s tests/test_failed_workers.py::test_submit_after_failed_worker_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_failed_workers.py SKIPPED [ 49%] 4976s tests/test_failed_workers.py::test_submit_after_failed_worker_async[False-False-closing] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_failed_workers.py PASSED [ 49%] 4977s tests/test_failed_workers.py::test_submit_after_failed_worker_async[False-False-closed] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_failed_workers.py PASSED [ 49%] 4977s tests/test_failed_workers.py::test_submit_after_failed_worker_async[False-True-closing] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_failed_workers.py PASSED [ 49%] 4977s tests/test_failed_workers.py::test_submit_after_failed_worker_async[False-True-closed] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_failed_workers.py PASSED [ 49%] 4977s tests/test_failed_workers.py::test_submit_after_failed_worker_async[True-False-closing] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_failed_workers.py PASSED [ 49%] 4978s tests/test_failed_workers.py::test_submit_after_failed_worker_async[True-False-closed] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_failed_workers.py PASSED [ 49%] 4978s tests/test_failed_workers.py::test_submit_after_failed_worker_async[True-True-closing] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_failed_workers.py PASSED [ 49%] 4978s tests/test_failed_workers.py::test_submit_after_failed_worker_async[True-True-closed] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_failed_workers.py PASSED [ 49%] 4979s tests/test_failed_workers.py::test_submit_after_failed_worker <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_failed_workers.py PASSED [ 49%] 4979s tests/test_failed_workers.py::test_gather_after_failed_worker <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_failed_workers.py SKIPPED [ 49%] 4979s tests/test_failed_workers.py::test_gather_then_submit_after_failed_workers <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_failed_workers.py SKIPPED [ 50%] 4983s tests/test_failed_workers.py::test_restart <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_failed_workers.py PASSED [ 50%] 4986s tests/test_failed_workers.py::test_restart_cleared <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_failed_workers.py PASSED [ 50%] 4992s tests/test_failed_workers.py::test_restart_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_failed_workers.py PASSED [ 50%] 4999s tests/test_failed_workers.py::test_worker_doesnt_await_task_completion <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_failed_workers.py PASSED [ 50%] 5004s tests/test_failed_workers.py::test_multiple_clients_restart <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_failed_workers.py PASSED [ 50%] 5008s tests/test_failed_workers.py::test_restart_scheduler <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_failed_workers.py PASSED [ 50%] 5012s tests/test_failed_workers.py::test_forgotten_futures_dont_clean_up_new_futures <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_failed_workers.py PASSED [ 50%] 5012s tests/test_failed_workers.py::test_broken_worker_during_computation <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_failed_workers.py SKIPPED [ 50%] 5016s tests/test_failed_workers.py::test_restart_during_computation <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_failed_workers.py PASSED [ 50%] 5016s tests/test_failed_workers.py::test_worker_who_has_clears_after_failed_connection <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_failed_workers.py SKIPPED [ 50%] 5017s tests/test_failed_workers.py::test_worker_same_host_replicas_missing <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_failed_workers.py PASSED [ 50%] 5017s tests/test_failed_workers.py::test_restart_timeout_on_long_running_task <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_failed_workers.py SKIPPED [ 50%] 5017s tests/test_failed_workers.py::test_worker_time_to_live <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_failed_workers.py SKIPPED [ 50%] 5017s tests/test_failed_workers.py::test_worker_ttl_restarts_worker[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_failed_workers.py SKIPPED [ 50%] 5017s tests/test_failed_workers.py::test_worker_ttl_restarts_worker[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_failed_workers.py SKIPPED [ 50%] 5017s tests/test_failed_workers.py::test_restart_hung_worker <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_failed_workers.py SKIPPED [ 50%] 5017s tests/test_failed_workers.py::test_forget_data_not_supposed_to_have <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_failed_workers.py PASSED [ 50%] 5020s tests/test_failed_workers.py::test_failing_worker_with_additional_replicas_on_cluster <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_failed_workers.py PASSED [ 50%] 5020s tests/test_gc.py::test_fractional_timer <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_gc.py PASSED [ 50%] 5035s tests/test_gc.py::test_gc_diagnosis_cpu_time <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_gc.py PASSED [ 50%] 5039s tests/test_gc.py::test_gc_diagnosis_rss_win <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_gc.py XFAIL [ 50%] 5040s tests/test_imports.py::test_can_import_distributed_in_background_thread <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_imports.py PASSED [ 50%] 5040s tests/test_init.py::test_version <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_init.py PASSED [ 50%] 5040s tests/test_itertools.py::test_ffill <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_itertools.py PASSED [ 50%] 5040s tests/test_jupyter.py::test_jupyter_cli <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_jupyter.py SKIPPED [ 50%] 5041s tests/test_locks.py::test_lock <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_locks.py PASSED [ 50%] 5041s tests/test_locks.py::test_timeout <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_locks.py PASSED [ 50%] 5042s tests/test_locks.py::test_acquires_with_zero_timeout <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_locks.py PASSED [ 50%] 5042s tests/test_locks.py::test_acquires_blocking <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_locks.py PASSED [ 50%] 5044s tests/test_locks.py::test_timeout_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_locks.py PASSED [ 50%] 5047s tests/test_locks.py::test_lock_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_locks.py PASSED [ 50%] 5047s tests/test_locks.py::test_lock_types <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_locks.py PASSED [ 50%] 5047s tests/test_locks.py::test_serializable <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_locks.py PASSED [ 51%] 5048s tests/test_locks.py::test_serializable_no_ctx <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_locks.py PASSED [ 51%] 5048s tests/test_locks.py::test_locks <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_locks.py PASSED [ 51%] 5048s tests/test_locks.py::test_locks_inf_lease_timeout <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_locks.py PASSED [ 51%] 5048s tests/test_metrics.py::test_wall_clock[time] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_metrics.py PASSED [ 51%] 5048s tests/test_metrics.py::test_wall_clock[monotonic] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_metrics.py PASSED [ 51%] 5048s tests/test_metrics.py::test_monotonic <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_metrics.py SKIPPED [ 51%] 5048s tests/test_metrics.py::test_meter <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_metrics.py PASSED [ 51%] 5048s tests/test_metrics.py::test_meter_raise <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_metrics.py PASSED [ 51%] 5048s tests/test_metrics.py::test_meter_floor[kwargs0-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_metrics.py PASSED [ 51%] 5048s tests/test_metrics.py::test_meter_floor[kwargs1-0.1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_metrics.py PASSED [ 51%] 5048s tests/test_metrics.py::test_meter_floor[kwargs2--1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_metrics.py PASSED [ 51%] 5048s tests/test_metrics.py::test_context_meter <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_metrics.py PASSED [ 51%] 5048s tests/test_metrics.py::test_context_meter_raise <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_metrics.py PASSED [ 51%] 5048s tests/test_metrics.py::test_context_meter_nested <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_metrics.py PASSED [ 51%] 5048s tests/test_metrics.py::test_context_meter_decorator <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_metrics.py PASSED [ 51%] 5048s tests/test_metrics.py::test_context_meter_nested_floor <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_metrics.py PASSED [ 51%] 5048s tests/test_metrics.py::test_context_meter_pickle <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_metrics.py PASSED [ 51%] 5048s tests/test_metrics.py::test_context_meter_clear_callbacks <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_metrics.py PASSED [ 51%] 5048s tests/test_metrics.py::test_context_meter_clear_callbacks_raises <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_metrics.py PASSED [ 51%] 5048s tests/test_metrics.py::test_context_meter_allow_offload <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_metrics.py PASSED [ 51%] 5048s tests/test_metrics.py::test_delayed_metrics_ledger <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_metrics.py PASSED [ 51%] 5048s tests/test_metrics.py::test_context_meter_keyed <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_metrics.py PASSED [ 51%] 5048s tests/test_metrics.py::test_delayed_metrics_ledger_keyed <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_metrics.py PASSED [ 51%] 5049s tests/test_multi_locks.py::test_single_lock <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_multi_locks.py PASSED [ 51%] 5050s tests/test_multi_locks.py::test_timeout <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_multi_locks.py PASSED [ 51%] 5050s tests/test_multi_locks.py::test_timeout_wake_waiter <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_multi_locks.py PASSED [ 51%] 5051s tests/test_multi_locks.py::test_multiple_locks <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_multi_locks.py PASSED [ 51%] 5052s tests/test_multi_locks.py::test_num_locks <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_multi_locks.py PASSED [ 51%] 5054s tests/test_nanny.py::test_str <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 51%] 5057s tests/test_nanny.py::test_nanny_process_failure <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 51%] 5059s tests/test_nanny.py::test_run <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 51%] 5059s tests/test_nanny.py::test_no_hang_when_scheduler_closes <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py SKIPPED [ 52%] 5059s tests/test_nanny.py::test_close_on_disconnect <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py SKIPPED [ 52%] 5061s tests/test_nanny.py::test_nanny_worker_class <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 52%] 5064s tests/test_nanny.py::test_nanny_alt_worker_class <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 52%] 5064s tests/test_nanny.py::test_nanny_death_timeout <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py SKIPPED [ 52%] 5065s tests/test_nanny.py::test_random_seed <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 52%] 5075s tests/test_nanny.py::test_num_fds <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 52%] 5079s tests/test_nanny.py::test_nanny_restart <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 52%] 5082s tests/test_nanny.py::test_nanny_restart_timeout <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 52%] 5086s tests/test_nanny.py::test_nanny_restart_timeout_stress <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 52%] 5087s tests/test_nanny.py::test_throttle_outgoing_transfers <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 52%] 5089s tests/test_nanny.py::test_scheduler_address_config <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 52%] 5089s tests/test_nanny.py::test_wait_for_scheduler <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py SKIPPED [ 52%] 5091s tests/test_nanny.py::test_environment_variable <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 52%] 5093s tests/test_nanny.py::test_environment_variable_by_config <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 52%] 5094s tests/test_nanny.py::test_environment_variable_config <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 52%] 5096s tests/test_nanny.py::test_environment_variable_pre_post_spawn <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 52%] 5098s tests/test_nanny.py::test_environment_variable_overlay <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 52%] 5100s tests/test_nanny.py::test_config_param_overlays <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 52%] 5101s tests/test_nanny.py::test_local_directory <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 52%] 5103s tests/test_nanny.py::test_unwriteable_dask_worker_space <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 52%] 5106s tests/test_nanny.py::test_mp_process_worker_no_daemon <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 52%] 5109s tests/test_nanny.py::test_mp_pool_worker_no_daemon <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 52%] 5111s tests/test_nanny.py::test_nanny_closes_cleanly <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 52%] 5111s tests/test_nanny.py::test_lifetime <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py SKIPPED [ 52%] 5115s tests/test_nanny.py::test_nanny_closes_cleanly_if_worker_is_terminated <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 52%] 5117s tests/test_nanny.py::test_config <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 52%] 5120s tests/test_nanny.py::test_nanny_port_range <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 52%] 5120s tests/test_nanny.py::test_nanny_closed_by_keyboard_interrupt[tcp] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py SKIPPED [ 52%] 5121s tests/test_nanny.py::test_nanny_closed_by_keyboard_interrupt[ucx] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py SKIPPED [ 52%] 5122s tests/test_nanny.py::test_worker_start_exception <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 52%] 5123s tests/test_nanny.py::test_worker_start_exception_while_killing <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 52%] 5124s tests/test_nanny.py::test_failure_during_worker_initialization <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 53%] 5129s tests/test_nanny.py::test_environ_plugin <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 53%] 5131s tests/test_nanny.py::test_no_unnecessary_imports_on_worker[scipy] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 53%] 5133s tests/test_nanny.py::test_no_unnecessary_imports_on_worker[pandas] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py XFAIL [ 53%] 5133s tests/test_nanny.py::test_repeated_restarts <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py SKIPPED [ 53%] 5133s tests/test_nanny.py::test_restart_memory <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py SKIPPED [ 53%] 5133s tests/test_nanny.py::test_close_joins <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py SKIPPED [ 53%] 5136s tests/test_nanny.py::test_scheduler_crash_doesnt_restart <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 53%] 5136s tests/test_nanny.py::test_malloc_trim_threshold <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py SKIPPED [ 53%] 5138s tests/test_nanny.py::test_default_client_does_not_propagate_to_subprocess <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 53%] 5140s tests/test_nanny.py::test_worker_inherits_temp_config <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 53%] 5143s tests/test_nanny.py::test_nanny_plugin_simple <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 53%] 5146s tests/test_nanny.py::test_nanny_plugin_register_during_start_success[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 53%] 5148s tests/test_nanny.py::test_nanny_plugin_register_during_start_success[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 53%] 5148s tests/test_nanny.py::test_nanny_plugin_register_during_start_failure[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 53%] 5148s tests/test_nanny.py::test_nanny_plugin_register_during_start_failure[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 53%] 5149s tests/test_nanny.py::test_nanny_plugin_register_nanny_killed[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 53%] 5151s tests/test_nanny.py::test_nanny_plugin_register_nanny_killed[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 53%] 5154s tests/test_preload.py::test_worker_preload_file <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_preload.py PASSED [ 53%] 5156s tests/test_preload.py::test_worker_preload_config <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_preload.py PASSED [ 53%] 5158s tests/test_preload.py::test_worker_preload_module <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_preload.py PASSED [ 53%] 5158s tests/test_preload.py::test_worker_preload_click <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_preload.py PASSED [ 53%] 5158s tests/test_preload.py::test_worker_preload_click_async <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_preload.py PASSED [ 53%] 5159s tests/test_preload.py::test_web_preload <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_preload.py PASSED [ 53%] 5159s tests/test_preload.py::test_scheduler_startup <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_preload.py PASSED [ 53%] 5160s tests/test_preload.py::test_scheduler_startup_nanny <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_preload.py PASSED [ 53%] 5162s tests/test_preload.py::test_web_preload_worker <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_preload.py PASSED [ 53%] 5162s tests/test_preload.py::test_client_preload_text <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_preload.py XFAIL [ 53%] 5162s tests/test_preload.py::test_client_preload_config <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_preload.py PASSED [ 53%] 5162s tests/test_preload.py::test_client_preload_click <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_preload.py XFAIL [ 53%] 5162s tests/test_preload.py::test_failure_doesnt_crash_worker <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_preload.py PASSED [ 53%] 5164s tests/test_preload.py::test_failure_doesnt_crash_nanny <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_preload.py PASSED [ 53%] 5164s tests/test_preload.py::test_failure_doesnt_crash_client <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_preload.py PASSED [ 53%] 5164s tests/test_preload.py::test_client_preload_config_click <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_preload.py PASSED [ 54%] 5165s tests/test_priorities.py::test_submit[queue on worker] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_priorities.py PASSED [ 54%] 5165s tests/test_priorities.py::test_submit[queue on scheduler] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_priorities.py PASSED [ 54%] 5165s tests/test_priorities.py::test_map[queue on worker] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_priorities.py PASSED [ 54%] 5165s tests/test_priorities.py::test_map[queue on scheduler] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_priorities.py PASSED [ 54%] 5165s tests/test_priorities.py::test_compute[queue on worker] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_priorities.py PASSED [ 54%] 5166s tests/test_priorities.py::test_compute[queue on scheduler] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_priorities.py PASSED [ 54%] 5166s tests/test_priorities.py::test_persist[queue on worker] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_priorities.py PASSED [ 54%] 5166s tests/test_priorities.py::test_persist[queue on scheduler] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_priorities.py PASSED [ 54%] 5166s tests/test_priorities.py::test_annotate_compute[queue on worker] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_priorities.py PASSED [ 54%] 5167s tests/test_priorities.py::test_annotate_compute[queue on scheduler] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_priorities.py PASSED [ 54%] 5167s tests/test_priorities.py::test_annotate_persist[queue on worker] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_priorities.py PASSED [ 54%] 5167s tests/test_priorities.py::test_annotate_persist[queue on scheduler] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_priorities.py PASSED [ 54%] 5168s tests/test_priorities.py::test_repeated_persists_same_priority[queue on worker] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_priorities.py PASSED [ 54%] 5168s tests/test_priorities.py::test_repeated_persists_same_priority[queue on scheduler] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_priorities.py PASSED [ 54%] 5169s tests/test_priorities.py::test_last_in_first_out[queue on worker] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_priorities.py PASSED [ 54%] 5169s tests/test_priorities.py::test_last_in_first_out[queue on scheduler] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_priorities.py PASSED [ 54%] 5171s tests/test_profile.py::test_basic <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py PASSED [ 54%] 5171s tests/test_profile.py::test_basic_low_level <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py SKIPPED [ 54%] 5171s tests/test_profile.py::test_merge <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py PASSED [ 54%] 5171s tests/test_profile.py::test_merge_empty <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py PASSED [ 54%] 5171s tests/test_profile.py::test_call_stack <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py PASSED [ 54%] 5171s tests/test_profile.py::test_identifier <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py PASSED [ 54%] 5172s tests/test_profile.py::test_watch <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py PASSED [ 54%] 5172s tests/test_profile.py::test_watch_requires_lock_to_run <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py PASSED [ 54%] 5172s tests/test_profile.py::test_info_frame_f_lineno[-1-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py PASSED [ 54%] 5172s tests/test_profile.py::test_info_frame_f_lineno[0-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py PASSED [ 54%] 5172s tests/test_profile.py::test_info_frame_f_lineno[1-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py PASSED [ 54%] 5172s tests/test_profile.py::test_info_frame_f_lineno[11-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py PASSED [ 54%] 5172s tests/test_profile.py::test_info_frame_f_lineno[12-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py PASSED [ 54%] 5172s tests/test_profile.py::test_info_frame_f_lineno[21-4] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py PASSED [ 54%] 5172s tests/test_profile.py::test_info_frame_f_lineno[22-4] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py PASSED [ 54%] 5172s tests/test_profile.py::test_info_frame_f_lineno[23-4] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py PASSED [ 55%] 5172s tests/test_profile.py::test_info_frame_f_lineno[24-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py PASSED [ 55%] 5172s tests/test_profile.py::test_info_frame_f_lineno[25-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py PASSED [ 55%] 5172s tests/test_profile.py::test_info_frame_f_lineno[26-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py PASSED [ 55%] 5172s tests/test_profile.py::test_info_frame_f_lineno[27-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py PASSED [ 55%] 5172s tests/test_profile.py::test_info_frame_f_lineno[100-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py PASSED [ 55%] 5172s tests/test_profile.py::test_call_stack_f_lineno[-1-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py PASSED [ 55%] 5172s tests/test_profile.py::test_call_stack_f_lineno[0-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py PASSED [ 55%] 5172s tests/test_profile.py::test_call_stack_f_lineno[1-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py PASSED [ 55%] 5172s tests/test_profile.py::test_call_stack_f_lineno[11-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py PASSED [ 55%] 5172s tests/test_profile.py::test_call_stack_f_lineno[12-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py PASSED [ 55%] 5172s tests/test_profile.py::test_call_stack_f_lineno[21-4] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py PASSED [ 55%] 5172s tests/test_profile.py::test_call_stack_f_lineno[22-4] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py PASSED [ 55%] 5172s tests/test_profile.py::test_call_stack_f_lineno[23-4] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py PASSED [ 55%] 5172s tests/test_profile.py::test_call_stack_f_lineno[24-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py PASSED [ 55%] 5172s tests/test_profile.py::test_call_stack_f_lineno[25-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py PASSED [ 55%] 5172s tests/test_profile.py::test_call_stack_f_lineno[26-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py PASSED [ 55%] 5172s tests/test_profile.py::test_call_stack_f_lineno[27-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py PASSED [ 55%] 5172s tests/test_profile.py::test_call_stack_f_lineno[100-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py PASSED [ 55%] 5172s tests/test_profile.py::test_builtin <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py PASSED [ 55%] 5173s tests/test_publish.py::test_publish_simple <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_publish.py PASSED [ 55%] 5173s tests/test_publish.py::test_publish_non_string_key <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_publish.py PASSED [ 55%] 5173s tests/test_publish.py::test_publish_roundtrip <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_publish.py PASSED [ 55%] 5173s tests/test_publish.py::test_unpublish <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_publish.py PASSED [ 55%] 5175s tests/test_publish.py::test_unpublish_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_publish.py PASSED [ 55%] 5176s tests/test_publish.py::test_publish_multiple_datasets <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_publish.py PASSED [ 55%] 5178s tests/test_publish.py::test_unpublish_multiple_datasets_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_publish.py PASSED [ 55%] 5178s tests/test_publish.py::test_publish_bag <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_publish.py PASSED [ 55%] 5180s tests/test_publish.py::test_datasets_setitem <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_publish.py PASSED [ 55%] 5183s tests/test_publish.py::test_datasets_getitem <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_publish.py PASSED [ 55%] 5185s tests/test_publish.py::test_datasets_getitem_default <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_publish.py PASSED [ 55%] 5187s tests/test_publish.py::test_datasets_delitem <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_publish.py PASSED [ 55%] 5189s tests/test_publish.py::test_datasets_keys <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_publish.py PASSED [ 56%] 5192s tests/test_publish.py::test_datasets_contains <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_publish.py PASSED [ 56%] 5194s tests/test_publish.py::test_datasets_republish <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_publish.py PASSED [ 56%] 5197s tests/test_publish.py::test_datasets_iter <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_publish.py PASSED [ 56%] 5197s tests/test_publish.py::test_datasets_async <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_publish.py PASSED [ 56%] 5197s tests/test_publish.py::test_pickle_safe <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_publish.py PASSED [ 56%] 5198s tests/test_publish.py::test_deserialize_client <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_publish.py PASSED [ 56%] 5198s tests/test_publish.py::test_publish_submit_ordering <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_publish.py PASSED [ 56%] 5199s tests/test_pubsub.py::test_speed <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_pubsub.py PASSED [ 56%] 5199s tests/test_pubsub.py::test_client <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_pubsub.py PASSED [ 56%] 5199s tests/test_pubsub.py::test_timeouts <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_pubsub.py PASSED [ 56%] 5200s tests/test_pubsub.py::test_repr <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_pubsub.py PASSED [ 56%] 5200s tests/test_pubsub.py::test_basic <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_pubsub.py XPASS [ 56%] 5200s tests/test_queues.py::test_queue <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_queues.py PASSED [ 56%] 5201s tests/test_queues.py::test_queue_with_data <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_queues.py PASSED [ 56%] 5203s tests/test_queues.py::test_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_queues.py PASSED [ 56%] 5204s tests/test_queues.py::test_hold_futures <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_queues.py PASSED [ 56%] 5204s tests/test_queues.py::test_picklability <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_queues.py PASSED [ 56%] 5206s tests/test_queues.py::test_picklability_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_queues.py PASSED [ 56%] 5206s tests/test_queues.py::test_race <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_queues.py SKIPPED [ 56%] 5207s tests/test_queues.py::test_same_futures <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_queues.py PASSED [ 56%] 5207s tests/test_queues.py::test_get_many <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_queues.py PASSED [ 56%] 5207s tests/test_queues.py::test_Future_knows_status_immediately <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_queues.py PASSED [ 56%] 5208s tests/test_queues.py::test_erred_future <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_queues.py PASSED [ 56%] 5208s tests/test_queues.py::test_close <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_queues.py PASSED [ 56%] 5209s tests/test_queues.py::test_timeout <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_queues.py PASSED [ 56%] 5209s tests/test_queues.py::test_2220 <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_queues.py PASSED [ 56%] 5209s tests/test_queues.py::test_unpickle_without_client <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_queues.py PASSED [ 56%] 5209s tests/test_queues.py::test_set_cancelled_future <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_queues.py PASSED [ 56%] 5210s tests/test_reschedule.py::test_scheduler_reschedule_warns <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_reschedule.py PASSED [ 56%] 5211s tests/test_reschedule.py::test_raise_reschedule[executing] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_reschedule.py PASSED [ 56%] 5211s tests/test_reschedule.py::test_raise_reschedule[long-running] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_reschedule.py PASSED [ 56%] 5211s tests/test_reschedule.py::test_cancelled_reschedule[executing] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_reschedule.py PASSED [ 56%] 5212s tests/test_reschedule.py::test_cancelled_reschedule[long-running] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_reschedule.py PASSED [ 57%] 5212s tests/test_reschedule.py::test_cancelled_reschedule_worker_state[executing] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_reschedule.py PASSED [ 57%] 5212s tests/test_reschedule.py::test_cancelled_reschedule_worker_state[long-running] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_reschedule.py PASSED [ 57%] 5212s tests/test_reschedule.py::test_reschedule_releases[executing] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_reschedule.py PASSED [ 57%] 5212s tests/test_reschedule.py::test_reschedule_releases[long-running] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_reschedule.py PASSED [ 57%] 5212s tests/test_reschedule.py::test_reschedule_cancelled[executing] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_reschedule.py PASSED [ 57%] 5212s tests/test_reschedule.py::test_reschedule_cancelled[long-running] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_reschedule.py PASSED [ 57%] 5212s tests/test_reschedule.py::test_reschedule_resumed[executing] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_reschedule.py PASSED [ 57%] 5212s tests/test_reschedule.py::test_reschedule_resumed[long-running] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_reschedule.py PASSED [ 57%] 5212s tests/test_resources.py::test_resource_submit <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 57%] 5212s tests/test_resources.py::test_submit_many_non_overlapping <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 57%] 5214s tests/test_resources.py::test_submit_many_non_overlapping_2 <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 57%] 5214s tests/test_resources.py::test_move <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 57%] 5215s tests/test_resources.py::test_dont_work_steal <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 57%] 5215s tests/test_resources.py::test_map <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 57%] 5215s tests/test_resources.py::test_persist <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 57%] 5215s tests/test_resources.py::test_compute <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 57%] 5216s tests/test_resources.py::test_get <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 57%] 5216s tests/test_resources.py::test_persist_multiple_collections <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 57%] 5216s tests/test_resources.py::test_resources_str <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 57%] 5217s tests/test_resources.py::test_minimum_resource <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 57%] 5217s tests/test_resources.py::test_constrained_vs_ready_priority_1[1-0-y-False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 57%] 5217s tests/test_resources.py::test_constrained_vs_ready_priority_1[1-0-y-True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 57%] 5217s tests/test_resources.py::test_constrained_vs_ready_priority_1[0-1-x-False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 57%] 5217s tests/test_resources.py::test_constrained_vs_ready_priority_1[0-1-x-True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 57%] 5217s tests/test_resources.py::test_constrained_vs_ready_priority_2[1-0-y-False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 57%] 5217s tests/test_resources.py::test_constrained_vs_ready_priority_2[1-0-y-True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 57%] 5217s tests/test_resources.py::test_constrained_vs_ready_priority_2[0-1-x-False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 57%] 5217s tests/test_resources.py::test_constrained_vs_ready_priority_2[0-1-x-True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 57%] 5217s tests/test_resources.py::test_constrained_tasks_respect_priority <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 57%] 5217s tests/test_resources.py::test_task_cancelled_and_readded_with_resources <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 57%] 5217s tests/test_resources.py::test_balance_resources <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py SKIPPED [ 57%] 5217s tests/test_resources.py::test_set_resources <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 58%] 5217s tests/test_resources.py::test_persist_collections <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 58%] 5217s tests/test_resources.py::test_dont_optimize_out <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py SKIPPED [ 58%] 5217s tests/test_resources.py::test_full_collections <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py SKIPPED [ 58%] 5220s tests/test_resources.py::test_collections_get[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py XFAIL [ 58%] 5222s tests/test_resources.py::test_collections_get[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 58%] 5222s tests/test_resources.py::test_resources_from_config <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 58%] 5222s tests/test_resources.py::test_resources_from_python_override_config <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 58%] 5222s tests/test_resources.py::test_cancelled_with_resources[executing-ExecuteSuccessEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 58%] 5222s tests/test_resources.py::test_cancelled_with_resources[executing-ExecuteFailureEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 58%] 5222s tests/test_resources.py::test_cancelled_with_resources[executing-RescheduleEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 58%] 5222s tests/test_resources.py::test_cancelled_with_resources[long-running-ExecuteSuccessEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 58%] 5222s tests/test_resources.py::test_cancelled_with_resources[long-running-ExecuteFailureEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 58%] 5222s tests/test_resources.py::test_cancelled_with_resources[long-running-RescheduleEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 58%] 5222s tests/test_resources.py::test_resumed_with_resources[executing-ExecuteSuccessEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 58%] 5222s tests/test_resources.py::test_resumed_with_resources[executing-ExecuteFailureEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 58%] 5222s tests/test_resources.py::test_resumed_with_resources[executing-RescheduleEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 58%] 5222s tests/test_resources.py::test_resumed_with_resources[long-running-ExecuteSuccessEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 58%] 5222s tests/test_resources.py::test_resumed_with_resources[long-running-ExecuteFailureEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 58%] 5222s tests/test_resources.py::test_resumed_with_resources[long-running-RescheduleEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 58%] 5222s tests/test_resources.py::test_resumed_with_different_resources[executing-ExecuteSuccessEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 58%] 5222s tests/test_resources.py::test_resumed_with_different_resources[executing-ExecuteFailureEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 58%] 5222s tests/test_resources.py::test_resumed_with_different_resources[executing-RescheduleEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 58%] 5222s tests/test_resources.py::test_resumed_with_different_resources[long-running-ExecuteSuccessEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 58%] 5222s tests/test_resources.py::test_resumed_with_different_resources[long-running-ExecuteFailureEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 58%] 5222s tests/test_resources.py::test_resumed_with_different_resources[long-running-RescheduleEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 58%] 5223s tests/test_scheduler.py::test_administration <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 58%] 5223s tests/test_scheduler.py::test_respect_data_in_memory <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 58%] 5223s tests/test_scheduler.py::test_recompute_released_results <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 58%] 5223s tests/test_scheduler.py::test_decide_worker_with_many_independent_leaves <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 58%] 5224s tests/test_scheduler.py::test_decide_worker_with_restrictions <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 58%] 5225s tests/test_scheduler.py::test_decide_worker_coschedule_order_neighbors[nthreads0-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 58%] 5226s tests/test_scheduler.py::test_decide_worker_coschedule_order_neighbors[nthreads0-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 59%] 5227s tests/test_scheduler.py::test_decide_worker_coschedule_order_neighbors[nthreads0-4] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 59%] 5228s tests/test_scheduler.py::test_decide_worker_coschedule_order_neighbors[nthreads1-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 59%] 5229s tests/test_scheduler.py::test_decide_worker_coschedule_order_neighbors[nthreads1-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 59%] 5230s tests/test_scheduler.py::test_decide_worker_coschedule_order_neighbors[nthreads1-4] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 59%] 5230s tests/test_scheduler.py::test_decide_worker_rootish_while_last_worker_is_retiring <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py SKIPPED [ 59%] 5231s tests/test_scheduler.py::test_graph_execution_width <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 59%] 5234s tests/test_scheduler.py::test_forget_tasks_while_processing <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 59%] 5234s tests/test_scheduler.py::test_restart_while_processing <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py SKIPPED [ 59%] 5234s tests/test_scheduler.py::test_queued_release_multiple_workers <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 59%] 5235s tests/test_scheduler.py::test_queued_paused_new_worker <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 59%] 5235s tests/test_scheduler.py::test_queued_paused_unpaused[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 59%] 5236s tests/test_scheduler.py::test_queued_paused_unpaused[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 59%] 5236s tests/test_scheduler.py::test_queued_remove_add_worker <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 59%] 5236s tests/test_scheduler.py::test_secede_opens_slot <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 59%] 5237s tests/test_scheduler.py::test_saturation_factor[2.5-expected_task_counts0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 59%] 5238s tests/test_scheduler.py::test_saturation_factor[2.0-expected_task_counts1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 59%] 5238s tests/test_scheduler.py::test_saturation_factor[1.1-expected_task_counts2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 59%] 5239s tests/test_scheduler.py::test_saturation_factor[1.0-expected_task_counts3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 59%] 5239s tests/test_scheduler.py::test_saturation_factor[0.1-expected_task_counts4] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 59%] 5239s tests/test_scheduler.py::test_saturation_factor[inf-expected_task_counts5] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 59%] 5240s tests/test_scheduler.py::test_saturation_factor[inf-expected_task_counts6] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 59%] 5240s tests/test_scheduler.py::test_bad_saturation_factor <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 59%] 5240s tests/test_scheduler.py::test_move_data_over_break_restrictions <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 59%] 5241s tests/test_scheduler.py::test_balance_with_restrictions <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 59%] 5241s tests/test_scheduler.py::test_no_valid_workers <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 59%] 5241s tests/test_scheduler.py::test_no_valid_workers_loose_restrictions <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 59%] 5242s tests/test_scheduler.py::test_no_workers[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 59%] 5242s tests/test_scheduler.py::test_no_workers[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 59%] 5242s tests/test_scheduler.py::test_retire_workers_empty <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 59%] 5243s tests/test_scheduler.py::test_retire_workers_lock <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 59%] 5243s tests/test_scheduler.py::test_retire_workers_concurrently <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 59%] 5243s tests/test_scheduler.py::test_server_listens_to_other_ops <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 59%] 5244s tests/test_scheduler.py::test_remove_worker_from_scheduler <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 60%] 5244s tests/test_scheduler.py::test_remove_worker_from_scheduler_warns_on_safe <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 60%] 5244s tests/test_scheduler.py::test_remove_worker_by_name_from_scheduler <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 60%] 5245s tests/test_scheduler.py::test_clear_events_worker_removal <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 60%] 5245s tests/test_scheduler.py::test_clear_events_client_removal <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 60%] 5245s tests/test_scheduler.py::test_add_worker <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 60%] 5245s tests/test_scheduler.py::test_blocked_handlers_are_respected <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 60%] 5246s tests/test_scheduler.py::test_scheduler_init_pulls_blocked_handlers_from_config <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 60%] 5246s tests/test_scheduler.py::test_feed <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 60%] 5246s tests/test_scheduler.py::test_feed_setup_teardown <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 60%] 5247s tests/test_scheduler.py::test_feed_large_bytestring <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 60%] 5247s tests/test_scheduler.py::test_delete_data <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 60%] 5247s tests/test_scheduler.py::test_delete <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 60%] 5247s tests/test_scheduler.py::test_dumps_function <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 60%] 5247s tests/test_scheduler.py::test_ready_remove_worker[1.0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 60%] 5248s tests/test_scheduler.py::test_ready_remove_worker[inf] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 60%] 5248s tests/test_scheduler.py::test_restart <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py SKIPPED [ 60%] 5248s tests/test_scheduler.py::test_restart_waits_for_new_workers <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py SKIPPED [ 60%] 5248s tests/test_scheduler.py::test_restart_nanny_timeout_exceeded <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py SKIPPED [ 60%] 5249s tests/test_scheduler.py::test_restart_not_all_workers_return <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 60%] 5249s tests/test_scheduler.py::test_restart_worker_rejoins_after_timeout_expired <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 60%] 5250s tests/test_scheduler.py::test_restart_no_wait_for_workers <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 60%] 5250s tests/test_scheduler.py::test_restart_some_nannies_some_not <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py SKIPPED [ 60%] 5250s tests/test_scheduler.py::test_restart_heartbeat_before_closing <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py SKIPPED [ 60%] 5250s tests/test_scheduler.py::test_broadcast <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 60%] 5250s tests/test_scheduler.py::test_broadcast_tls <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 60%] 5253s tests/test_scheduler.py::test_broadcast_nanny <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 60%] 5254s tests/test_scheduler.py::test_broadcast_on_error <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 60%] 5254s tests/test_scheduler.py::test_broadcast_deprecation <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 60%] 5254s tests/test_scheduler.py::test_worker_name <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 60%] 5255s tests/test_scheduler.py::test_coerce_address <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 60%] 5255s tests/test_scheduler.py::test_config_stealing <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 60%] 5255s tests/test_scheduler.py::test_config_no_stealing <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 61%] 5255s tests/test_scheduler.py::test_update_graph_culls <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 61%] 5255s tests/test_scheduler.py::test_io_loop <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 61%] 5255s tests/test_scheduler.py::test_story <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 61%] 5256s tests/test_scheduler.py::test_scatter_no_workers[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 61%] 5257s tests/test_scheduler.py::test_scatter_no_workers[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 61%] 5257s tests/test_scheduler.py::test_scheduler_sees_memory_limits <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 61%] 5257s tests/test_scheduler.py::test_retire_workers <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 61%] 5258s tests/test_scheduler.py::test_retire_workers_n <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 61%] 5258s tests/test_scheduler.py::test_workers_to_close <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 61%] 5259s tests/test_scheduler.py::test_workers_to_close_grouped <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 61%] 5259s tests/test_scheduler.py::test_workers_to_close_never_close_long_running[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 61%] 5259s tests/test_scheduler.py::test_workers_to_close_never_close_long_running[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 61%] 5260s tests/test_scheduler.py::test_retire_workers_no_suspicious_tasks <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 61%] 5260s tests/test_scheduler.py::test_file_descriptors <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py SKIPPED [ 61%] 5260s tests/test_scheduler.py::test_learn_occupancy <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py SKIPPED [ 61%] 5260s tests/test_scheduler.py::test_learn_occupancy_2 <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py SKIPPED [ 61%] 5263s tests/test_scheduler.py::test_balance_many_workers <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 61%] 5267s tests/test_scheduler.py::test_balance_many_workers_2 <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 61%] 5269s tests/test_scheduler.py::test_include_communication_in_occupancy <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 61%] 5269s tests/test_scheduler.py::test_nonempty_data_is_rejected <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 61%] 5271s tests/test_scheduler.py::test_worker_arrives_with_data_is_rejected <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 61%] 5274s tests/test_scheduler.py::test_run_on_scheduler_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 61%] 5274s tests/test_scheduler.py::test_run_on_scheduler <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 61%] 5274s tests/test_scheduler.py::test_allow_pickle_false <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 61%] 5274s tests/test_scheduler.py::test_close_worker <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 61%] 5274s tests/test_scheduler.py::test_close_nanny <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py SKIPPED [ 61%] 5274s tests/test_scheduler.py::test_retire_workers_close <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 61%] 5274s tests/test_scheduler.py::test_retire_nannies_close <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py SKIPPED [ 61%] 5276s tests/test_scheduler.py::test_fifo_submission <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 61%] 5277s tests/test_scheduler.py::test_profile_metadata <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 61%] 5278s tests/test_scheduler.py::test_profile_metadata_timeout <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 61%] 5278s tests/test_scheduler.py::test_profile_metadata_keys <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 62%] 5279s tests/test_scheduler.py::test_statistical_profiling <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 62%] 5280s tests/test_scheduler.py::test_statistical_profiling_failure <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 62%] 5280s tests/test_scheduler.py::test_cancel_fire_and_forget <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 62%] 5280s tests/test_scheduler.py::test_log_tasks_during_restart <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py SKIPPED [ 62%] 5280s tests/test_scheduler.py::test_get_task_status <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 62%] 5280s tests/test_scheduler.py::test_deque_handler <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 62%] 5281s tests/test_scheduler.py::test_retries <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 62%] 5281s tests/test_scheduler.py::test_missing_data_errant_worker <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 62%] 5282s tests/test_scheduler.py::test_dont_recompute_if_persisted <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 62%] 5282s tests/test_scheduler.py::test_dont_recompute_if_persisted_2 <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 62%] 5283s tests/test_scheduler.py::test_dont_recompute_if_persisted_3 <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 62%] 5283s tests/test_scheduler.py::test_dont_recompute_if_persisted_4 <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 62%] 5283s tests/test_scheduler.py::test_dont_forget_released_keys <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 62%] 5284s tests/test_scheduler.py::test_dont_recompute_if_erred <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 62%] 5284s tests/test_scheduler.py::test_closing_scheduler_closes_workers <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 62%] 5284s tests/test_scheduler.py::test_resources_reset_after_cancelled_task <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 62%] 5285s tests/test_scheduler.py::test_gh2187 <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 62%] 5285s tests/test_scheduler.py::test_collect_versions <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 62%] 5285s tests/test_scheduler.py::test_idle_timeout <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py SKIPPED [ 62%] 5286s tests/test_scheduler.py::test_idle_during_update_graph <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 62%] 5286s tests/test_scheduler.py::test_idle_timeout_no_workers <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 62%] 5287s tests/test_scheduler.py::test_no_workers_timeout_disabled <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 62%] 5287s tests/test_scheduler.py::test_no_workers_timeout_without_workers <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py SKIPPED [ 62%] 5287s tests/test_scheduler.py::test_no_workers_timeout_bad_restrictions <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py SKIPPED [ 62%] 5288s tests/test_scheduler.py::test_no_workers_timeout_queued <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 62%] 5288s tests/test_scheduler.py::test_no_workers_timeout_processing <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py SKIPPED [ 62%] 5288s tests/test_scheduler.py::test_bandwidth <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 62%] 5288s tests/test_scheduler.py::test_bandwidth_clear <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py SKIPPED [ 62%] 5289s tests/test_scheduler.py::test_workerstate_clean <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 62%] 5289s tests/test_scheduler.py::test_result_type <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 62%] 5289s tests/test_scheduler.py::test_close_workers <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 62%] 5289s tests/test_scheduler.py::test_host_address <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 62%] 5289s tests/test_scheduler.py::test_dashboard_address <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py SKIPPED [ 63%] 5290s tests/test_scheduler.py::test_adaptive_target <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 63%] 5291s tests/test_scheduler.py::test_adaptive_target_empty_cluster[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 63%] 5291s tests/test_scheduler.py::test_adaptive_target_empty_cluster[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 63%] 5291s tests/test_scheduler.py::test_retire_names_str <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 63%] 5291s tests/test_scheduler.py::test_retire_workers_bad_params <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 63%] 5292s tests/test_scheduler.py::test_get_task_duration <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 63%] 5294s tests/test_scheduler.py::test_default_task_duration_splits <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 63%] 5294s tests/test_scheduler.py::test_task_group_and_prefix_statistics <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 63%] 5295s tests/test_scheduler.py::test_task_groups_update_start_stop <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 63%] 5295s tests/test_scheduler.py::test_task_group_done <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 63%] 5296s tests/test_scheduler.py::test_task_group_not_done_waiting <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 63%] 5296s tests/test_scheduler.py::test_task_group_not_done_noworker <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 63%] 5296s tests/test_scheduler.py::test_task_group_not_done_queued <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 63%] 5296s tests/test_scheduler.py::test_task_group_not_done_processing <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 63%] 5297s tests/test_scheduler.py::test_task_prefix <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 63%] 5297s tests/test_scheduler.py::test_failing_task_increments_suspicious <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py SKIPPED [ 63%] 5297s tests/test_scheduler.py::test_task_group_non_tuple_key <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 63%] 5298s tests/test_scheduler.py::test_task_unique_groups <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 63%] 5299s tests/test_scheduler.py::test_task_group_on_fire_and_forget <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 63%] 5299s tests/test_scheduler.py::test_gather_failing_can_recover <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 63%] 5299s tests/test_scheduler.py::test_gather_failing_cnn_error <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 63%] 5301s tests/test_scheduler.py::test_gather_no_workers <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 63%] 5301s tests/test_scheduler.py::test_gather_bad_worker[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 63%] 5301s tests/test_scheduler.py::test_gather_bad_worker[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 63%] 5302s tests/test_scheduler.py::test_too_many_groups <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 63%] 5302s tests/test_scheduler.py::test_worker_name_collision <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 63%] 5302s tests/test_scheduler.py::test_unknown_task_duration_config <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 63%] 5302s tests/test_scheduler.py::test_unknown_task_duration_config_2 <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 63%] 5303s tests/test_scheduler.py::test_retire_state_change <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 63%] 5303s tests/test_scheduler.py::test_get_worker_monitor_info <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 63%] 5304s tests/test_scheduler.py::test_quiet_cluster_round_robin <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 63%] 5304s tests/test_scheduler.py::test_memorystate <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 64%] 5304s tests/test_scheduler.py::test_memorystate_sum <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 64%] 5304s tests/test_scheduler.py::test_memorystate_adds_up[0-0-0-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 64%] 5304s tests/test_scheduler.py::test_memorystate_adds_up[0-0-0-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 64%] 5304s tests/test_scheduler.py::test_memorystate_adds_up[0-0-0-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 64%] 5304s tests/test_scheduler.py::test_memorystate_adds_up[0-0-0-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 64%] 5304s tests/test_scheduler.py::test_memorystate_adds_up[0-0-1-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 64%] 5304s tests/test_scheduler.py::test_memorystate_adds_up[0-0-1-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 64%] 5304s tests/test_scheduler.py::test_memorystate_adds_up[0-0-1-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 64%] 5304s tests/test_scheduler.py::test_memorystate_adds_up[0-0-1-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 64%] 5304s tests/test_scheduler.py::test_memorystate_adds_up[0-0-2-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 64%] 5304s tests/test_scheduler.py::test_memorystate_adds_up[0-0-2-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 64%] 5304s tests/test_scheduler.py::test_memorystate_adds_up[0-0-2-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 64%] 5304s tests/test_scheduler.py::test_memorystate_adds_up[0-0-2-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 64%] 5304s tests/test_scheduler.py::test_memorystate_adds_up[0-0-3-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 64%] 5304s tests/test_scheduler.py::test_memorystate_adds_up[0-0-3-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 64%] 5304s tests/test_scheduler.py::test_memorystate_adds_up[0-0-3-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 64%] 5304s tests/test_scheduler.py::test_memorystate_adds_up[0-0-3-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 64%] 5304s tests/test_scheduler.py::test_memorystate_adds_up[0-1-0-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 64%] 5304s tests/test_scheduler.py::test_memorystate_adds_up[0-1-0-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 64%] 5304s tests/test_scheduler.py::test_memorystate_adds_up[0-1-0-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 64%] 5304s tests/test_scheduler.py::test_memorystate_adds_up[0-1-0-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 64%] 5304s tests/test_scheduler.py::test_memorystate_adds_up[0-1-1-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 64%] 5304s tests/test_scheduler.py::test_memorystate_adds_up[0-1-1-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 64%] 5304s tests/test_scheduler.py::test_memorystate_adds_up[0-1-1-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 64%] 5304s tests/test_scheduler.py::test_memorystate_adds_up[0-1-1-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 64%] 5304s tests/test_scheduler.py::test_memorystate_adds_up[0-1-2-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 64%] 5304s tests/test_scheduler.py::test_memorystate_adds_up[0-1-2-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 64%] 5304s tests/test_scheduler.py::test_memorystate_adds_up[0-1-2-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 64%] 5304s tests/test_scheduler.py::test_memorystate_adds_up[0-1-2-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 64%] 5304s tests/test_scheduler.py::test_memorystate_adds_up[0-1-3-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 64%] 5304s tests/test_scheduler.py::test_memorystate_adds_up[0-1-3-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 64%] 5304s tests/test_scheduler.py::test_memorystate_adds_up[0-1-3-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 65%] 5304s tests/test_scheduler.py::test_memorystate_adds_up[0-1-3-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 65%] 5304s tests/test_scheduler.py::test_memorystate_adds_up[0-2-0-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 65%] 5304s tests/test_scheduler.py::test_memorystate_adds_up[0-2-0-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 65%] 5304s tests/test_scheduler.py::test_memorystate_adds_up[0-2-0-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 65%] 5304s tests/test_scheduler.py::test_memorystate_adds_up[0-2-0-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 65%] 5304s tests/test_scheduler.py::test_memorystate_adds_up[0-2-1-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 65%] 5304s tests/test_scheduler.py::test_memorystate_adds_up[0-2-1-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 65%] 5304s tests/test_scheduler.py::test_memorystate_adds_up[0-2-1-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 65%] 5304s tests/test_scheduler.py::test_memorystate_adds_up[0-2-1-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 65%] 5304s tests/test_scheduler.py::test_memorystate_adds_up[0-2-2-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 65%] 5304s tests/test_scheduler.py::test_memorystate_adds_up[0-2-2-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 65%] 5304s tests/test_scheduler.py::test_memorystate_adds_up[0-2-2-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 65%] 5304s tests/test_scheduler.py::test_memorystate_adds_up[0-2-2-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 65%] 5304s tests/test_scheduler.py::test_memorystate_adds_up[0-2-3-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 65%] 5304s tests/test_scheduler.py::test_memorystate_adds_up[0-2-3-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 65%] 5304s tests/test_scheduler.py::test_memorystate_adds_up[0-2-3-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 65%] 5304s tests/test_scheduler.py::test_memorystate_adds_up[0-2-3-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 65%] 5304s tests/test_scheduler.py::test_memorystate_adds_up[0-3-0-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 65%] 5304s tests/test_scheduler.py::test_memorystate_adds_up[0-3-0-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 65%] 5304s tests/test_scheduler.py::test_memorystate_adds_up[0-3-0-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 65%] 5304s tests/test_scheduler.py::test_memorystate_adds_up[0-3-0-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 65%] 5304s tests/test_scheduler.py::test_memorystate_adds_up[0-3-1-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 65%] 5304s tests/test_scheduler.py::test_memorystate_adds_up[0-3-1-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 65%] 5304s tests/test_scheduler.py::test_memorystate_adds_up[0-3-1-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 65%] 5304s tests/test_scheduler.py::test_memorystate_adds_up[0-3-1-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 65%] 5304s tests/test_scheduler.py::test_memorystate_adds_up[0-3-2-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 65%] 5304s tests/test_scheduler.py::test_memorystate_adds_up[0-3-2-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 65%] 5304s tests/test_scheduler.py::test_memorystate_adds_up[0-3-2-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 65%] 5304s tests/test_scheduler.py::test_memorystate_adds_up[0-3-2-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 65%] 5304s tests/test_scheduler.py::test_memorystate_adds_up[0-3-3-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 65%] 5304s tests/test_scheduler.py::test_memorystate_adds_up[0-3-3-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 65%] 5304s tests/test_scheduler.py::test_memorystate_adds_up[0-3-3-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 65%] 5304s tests/test_scheduler.py::test_memorystate_adds_up[0-3-3-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 66%] 5304s tests/test_scheduler.py::test_memorystate_adds_up[1-0-0-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 66%] 5304s tests/test_scheduler.py::test_memorystate_adds_up[1-0-0-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 66%] 5304s tests/test_scheduler.py::test_memorystate_adds_up[1-0-0-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 66%] 5304s tests/test_scheduler.py::test_memorystate_adds_up[1-0-0-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 66%] 5304s tests/test_scheduler.py::test_memorystate_adds_up[1-0-1-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 66%] 5304s tests/test_scheduler.py::test_memorystate_adds_up[1-0-1-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 66%] 5304s tests/test_scheduler.py::test_memorystate_adds_up[1-0-1-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 66%] 5304s tests/test_scheduler.py::test_memorystate_adds_up[1-0-1-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 66%] 5304s tests/test_scheduler.py::test_memorystate_adds_up[1-0-2-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 66%] 5304s tests/test_scheduler.py::test_memorystate_adds_up[1-0-2-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 66%] 5304s tests/test_scheduler.py::test_memorystate_adds_up[1-0-2-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 66%] 5304s tests/test_scheduler.py::test_memorystate_adds_up[1-0-2-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 66%] 5304s tests/test_scheduler.py::test_memorystate_adds_up[1-0-3-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 66%] 5304s tests/test_scheduler.py::test_memorystate_adds_up[1-0-3-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 66%] 5304s tests/test_scheduler.py::test_memorystate_adds_up[1-0-3-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 66%] 5304s tests/test_scheduler.py::test_memorystate_adds_up[1-0-3-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 66%] 5304s tests/test_scheduler.py::test_memorystate_adds_up[1-1-0-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 66%] 5304s tests/test_scheduler.py::test_memorystate_adds_up[1-1-0-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 66%] 5304s tests/test_scheduler.py::test_memorystate_adds_up[1-1-0-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 66%] 5304s tests/test_scheduler.py::test_memorystate_adds_up[1-1-0-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 66%] 5304s tests/test_scheduler.py::test_memorystate_adds_up[1-1-1-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 66%] 5304s tests/test_scheduler.py::test_memorystate_adds_up[1-1-1-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 66%] 5304s tests/test_scheduler.py::test_memorystate_adds_up[1-1-1-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 66%] 5304s tests/test_scheduler.py::test_memorystate_adds_up[1-1-1-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 66%] 5304s tests/test_scheduler.py::test_memorystate_adds_up[1-1-2-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 66%] 5304s tests/test_scheduler.py::test_memorystate_adds_up[1-1-2-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 66%] 5304s tests/test_scheduler.py::test_memorystate_adds_up[1-1-2-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 66%] 5304s tests/test_scheduler.py::test_memorystate_adds_up[1-1-2-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 66%] 5304s tests/test_scheduler.py::test_memorystate_adds_up[1-1-3-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 66%] 5304s tests/test_scheduler.py::test_memorystate_adds_up[1-1-3-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 66%] 5304s tests/test_scheduler.py::test_memorystate_adds_up[1-1-3-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 66%] 5304s tests/test_scheduler.py::test_memorystate_adds_up[1-1-3-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 67%] 5304s tests/test_scheduler.py::test_memorystate_adds_up[1-2-0-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 67%] 5304s tests/test_scheduler.py::test_memorystate_adds_up[1-2-0-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 67%] 5304s tests/test_scheduler.py::test_memorystate_adds_up[1-2-0-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 67%] 5304s tests/test_scheduler.py::test_memorystate_adds_up[1-2-0-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 67%] 5304s tests/test_scheduler.py::test_memorystate_adds_up[1-2-1-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 67%] 5304s tests/test_scheduler.py::test_memorystate_adds_up[1-2-1-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 67%] 5304s tests/test_scheduler.py::test_memorystate_adds_up[1-2-1-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 67%] 5304s tests/test_scheduler.py::test_memorystate_adds_up[1-2-1-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 67%] 5304s tests/test_scheduler.py::test_memorystate_adds_up[1-2-2-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 67%] 5304s tests/test_scheduler.py::test_memorystate_adds_up[1-2-2-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 67%] 5304s tests/test_scheduler.py::test_memorystate_adds_up[1-2-2-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 67%] 5304s tests/test_scheduler.py::test_memorystate_adds_up[1-2-2-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 67%] 5304s tests/test_scheduler.py::test_memorystate_adds_up[1-2-3-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 67%] 5304s tests/test_scheduler.py::test_memorystate_adds_up[1-2-3-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 67%] 5304s tests/test_scheduler.py::test_memorystate_adds_up[1-2-3-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 67%] 5304s tests/test_scheduler.py::test_memorystate_adds_up[1-2-3-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 67%] 5304s tests/test_scheduler.py::test_memorystate_adds_up[1-3-0-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 67%] 5304s tests/test_scheduler.py::test_memorystate_adds_up[1-3-0-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 67%] 5304s tests/test_scheduler.py::test_memorystate_adds_up[1-3-0-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 67%] 5304s tests/test_scheduler.py::test_memorystate_adds_up[1-3-0-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 67%] 5304s tests/test_scheduler.py::test_memorystate_adds_up[1-3-1-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 67%] 5304s tests/test_scheduler.py::test_memorystate_adds_up[1-3-1-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 67%] 5304s tests/test_scheduler.py::test_memorystate_adds_up[1-3-1-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 67%] 5304s tests/test_scheduler.py::test_memorystate_adds_up[1-3-1-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 67%] 5304s tests/test_scheduler.py::test_memorystate_adds_up[1-3-2-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 67%] 5304s tests/test_scheduler.py::test_memorystate_adds_up[1-3-2-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 67%] 5304s tests/test_scheduler.py::test_memorystate_adds_up[1-3-2-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 67%] 5304s tests/test_scheduler.py::test_memorystate_adds_up[1-3-2-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 67%] 5304s tests/test_scheduler.py::test_memorystate_adds_up[1-3-3-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 67%] 5304s tests/test_scheduler.py::test_memorystate_adds_up[1-3-3-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 67%] 5304s tests/test_scheduler.py::test_memorystate_adds_up[1-3-3-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 67%] 5304s tests/test_scheduler.py::test_memorystate_adds_up[1-3-3-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 68%] 5304s tests/test_scheduler.py::test_memorystate_adds_up[2-0-0-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 68%] 5304s tests/test_scheduler.py::test_memorystate_adds_up[2-0-0-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 68%] 5304s tests/test_scheduler.py::test_memorystate_adds_up[2-0-0-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 68%] 5304s tests/test_scheduler.py::test_memorystate_adds_up[2-0-0-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 68%] 5304s tests/test_scheduler.py::test_memorystate_adds_up[2-0-1-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 68%] 5304s tests/test_scheduler.py::test_memorystate_adds_up[2-0-1-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 68%] 5304s tests/test_scheduler.py::test_memorystate_adds_up[2-0-1-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 68%] 5304s tests/test_scheduler.py::test_memorystate_adds_up[2-0-1-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 68%] 5304s tests/test_scheduler.py::test_memorystate_adds_up[2-0-2-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 68%] 5304s tests/test_scheduler.py::test_memorystate_adds_up[2-0-2-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 68%] 5304s tests/test_scheduler.py::test_memorystate_adds_up[2-0-2-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 68%] 5304s tests/test_scheduler.py::test_memorystate_adds_up[2-0-2-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 68%] 5304s tests/test_scheduler.py::test_memorystate_adds_up[2-0-3-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 68%] 5304s tests/test_scheduler.py::test_memorystate_adds_up[2-0-3-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 68%] 5304s tests/test_scheduler.py::test_memorystate_adds_up[2-0-3-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 68%] 5304s tests/test_scheduler.py::test_memorystate_adds_up[2-0-3-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 68%] 5304s tests/test_scheduler.py::test_memorystate_adds_up[2-1-0-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 68%] 5304s tests/test_scheduler.py::test_memorystate_adds_up[2-1-0-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 68%] 5304s tests/test_scheduler.py::test_memorystate_adds_up[2-1-0-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 68%] 5304s tests/test_scheduler.py::test_memorystate_adds_up[2-1-0-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 68%] 5304s tests/test_scheduler.py::test_memorystate_adds_up[2-1-1-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 68%] 5304s tests/test_scheduler.py::test_memorystate_adds_up[2-1-1-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 68%] 5304s tests/test_scheduler.py::test_memorystate_adds_up[2-1-1-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 68%] 5304s tests/test_scheduler.py::test_memorystate_adds_up[2-1-1-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 68%] 5304s tests/test_scheduler.py::test_memorystate_adds_up[2-1-2-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 68%] 5304s tests/test_scheduler.py::test_memorystate_adds_up[2-1-2-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 68%] 5304s tests/test_scheduler.py::test_memorystate_adds_up[2-1-2-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 68%] 5304s tests/test_scheduler.py::test_memorystate_adds_up[2-1-2-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 68%] 5304s tests/test_scheduler.py::test_memorystate_adds_up[2-1-3-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 68%] 5304s tests/test_scheduler.py::test_memorystate_adds_up[2-1-3-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 68%] 5304s tests/test_scheduler.py::test_memorystate_adds_up[2-1-3-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 68%] 5304s tests/test_scheduler.py::test_memorystate_adds_up[2-1-3-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 68%] 5304s tests/test_scheduler.py::test_memorystate_adds_up[2-2-0-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 69%] 5304s tests/test_scheduler.py::test_memorystate_adds_up[2-2-0-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 69%] 5304s tests/test_scheduler.py::test_memorystate_adds_up[2-2-0-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 69%] 5304s tests/test_scheduler.py::test_memorystate_adds_up[2-2-0-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 69%] 5304s tests/test_scheduler.py::test_memorystate_adds_up[2-2-1-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 69%] 5304s tests/test_scheduler.py::test_memorystate_adds_up[2-2-1-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 69%] 5304s tests/test_scheduler.py::test_memorystate_adds_up[2-2-1-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 69%] 5304s tests/test_scheduler.py::test_memorystate_adds_up[2-2-1-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 69%] 5304s tests/test_scheduler.py::test_memorystate_adds_up[2-2-2-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 69%] 5304s tests/test_scheduler.py::test_memorystate_adds_up[2-2-2-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 69%] 5304s tests/test_scheduler.py::test_memorystate_adds_up[2-2-2-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 69%] 5304s tests/test_scheduler.py::test_memorystate_adds_up[2-2-2-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 69%] 5304s tests/test_scheduler.py::test_memorystate_adds_up[2-2-3-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 69%] 5304s tests/test_scheduler.py::test_memorystate_adds_up[2-2-3-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 69%] 5304s tests/test_scheduler.py::test_memorystate_adds_up[2-2-3-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 69%] 5304s tests/test_scheduler.py::test_memorystate_adds_up[2-2-3-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 69%] 5304s tests/test_scheduler.py::test_memorystate_adds_up[2-3-0-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 69%] 5304s tests/test_scheduler.py::test_memorystate_adds_up[2-3-0-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 69%] 5304s tests/test_scheduler.py::test_memorystate_adds_up[2-3-0-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 69%] 5304s tests/test_scheduler.py::test_memorystate_adds_up[2-3-0-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 69%] 5304s tests/test_scheduler.py::test_memorystate_adds_up[2-3-1-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 69%] 5304s tests/test_scheduler.py::test_memorystate_adds_up[2-3-1-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 69%] 5304s tests/test_scheduler.py::test_memorystate_adds_up[2-3-1-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 69%] 5304s tests/test_scheduler.py::test_memorystate_adds_up[2-3-1-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 69%] 5304s tests/test_scheduler.py::test_memorystate_adds_up[2-3-2-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 69%] 5304s tests/test_scheduler.py::test_memorystate_adds_up[2-3-2-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 69%] 5304s tests/test_scheduler.py::test_memorystate_adds_up[2-3-2-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 69%] 5304s tests/test_scheduler.py::test_memorystate_adds_up[2-3-2-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 69%] 5304s tests/test_scheduler.py::test_memorystate_adds_up[2-3-3-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 69%] 5304s tests/test_scheduler.py::test_memorystate_adds_up[2-3-3-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 69%] 5304s tests/test_scheduler.py::test_memorystate_adds_up[2-3-3-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 69%] 5304s tests/test_scheduler.py::test_memorystate_adds_up[2-3-3-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 69%] 5304s tests/test_scheduler.py::test_memorystate_adds_up[3-0-0-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 70%] 5304s tests/test_scheduler.py::test_memorystate_adds_up[3-0-0-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 70%] 5304s tests/test_scheduler.py::test_memorystate_adds_up[3-0-0-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 70%] 5304s tests/test_scheduler.py::test_memorystate_adds_up[3-0-0-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 70%] 5304s tests/test_scheduler.py::test_memorystate_adds_up[3-0-1-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 70%] 5304s tests/test_scheduler.py::test_memorystate_adds_up[3-0-1-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 70%] 5304s tests/test_scheduler.py::test_memorystate_adds_up[3-0-1-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 70%] 5304s tests/test_scheduler.py::test_memorystate_adds_up[3-0-1-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 70%] 5304s tests/test_scheduler.py::test_memorystate_adds_up[3-0-2-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 70%] 5304s tests/test_scheduler.py::test_memorystate_adds_up[3-0-2-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 70%] 5304s tests/test_scheduler.py::test_memorystate_adds_up[3-0-2-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 70%] 5304s tests/test_scheduler.py::test_memorystate_adds_up[3-0-2-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 70%] 5304s tests/test_scheduler.py::test_memorystate_adds_up[3-0-3-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 70%] 5304s tests/test_scheduler.py::test_memorystate_adds_up[3-0-3-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 70%] 5304s tests/test_scheduler.py::test_memorystate_adds_up[3-0-3-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 70%] 5304s tests/test_scheduler.py::test_memorystate_adds_up[3-0-3-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 70%] 5304s tests/test_scheduler.py::test_memorystate_adds_up[3-1-0-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 70%] 5304s tests/test_scheduler.py::test_memorystate_adds_up[3-1-0-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 70%] 5304s tests/test_scheduler.py::test_memorystate_adds_up[3-1-0-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 70%] 5304s tests/test_scheduler.py::test_memorystate_adds_up[3-1-0-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 70%] 5304s tests/test_scheduler.py::test_memorystate_adds_up[3-1-1-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 70%] 5304s tests/test_scheduler.py::test_memorystate_adds_up[3-1-1-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 70%] 5304s tests/test_scheduler.py::test_memorystate_adds_up[3-1-1-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 70%] 5304s tests/test_scheduler.py::test_memorystate_adds_up[3-1-1-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 70%] 5304s tests/test_scheduler.py::test_memorystate_adds_up[3-1-2-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 70%] 5304s tests/test_scheduler.py::test_memorystate_adds_up[3-1-2-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 70%] 5304s tests/test_scheduler.py::test_memorystate_adds_up[3-1-2-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 70%] 5304s tests/test_scheduler.py::test_memorystate_adds_up[3-1-2-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 70%] 5304s tests/test_scheduler.py::test_memorystate_adds_up[3-1-3-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 70%] 5304s tests/test_scheduler.py::test_memorystate_adds_up[3-1-3-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 70%] 5304s tests/test_scheduler.py::test_memorystate_adds_up[3-1-3-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 70%] 5304s tests/test_scheduler.py::test_memorystate_adds_up[3-1-3-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 70%] 5304s tests/test_scheduler.py::test_memorystate_adds_up[3-2-0-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 71%] 5304s tests/test_scheduler.py::test_memorystate_adds_up[3-2-0-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 71%] 5304s tests/test_scheduler.py::test_memorystate_adds_up[3-2-0-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 71%] 5304s tests/test_scheduler.py::test_memorystate_adds_up[3-2-0-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 71%] 5304s tests/test_scheduler.py::test_memorystate_adds_up[3-2-1-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 71%] 5304s tests/test_scheduler.py::test_memorystate_adds_up[3-2-1-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 71%] 5304s tests/test_scheduler.py::test_memorystate_adds_up[3-2-1-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 71%] 5304s tests/test_scheduler.py::test_memorystate_adds_up[3-2-1-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 71%] 5304s tests/test_scheduler.py::test_memorystate_adds_up[3-2-2-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 71%] 5304s tests/test_scheduler.py::test_memorystate_adds_up[3-2-2-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 71%] 5304s tests/test_scheduler.py::test_memorystate_adds_up[3-2-2-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 71%] 5304s tests/test_scheduler.py::test_memorystate_adds_up[3-2-2-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 71%] 5304s tests/test_scheduler.py::test_memorystate_adds_up[3-2-3-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 71%] 5304s tests/test_scheduler.py::test_memorystate_adds_up[3-2-3-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 71%] 5304s tests/test_scheduler.py::test_memorystate_adds_up[3-2-3-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 71%] 5304s tests/test_scheduler.py::test_memorystate_adds_up[3-2-3-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 71%] 5304s tests/test_scheduler.py::test_memorystate_adds_up[3-3-0-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 71%] 5304s tests/test_scheduler.py::test_memorystate_adds_up[3-3-0-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 71%] 5304s tests/test_scheduler.py::test_memorystate_adds_up[3-3-0-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 71%] 5304s tests/test_scheduler.py::test_memorystate_adds_up[3-3-0-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 71%] 5304s tests/test_scheduler.py::test_memorystate_adds_up[3-3-1-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 71%] 5304s tests/test_scheduler.py::test_memorystate_adds_up[3-3-1-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 71%] 5304s tests/test_scheduler.py::test_memorystate_adds_up[3-3-1-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 71%] 5304s tests/test_scheduler.py::test_memorystate_adds_up[3-3-1-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 71%] 5304s tests/test_scheduler.py::test_memorystate_adds_up[3-3-2-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 71%] 5304s tests/test_scheduler.py::test_memorystate_adds_up[3-3-2-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 71%] 5304s tests/test_scheduler.py::test_memorystate_adds_up[3-3-2-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 71%] 5304s tests/test_scheduler.py::test_memorystate_adds_up[3-3-2-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 71%] 5304s tests/test_scheduler.py::test_memorystate_adds_up[3-3-3-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 71%] 5304s tests/test_scheduler.py::test_memorystate_adds_up[3-3-3-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 71%] 5304s tests/test_scheduler.py::test_memorystate_adds_up[3-3-3-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 71%] 5304s tests/test_scheduler.py::test_memorystate_adds_up[3-3-3-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 71%] 5304s tests/test_scheduler.py::test_memorystate__to_dict <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 71%] 5304s tests/test_scheduler.py::test_memory <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py SKIPPED [ 72%] 5304s tests/test_scheduler.py::test_memory_no_zict <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 72%] 5304s tests/test_scheduler.py::test_memory_no_workers <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 72%] 5305s tests/test_scheduler.py::test_infrequent_sysmon <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 72%] 5305s tests/test_scheduler.py::test_close_scheduler__close_workers_Worker <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 72%] 5305s tests/test_scheduler.py::test_close_scheduler__close_workers_Nanny <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py SKIPPED [ 72%] 5305s tests/test_scheduler.py::test_rebalance <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py SKIPPED [ 72%] 5305s tests/test_scheduler.py::test_rebalance_managed_memory <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 72%] 5306s tests/test_scheduler.py::test_rebalance_workers_and_keys <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 72%] 5306s tests/test_scheduler.py::test_rebalance_missing_data1 <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 72%] 5306s tests/test_scheduler.py::test_rebalance_missing_data2 <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 72%] 5307s tests/test_scheduler.py::test_rebalance_raises_missing_data3[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 72%] 5307s tests/test_scheduler.py::test_rebalance_raises_missing_data3[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py XFAIL subject to a race 5307s condition. This test assumes that the data is freed before 5307s the rebalance get_data requests come in but merely deleting 5307s the futures is not sufficient to guarantee this) [ 72%] 5307s tests/test_scheduler.py::test_rebalance_no_workers <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 72%] 5308s tests/test_scheduler.py::test_rebalance_no_limit <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 72%] 5308s tests/test_scheduler.py::test_rebalance_no_recipients <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py SKIPPED [ 72%] 5308s tests/test_scheduler.py::test_rebalance_skip_recipient <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 72%] 5308s tests/test_scheduler.py::test_rebalance_skip_all_recipients <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 72%] 5308s tests/test_scheduler.py::test_rebalance_sender_below_mean <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py SKIPPED [ 72%] 5308s tests/test_scheduler.py::test_rebalance_least_recently_inserted_sender_min <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py SKIPPED [ 72%] 5309s tests/test_scheduler.py::test_gather_on_worker <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 72%] 5309s tests/test_scheduler.py::test_gather_on_worker_bad_recipient <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 72%] 5309s tests/test_scheduler.py::test_gather_on_worker_bad_sender <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 72%] 5310s tests/test_scheduler.py::test_gather_on_worker_bad_sender_replicated[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 72%] 5310s tests/test_scheduler.py::test_gather_on_worker_bad_sender_replicated[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 72%] 5310s tests/test_scheduler.py::test_gather_on_worker_key_not_on_sender <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 72%] 5311s tests/test_scheduler.py::test_gather_on_worker_key_not_on_sender_replicated[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 72%] 5311s tests/test_scheduler.py::test_gather_on_worker_key_not_on_sender_replicated[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 72%] 5311s tests/test_scheduler.py::test_gather_on_worker_duplicate_task <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 72%] 5312s tests/test_scheduler.py::test_rebalance_dead_recipient <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 72%] 5312s tests/test_scheduler.py::test_delete_worker_data <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 72%] 5312s tests/test_scheduler.py::test_delete_worker_data_double_delete <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 72%] 5313s tests/test_scheduler.py::test_delete_worker_data_bad_worker <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 73%] 5313s tests/test_scheduler.py::test_delete_worker_data_bad_task[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 73%] 5313s tests/test_scheduler.py::test_delete_worker_data_bad_task[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 73%] 5313s tests/test_scheduler.py::test_transition_counter <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 73%] 5313s tests/test_scheduler.py::test_transition_counter_max_scheduler <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 73%] 5314s tests/test_scheduler.py::test_transition_counter_max_worker <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 73%] 5316s tests/test_scheduler.py::test_disable_transition_counter_max <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 73%] 5318s tests/test_scheduler.py::test_worker_heartbeat_after_cancel <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 73%] 5318s tests/test_scheduler.py::test_set_restrictions <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 73%] 5319s tests/test_scheduler.py::test_avoid_paused_workers <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 73%] 5319s tests/test_scheduler.py::test_Scheduler__to_dict <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 73%] 5319s tests/test_scheduler.py::test_TaskState__to_dict <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 73%] 5321s tests/test_scheduler.py::test_get_cluster_state <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 73%] 5321s tests/test_scheduler.py::test_get_cluster_state_worker_error <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 73%] 5321s tests/test_scheduler.py::test_dump_cluster_state[msgpack] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 73%] 5322s tests/test_scheduler.py::test_dump_cluster_state[yaml] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 73%] 5322s tests/test_scheduler.py::test_repr <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 73%] 5323s tests/test_scheduler.py::test_ensure_events_dont_include_taskstate_objects <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 73%] 5323s tests/test_scheduler.py::test_worker_state_unique_regardless_of_address <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 73%] 5323s tests/test_scheduler.py::test_scheduler_close_fast_deprecated <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 73%] 5326s tests/test_scheduler.py::test_runspec_regression_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 73%] 5326s tests/test_scheduler.py::test_KilledWorker_informative_message <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 73%] 5327s tests/test_scheduler.py::test_count_task_prefix <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 73%] 5327s tests/test_scheduler.py::test_transition_waiting_memory <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 73%] 5328s tests/test_scheduler.py::test_deadlock_resubmit_queued_tasks_fast[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 73%] 5328s tests/test_scheduler.py::test_deadlock_resubmit_queued_tasks_fast[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 73%] 5329s tests/test_scheduler.py::test_transition_failure_triggers_log_event <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 73%] 5329s tests/test_scheduler.py::test_deadlock_dependency_of_queued_released_when_worker_replaced[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 73%] 5330s tests/test_scheduler.py::test_deadlock_dependency_of_queued_released_when_worker_replaced[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 73%] 5330s tests/test_scheduler.py::test_deadlock_dependency_of_queued_released_when_worker_removed[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 73%] 5331s tests/test_scheduler.py::test_deadlock_dependency_of_queued_released_when_worker_removed[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 73%] 5331s tests/test_scheduler.py::test_submit_dependency_of_erred_task <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 73%] 5331s tests/test_scheduler.py::test_tell_workers_when_peers_have_left <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 74%] 5332s tests/test_scheduler.py::test_scatter_creates_ts <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 74%] 5332s tests/test_scheduler.py::test_refuse_to_schedule_huge_task[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 74%] 5333s tests/test_scheduler.py::test_refuse_to_schedule_huge_task[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 74%] 5334s tests/test_scheduler.py::test_html_repr <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 74%] 5334s tests/test_scheduler.py::test_resubmit_different_task_same_key_before_previous_is_done[same] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 74%] 5335s tests/test_scheduler.py::test_resubmit_different_task_same_key_before_previous_is_done[less] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 74%] 5335s tests/test_scheduler.py::test_resubmit_different_task_same_key_before_previous_is_done[more] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 74%] 5335s tests/test_scheduler.py::test_resubmit_different_task_same_key_after_previous_is_done[False-same] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 74%] 5336s tests/test_scheduler.py::test_resubmit_different_task_same_key_after_previous_is_done[False-less] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 74%] 5336s tests/test_scheduler.py::test_resubmit_different_task_same_key_after_previous_is_done[False-more] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 74%] 5336s tests/test_scheduler.py::test_resubmit_different_task_same_key_after_previous_is_done[True-same] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 74%] 5336s tests/test_scheduler.py::test_resubmit_different_task_same_key_after_previous_is_done[True-less] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 74%] 5337s tests/test_scheduler.py::test_resubmit_different_task_same_key_after_previous_is_done[True-more] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 74%] 5337s tests/test_scheduler.py::test_resubmit_different_task_same_key_many_clients <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 74%] 5337s tests/test_scheduler.py::test_resubmit_nondeterministic_task_same_deps[before0-123-True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 74%] 5338s tests/test_scheduler.py::test_resubmit_nondeterministic_task_same_deps[123-after1-True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 74%] 5338s tests/test_scheduler.py::test_resubmit_nondeterministic_task_same_deps[before2-after2-False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 74%] 5338s tests/test_scheduler.py::test_resubmit_nondeterministic_task_different_deps[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 74%] 5338s tests/test_scheduler.py::test_resubmit_nondeterministic_task_different_deps[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 74%] 5339s tests/test_scheduler.py::test_resubmit_different_task_same_key_warns_only_once[10-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 74%] 5339s tests/test_scheduler.py::test_resubmit_different_task_same_key_warns_only_once[30-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 74%] 5339s tests/test_scheduler.py::test_fan_out_pattern_deadlock <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 74%] 5340s tests/test_scheduler.py::test_stimulus_from_erred_task <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 74%] 5342s tests/test_scheduler.py::test_concurrent_close_requests <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 74%] 5343s tests/test_scheduler.py::test_rootish_taskgroup_configuration <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 74%] 5343s tests/test_scheduler.py::test_alias_resolving_break_queuing <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 74%] 5343s tests/test_security.py::test_defaults <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_security.py PASSED [ 74%] 5343s tests/test_security.py::test_constructor_errors <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_security.py PASSED [ 74%] 5343s tests/test_security.py::test_attribute_error <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_security.py PASSED [ 74%] 5343s tests/test_security.py::test_from_config <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_security.py PASSED [ 74%] 5343s tests/test_security.py::test_min_max_version_from_config[None-None] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_security.py PASSED [ 74%] 5343s tests/test_security.py::test_min_max_version_from_config[None-1.2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_security.py PASSED [ 75%] 5343s tests/test_security.py::test_min_max_version_from_config[None-1.3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_security.py PASSED [ 75%] 5343s tests/test_security.py::test_min_max_version_from_config[1.2-None] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_security.py PASSED [ 75%] 5343s tests/test_security.py::test_min_max_version_from_config[1.2-1.2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_security.py PASSED [ 75%] 5343s tests/test_security.py::test_min_max_version_from_config[1.2-1.3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_security.py PASSED [ 75%] 5343s tests/test_security.py::test_min_max_version_from_config[1.3-None] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_security.py PASSED [ 75%] 5343s tests/test_security.py::test_min_max_version_from_config[1.3-1.2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_security.py PASSED [ 75%] 5343s tests/test_security.py::test_min_max_version_from_config[1.3-1.3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_security.py PASSED [ 75%] 5343s tests/test_security.py::test_min_max_version_config_errors[min-version] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_security.py PASSED [ 75%] 5343s tests/test_security.py::test_min_max_version_config_errors[max-version] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_security.py PASSED [ 75%] 5343s tests/test_security.py::test_invalid_min_version_from_config_errors <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_security.py PASSED [ 75%] 5343s tests/test_security.py::test_kwargs <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_security.py PASSED [ 75%] 5343s tests/test_security.py::test_min_max_version_kwarg_errors[tls_min_version] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_security.py PASSED [ 75%] 5343s tests/test_security.py::test_min_max_version_kwarg_errors[tls_max_version] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_security.py PASSED [ 75%] 5343s tests/test_security.py::test_repr_temp_keys <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_security.py PASSED [ 75%] 5343s tests/test_security.py::test_repr_local_keys <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_security.py PASSED [ 75%] 5343s tests/test_security.py::test_tls_config_for_role <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_security.py PASSED [ 75%] 5343s tests/test_security.py::test_connection_args <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_security.py PASSED [ 75%] 5343s tests/test_security.py::test_extra_conn_args_connection_args <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_security.py PASSED [ 75%] 5343s tests/test_security.py::test_listen_args <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_security.py PASSED [ 75%] 5344s tests/test_security.py::test_temporary_credentials <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_security.py PASSED [ 75%] 5344s tests/test_security.py::test_extra_conn_args_in_temporary_credentials <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_security.py PASSED [ 75%] 5344s tests/test_semaphore.py::test_semaphore_trivial <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_semaphore.py PASSED [ 75%] 5345s tests/test_semaphore.py::test_serializable <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_semaphore.py PASSED [ 75%] 5345s tests/test_semaphore.py::test_release_simple <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_semaphore.py PASSED [ 75%] 5345s tests/test_semaphore.py::test_acquires_with_timeout <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_semaphore.py PASSED [ 75%] 5348s tests/test_semaphore.py::test_timeout_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_semaphore.py PASSED [ 75%] 5348s tests/test_semaphore.py::test_release_semaphore_after_timeout <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_semaphore.py PASSED [ 75%] 5349s tests/test_semaphore.py::test_async_ctx <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_semaphore.py PASSED [ 75%] 5351s tests/test_semaphore.py::test_worker_dies <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_semaphore.py PASSED [ 75%] 5352s tests/test_semaphore.py::test_access_semaphore_by_name <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_semaphore.py PASSED [ 75%] 5353s tests/test_semaphore.py::test_close_async <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_semaphore.py PASSED [ 75%] 5353s tests/test_semaphore.py::test_release_once_too_many <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_semaphore.py PASSED [ 75%] 5353s tests/test_semaphore.py::test_release_once_too_many_resilience <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_semaphore.py PASSED [ 76%] 5354s tests/test_semaphore.py::test_retry_acquire <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_semaphore.py PASSED [ 76%] 5355s tests/test_semaphore.py::test_oversubscribing_leases <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_semaphore.py PASSED [ 76%] 5355s tests/test_semaphore.py::test_timeout_zero <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_semaphore.py PASSED [ 76%] 5355s tests/test_semaphore.py::test_getvalue <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_semaphore.py PASSED [ 76%] 5356s tests/test_semaphore.py::test_metrics <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_semaphore.py PASSED [ 76%] 5356s tests/test_semaphore.py::test_release_retry <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_semaphore.py PASSED [ 76%] 5356s tests/test_semaphore.py::test_release_failure <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_semaphore.py PASSED [ 76%] 5356s tests/test_semaphore.py::test_unpickle_without_client <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_semaphore.py PASSED [ 76%] 5356s tests/test_sizeof.py::test_safe_sizeof[obj0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_sizeof.py PASSED [ 76%] 5356s tests/test_sizeof.py::test_safe_sizeof[obj1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_sizeof.py PASSED [ 76%] 5356s tests/test_sizeof.py::test_safe_sizeof[obj2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_sizeof.py PASSED [ 76%] 5357s tests/test_sizeof.py::test_safe_sizeof_logs_on_failure <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_sizeof.py PASSED [ 76%] 5357s tests/test_spans.py::test_spans <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_spans.py PASSED [ 76%] 5357s tests/test_spans.py::test_submit <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_spans.py PASSED [ 76%] 5358s tests/test_spans.py::test_multiple_tags <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_spans.py PASSED [ 76%] 5358s tests/test_spans.py::test_repeat_span <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_spans.py PASSED [ 76%] 5358s tests/test_spans.py::test_default_span <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_spans.py PASSED [ 76%] 5361s tests/test_spans.py::test_no_extension <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_spans.py PASSED [ 76%] 5362s tests/test_spans.py::test_task_groups[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_spans.py PASSED [ 76%] 5362s tests/test_spans.py::test_task_groups[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_spans.py PASSED [ 76%] 5363s tests/test_spans.py::test_before_first_task_finished <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_spans.py PASSED [ 76%] 5363s tests/test_spans.py::test_duplicate_task_group <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_spans.py PASSED [ 76%] 5363s tests/test_spans.py::test_mismatched_span[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_spans.py PASSED [ 76%] 5364s tests/test_spans.py::test_mismatched_span[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_spans.py PASSED [ 76%] 5364s tests/test_spans.py::test_no_tags <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_spans.py PASSED [ 76%] 5364s tests/test_spans.py::test_scatter_creates_ts <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_spans.py PASSED [ 76%] 5365s tests/test_spans.py::test_scatter_creates_tg <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_spans.py PASSED [ 76%] 5365s tests/test_spans.py::test_worker_metrics <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_spans.py PASSED [ 76%] 5366s tests/test_spans.py::test_merge_by_tags <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_spans.py PASSED [ 76%] 5366s tests/test_spans.py::test_merge_by_tags_metrics <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_spans.py PASSED [ 76%] 5367s tests/test_spans.py::test_code <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_spans.py PASSED [ 76%] 5367s tests/test_spans.py::test_no_code_by_default <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_spans.py PASSED [ 77%] 5368s tests/test_spans.py::test_merge_all <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_spans.py PASSED [ 77%] 5368s tests/test_spans.py::test_merge_nothing <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_spans.py PASSED [ 77%] 5368s tests/test_spans.py::test_active_cpu_seconds_trivial <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_spans.py PASSED [ 77%] 5369s tests/test_spans.py::test_active_cpu_seconds_not_done[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_spans.py PASSED [ 77%] 5369s tests/test_spans.py::test_active_cpu_seconds_not_done[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_spans.py PASSED [ 77%] 5370s tests/test_spans.py::test_active_cpu_seconds_change_nthreads <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_spans.py PASSED [ 77%] 5371s tests/test_spans.py::test_active_cpu_seconds_merged <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_spans.py PASSED [ 77%] 5371s tests/test_spans.py::test_spans_are_visible_from_tasks <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_spans.py PASSED [ 77%] 5371s tests/test_spans.py::test_span_on_persist <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_spans.py PASSED [ 77%] 5372s tests/test_spans.py::test_collections_metadata <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_spans.py XPASS [ 77%] 5372s tests/test_spec.py::test_address_default_none <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_spec.py PASSED [ 77%] 5372s tests/test_spec.py::test_child_address_persists <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_spec.py PASSED [ 77%] 5372s tests/test_spill.py::test_psize <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_spill.py PASSED [ 77%] 5372s tests/test_spill.py::test_spillbuffer <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_spill.py PASSED [ 77%] 5372s tests/test_spill.py::test_disk_size_calculation <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_spill.py PASSED [ 77%] 5372s tests/test_spill.py::test_spillbuffer_maxlim <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_spill.py PASSED [ 77%] 5372s tests/test_spill.py::test_spillbuffer_fail_to_serialize <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_spill.py PASSED [ 77%] 5372s tests/test_spill.py::test_spillbuffer_evict <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_spill.py PASSED [ 77%] 5372s tests/test_spill.py::test_no_pop <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_spill.py PASSED [ 77%] 5372s tests/test_spill.py::test_weakref_cache[60-SupportsWeakRef-True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_spill.py PASSED [ 77%] 5372s tests/test_spill.py::test_weakref_cache[60-NoWeakRef-False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_spill.py PASSED [ 77%] 5372s tests/test_spill.py::test_weakref_cache[110-SupportsWeakRef-True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_spill.py PASSED [ 77%] 5372s tests/test_spill.py::test_weakref_cache[110-NoWeakRef-False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_spill.py PASSED [ 77%] 5372s tests/test_spill.py::test_metrics <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_spill.py PASSED [ 77%] 5372s tests/test_spill.py::test_compression_settings[zlib-100-500] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_spill.py PASSED [ 77%] 5372s tests/test_spill.py::test_compression_settings[None-20000-20500] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_spill.py PASSED [ 77%] 5372s tests/test_spill.py::test_str_collision <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_spill.py PASSED [ 77%] 5372s tests/test_steal.py::test_work_stealing <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 77%] 5373s tests/test_steal.py::test_dont_steal_expensive_data_fast_computation <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 77%] 5374s tests/test_steal.py::test_steal_cheap_data_slow_computation <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 77%] 5374s tests/test_steal.py::test_steal_expensive_data_slow_computation <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py SKIPPED [ 77%] 5376s tests/test_steal.py::test_worksteal_many_thieves <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 78%] 5377s tests/test_steal.py::test_stop_plugin <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 78%] 5378s tests/test_steal.py::test_stop_in_flight <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 78%] 5379s tests/test_steal.py::test_allow_tasks_stolen_before_first_completes <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 78%] 5380s tests/test_steal.py::test_eventually_steal_unknown_functions <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 78%] 5380s tests/test_steal.py::test_steal_related_tasks <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py SKIPPED [ 78%] 5381s tests/test_steal.py::test_dont_steal_fast_tasks_compute_time <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 78%] 5382s tests/test_steal.py::test_dont_steal_fast_tasks_blocklist <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 78%] 5385s tests/test_steal.py::test_new_worker_steals <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 78%] 5388s tests/test_steal.py::test_work_steal_allow_other_workers <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 78%] 5388s tests/test_steal.py::test_dont_steal_worker_restrictions <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 78%] 5389s tests/test_steal.py::test_steal_worker_restrictions <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 78%] 5389s tests/test_steal.py::test_dont_steal_host_restrictions <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 78%] 5390s tests/test_steal.py::test_steal_host_restrictions <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 78%] 5390s tests/test_steal.py::test_dont_steal_resource_restrictions <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 78%] 5391s tests/test_steal.py::test_steal_resource_restrictions <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 78%] 5391s tests/test_steal.py::test_steal_resource_restrictions_asym_diff <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 78%] 5393s tests/test_steal.py::test_balance_without_dependencies <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 78%] 5394s tests/test_steal.py::test_dont_steal_executing_tasks <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 78%] 5395s tests/test_steal.py::test_dont_steal_executing_tasks_2 <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 78%] 5396s tests/test_steal.py::test_dont_steal_few_saturated_tasks_many_workers <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 78%] 5398s tests/test_steal.py::test_steal_when_more_tasks <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 78%] 5399s tests/test_steal.py::test_steal_more_attractive_tasks <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 78%] 5399s tests/test_steal.py::test_balance[don't move unnecessarily] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 78%] 5399s tests/test_steal.py::test_balance[balance] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 78%] 5400s tests/test_steal.py::test_balance[balance even if results in even] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 78%] 5400s tests/test_steal.py::test_balance[don't over balance] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 78%] 5401s tests/test_steal.py::test_balance[move from larger] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 78%] 5401s tests/test_steal.py::test_balance[move to smaller] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 78%] 5402s tests/test_steal.py::test_balance[choose easier first] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 78%] 5402s tests/test_steal.py::test_balance[spread evenly] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 78%] 5402s tests/test_steal.py::test_balance[move easier] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 78%] 5403s tests/test_steal.py::test_balance[be willing to move costly items] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 78%] 5403s tests/test_steal.py::test_balance[but don't move too many] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 79%] 5404s tests/test_steal.py::test_balance[no one clearly saturated] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 79%] 5405s tests/test_steal.py::test_balance[balance multiple saturated workers] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 79%] 5410s tests/test_steal.py::test_restart <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 79%] 5411s tests/test_steal.py::test_paused_workers_must_not_steal <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 79%] 5412s tests/test_steal.py::test_dont_steal_already_released <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 79%] 5413s tests/test_steal.py::test_dont_steal_long_running_tasks <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 79%] 5415s tests/test_steal.py::test_cleanup_repeated_tasks <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 79%] 5417s tests/test_steal.py::test_lose_task <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 79%] 5417s tests/test_steal.py::test_parse_stealing_interval[None-100] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 79%] 5417s tests/test_steal.py::test_parse_stealing_interval[500ms-500] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 79%] 5417s tests/test_steal.py::test_parse_stealing_interval[2-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 79%] 5422s tests/test_steal.py::test_balance_with_longer_task <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 79%] 5424s tests/test_steal.py::test_blocklist_shuffle_split <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 79%] 5424s tests/test_steal.py::test_steal_concurrent_simple <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 79%] 5425s tests/test_steal.py::test_steal_reschedule_reset_in_flight_occupancy <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 79%] 5426s tests/test_steal.py::test_get_story <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 79%] 5427s tests/test_steal.py::test_steal_worker_dies_same_ip <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 79%] 5428s tests/test_steal.py::test_reschedule_concurrent_requests_deadlock <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 79%] 5428s tests/test_steal.py::test_correct_bad_time_estimate <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py SKIPPED [ 79%] 5430s tests/test_steal.py::test_steal_stimulus_id_unique <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 79%] 5430s tests/test_steal.py::test_steal_worker_state[executing] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 79%] 5430s tests/test_steal.py::test_steal_worker_state[long-running] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 79%] 5430s tests/test_steal.py::test_steal_very_fast_tasks <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py SKIPPED [ 79%] 5431s tests/test_steal.py::test_balance_expensive_tasks[not enough work to steal] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 79%] 5432s tests/test_steal.py::test_balance_expensive_tasks[enough work to steal] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 79%] 5433s tests/test_steal.py::test_balance_expensive_tasks[not enough work for increased cost] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 79%] 5433s tests/test_steal.py::test_balance_uneven_without_replica <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 79%] 5434s tests/test_steal.py::test_balance_eventually_steals_large_dependency_without_replica <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 79%] 5435s tests/test_steal.py::test_balance_even_with_replica <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 79%] 5438s tests/test_steal.py::test_balance_to_replica <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 79%] 5441s tests/test_steal.py::test_balance_multiple_to_replica <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 79%] 5445s tests/test_steal.py::test_balance_to_larger_dependency <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 80%] 5448s tests/test_steal.py::test_balance_prefers_busier_with_dependency <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 80%] 5453s tests/test_steal.py::test_trivial_workload_should_not_cause_work_stealing <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 80%] 5453s tests/test_stories.py::test_scheduler_story_stimulus_success <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_stories.py PASSED [ 80%] 5453s tests/test_stories.py::test_scheduler_story_stimulus_retry <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_stories.py PASSED [ 80%] 5453s tests/test_stories.py::test_client_story <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_stories.py PASSED [ 80%] 5454s tests/test_stories.py::test_client_story_failed_worker[ignore] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_stories.py PASSED [ 80%] 5454s tests/test_stories.py::test_client_story_failed_worker[raise] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_stories.py PASSED [ 80%] 5454s tests/test_stories.py::test_worker_story_with_deps <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_stories.py PASSED [ 80%] 5455s tests/test_stress.py::test_stress_1 <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_stress.py PASSED [ 80%] 5455s tests/test_stress.py::test_stress_gc[slowinc-100] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_stress.py SKIPPED [ 80%] 5455s tests/test_stress.py::test_stress_gc[inc-1000] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_stress.py SKIPPED [ 80%] 5466s tests/test_stress.py::test_cancel_stress <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_stress.py PASSED [ 80%] 5473s tests/test_stress.py::test_cancel_stress_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_stress.py PASSED [ 80%] 5473s tests/test_stress.py::test_stress_creation_and_deletion <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_stress.py SKIPPED [ 80%] 5475s tests/test_stress.py::test_stress_scatter_death <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_stress.py PASSED [ 80%] 5475s tests/test_stress.py::test_stress_steal <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_stress.py SKIPPED [ 80%] 5475s tests/test_stress.py::test_close_connections <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_stress.py SKIPPED [ 80%] 5475s tests/test_stress.py::test_no_delay_during_large_transfer <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_stress.py SKIPPED [ 80%] 5475s tests/test_stress.py::test_chaos_rechunk <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_stress.py SKIPPED [ 80%] 5475s tests/test_system.py::test_memory_limit <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_system.py PASSED [ 80%] 5475s tests/test_system.py::test_hard_memory_limit_cgroups <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_system.py PASSED [ 80%] 5475s tests/test_system.py::test_soft_memory_limit_cgroups <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_system.py PASSED [ 80%] 5475s tests/test_system.py::test_hard_memory_limit_cgroups2 <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_system.py PASSED [ 80%] 5475s tests/test_system.py::test_soft_memory_limit_cgroups2 <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_system.py PASSED [ 80%] 5475s tests/test_system.py::test_softest_memory_limit_cgroups2 <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_system.py PASSED [ 80%] 5475s tests/test_system.py::test_rlimit <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_system.py PASSED [ 80%] 5475s tests/test_system_monitor.py::test_SystemMonitor <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_system_monitor.py PASSED [ 80%] 5475s tests/test_system_monitor.py::test_maxlen_zero <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_system_monitor.py PASSED [ 80%] 5475s tests/test_system_monitor.py::test_count <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_system_monitor.py PASSED [ 80%] 5475s tests/test_system_monitor.py::test_range_query <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_system_monitor.py PASSED [ 80%] 5475s tests/test_system_monitor.py::test_disk_config <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_system_monitor.py PASSED [ 80%] 5475s tests/test_system_monitor.py::test_host_cpu <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_system_monitor.py PASSED [ 81%] 5475s tests/test_system_monitor.py::test_gil_contention <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_system_monitor.py SKIPPED [ 81%] 5475s tests/test_threadpoolexecutor.py::test_tpe <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_threadpoolexecutor.py PASSED [ 81%] 5476s tests/test_threadpoolexecutor.py::test_shutdown_timeout <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_threadpoolexecutor.py PASSED [ 81%] 5476s tests/test_threadpoolexecutor.py::test_shutdown_timeout_raises <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_threadpoolexecutor.py PASSED [ 81%] 5476s tests/test_threadpoolexecutor.py::test_shutdown_wait <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_threadpoolexecutor.py PASSED [ 81%] 5477s tests/test_threadpoolexecutor.py::test_secede_rejoin_busy <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_threadpoolexecutor.py PASSED [ 81%] 5477s tests/test_threadpoolexecutor.py::test_secede_rejoin_quiet <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_threadpoolexecutor.py PASSED [ 81%] 5477s tests/test_threadpoolexecutor.py::test_rejoin_idempotent <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_threadpoolexecutor.py PASSED [ 81%] 5477s tests/test_threadpoolexecutor.py::test_thread_name <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_threadpoolexecutor.py PASSED [ 81%] 5478s tests/test_tls_functional.py::test_basic <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_tls_functional.py PASSED [ 81%] 5478s tests/test_tls_functional.py::test_Queue <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_tls_functional.py PASSED [ 81%] 5480s tests/test_tls_functional.py::test_client_submit <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_tls_functional.py PASSED [ 81%] 5481s tests/test_tls_functional.py::test_gather <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_tls_functional.py PASSED [ 81%] 5481s tests/test_tls_functional.py::test_scatter <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_tls_functional.py PASSED [ 81%] 5542s tests/test_tls_functional.py::test_nanny <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_tls_functional.py FAILED [ 81%] 5542s tests/test_tls_functional.py::test_rebalance <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_tls_functional.py PASSED [ 81%] 5544s tests/test_tls_functional.py::test_work_stealing <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_tls_functional.py PASSED [ 81%] 5544s tests/test_tls_functional.py::test_worker_client <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_tls_functional.py PASSED [ 81%] 5545s tests/test_tls_functional.py::test_worker_client_gather <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_tls_functional.py PASSED [ 81%] 5545s tests/test_tls_functional.py::test_worker_client_executor <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_tls_functional.py PASSED [ 81%] 5606s tests/test_tls_functional.py::test_retire_workers <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_tls_functional.py FAILED [ 81%] 5606s tests/test_tls_functional.py::test_security_dict_input <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_tls_functional.py PASSED [ 81%] 5606s tests/test_utils.py::test_All <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 81%] 5606s tests/test_utils.py::test_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 81%] 5606s tests/test_utils.py::test_sync_error <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 81%] 5606s tests/test_utils.py::test_sync_timeout <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 81%] 5606s tests/test_utils.py::test_sync_closed_loop <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 81%] 5606s tests/test_utils.py::test_sync_contextvars <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 81%] 5606s tests/test_utils.py::test_is_kernel <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py SKIPPED [ 81%] 5606s tests/test_utils.py::test_ensure_ip <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 81%] 5606s tests/test_utils.py::test_get_ip_interface <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 81%] 5606s tests/test_utils.py::test_get_mp_context <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 81%] 5606s tests/test_utils.py::test_truncate_exception <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 82%] 5606s tests/test_utils.py::test_get_traceback <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 82%] 5606s tests/test_utils.py::test_read_block <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 82%] 5606s tests/test_utils.py::test_seek_delimiter_endline <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 82%] 5607s tests/test_utils.py::test_ensure_memoryview[] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 82%] 5607s tests/test_utils.py::test_ensure_memoryview[data1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 82%] 5607s tests/test_utils.py::test_ensure_memoryview[1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 82%] 5607s tests/test_utils.py::test_ensure_memoryview[data3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 82%] 5607s tests/test_utils.py::test_ensure_memoryview[data4] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 82%] 5607s tests/test_utils.py::test_ensure_memoryview[data5] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 82%] 5607s tests/test_utils.py::test_ensure_memoryview[data6] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 82%] 5607s tests/test_utils.py::test_ensure_memoryview[data7] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 82%] 5607s tests/test_utils.py::test_ensure_memoryview[data8] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 82%] 5607s tests/test_utils.py::test_ensure_memoryview[data9] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 82%] 5607s tests/test_utils.py::test_ensure_memoryview[data10] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 82%] 5607s tests/test_utils.py::test_ensure_memoryview[data11] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 82%] 5607s tests/test_utils.py::test_ensure_memoryview[data12] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 82%] 5607s tests/test_utils.py::test_ensure_memoryview[data13] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 82%] 5607s tests/test_utils.py::test_ensure_memoryview[data14] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 82%] 5607s tests/test_utils.py::test_ensure_memoryview_ndarray[i8-12-shape0-strides0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 82%] 5607s tests/test_utils.py::test_ensure_memoryview_ndarray[i8-12-shape1-strides1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 82%] 5607s tests/test_utils.py::test_ensure_memoryview_ndarray[i8-12-shape2-strides2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 82%] 5607s tests/test_utils.py::test_ensure_memoryview_ndarray[i8-12-shape3-strides3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 82%] 5607s tests/test_utils.py::test_ensure_memoryview_ndarray[i8-12-shape4-strides4] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 82%] 5607s tests/test_utils.py::test_ensure_memoryview_pyarrow_buffer <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py SKIPPED [ 82%] 5607s tests/test_utils.py::test_nbytes <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 82%] 5607s tests/test_utils.py::test_open_port <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 82%] 5607s tests/test_utils.py::test_set_thread_state <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 82%] 5607s tests/test_utils.py::test_loop_runner <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 82%] 5607s tests/test_utils.py::test_two_loop_runners <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 82%] 5607s tests/test_utils.py::test_loop_runner_gen <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 82%] 5607s tests/test_utils.py::test_loop_runner_exception_in_start <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 82%] 5607s tests/test_utils.py::test_loop_runner_exception_in_teardown <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 83%] 5607s tests/test_utils.py::test_all_quiet_exceptions <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 83%] 5607s tests/test_utils.py::test_warn_on_duration <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 83%] 5607s tests/test_utils.py::test_logs <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 83%] 5607s tests/test_utils.py::test_is_valid_xml <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 83%] 5607s tests/test_utils.py::test_format_dashboard_link <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 83%] 5607s tests/test_utils.py::test_parse_ports <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 83%] 5607s tests/test_utils.py::test_run_in_executor_with_context <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 83%] 5607s tests/test_utils.py::test_run_in_executor_with_context_preserves_contextvars <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 83%] 5607s tests/test_utils.py::test_offload <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 83%] 5607s tests/test_utils.py::test_offload_preserves_contextvars <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 83%] 5607s tests/test_utils.py::test_no_default_deprecated <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 83%] 5607s tests/test_utils.py::test_iscoroutinefunction_unhashable_input <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 83%] 5607s tests/test_utils.py::test_iscoroutinefunction_nested_partial <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 83%] 5607s tests/test_utils.py::test_recursive_to_dict <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 83%] 5607s tests/test_utils.py::test_recursive_to_dict_no_nest <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 83%] 5607s tests/test_utils.py::test_log_errors <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 83%] 5607s tests/test_utils.py::test_log_errors_unroll_stack[0-test_utils] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 83%] 5607s tests/test_utils.py::test_log_errors_unroll_stack[1-a.b.c] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 83%] 5607s tests/test_utils.py::test_load_json_robust_timeout <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 83%] 5607s tests/test_utils.py::test_rate_limiter_filter <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 83%] 5607s tests/test_utils.py::test_tuple_comparable_lt[obj10-obj20-False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 83%] 5607s tests/test_utils.py::test_tuple_comparable_lt[obj11-obj21-True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 83%] 5607s tests/test_utils.py::test_tuple_comparable_lt[1-1-False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 83%] 5607s tests/test_utils.py::test_tuple_comparable_lt[1-2-True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 83%] 5607s tests/test_utils.py::test_tuple_comparable_lt[None-0-False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 83%] 5607s tests/test_utils.py::test_tuple_comparable_lt[None-obj25-True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 83%] 5607s tests/test_utils.py::test_tuple_comparable_eq[obj10-obj20-True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 83%] 5607s tests/test_utils.py::test_tuple_comparable_eq[obj11-obj21-False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 83%] 5607s tests/test_utils.py::test_tuple_comparable_eq[1-1-True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 83%] 5607s tests/test_utils.py::test_tuple_comparable_eq[1-2-False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 83%] 5607s tests/test_utils.py::test_tuple_comparable_eq[None-0-True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 83%] 5607s tests/test_utils.py::test_tuple_comparable_eq[None-obj25-False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 84%] 5607s tests/test_utils.py::test_tuple_comparable_error <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 84%] 5607s tests/test_utils_comm.py::test_pack_data <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_comm.py PASSED [ 84%] 5607s tests/test_utils_comm.py::test_subs_multiple <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_comm.py PASSED [ 84%] 5609s tests/test_utils_comm.py::test_gather_from_workers_missing_replicas <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_comm.py PASSED [ 84%] 5609s tests/test_utils_comm.py::test_gather_from_workers_permissive <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_comm.py PASSED [ 84%] 5609s tests/test_utils_comm.py::test_gather_from_workers_permissive_flaky <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_comm.py PASSED [ 84%] 5610s tests/test_utils_comm.py::test_gather_from_workers_busy <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_comm.py PASSED [ 84%] 5610s tests/test_utils_comm.py::test_gather_from_workers_serialization_error[pickle] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_comm.py PASSED [ 84%] 5611s tests/test_utils_comm.py::test_gather_from_workers_serialization_error[unpickle] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_comm.py PASSED [ 84%] 5611s tests/test_utils_comm.py::test_retry_no_exception <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_comm.py PASSED [ 84%] 5611s tests/test_utils_comm.py::test_retry0_raises_immediately <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_comm.py PASSED [ 84%] 5611s tests/test_utils_comm.py::test_retry_does_retry_and_sleep <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_comm.py PASSED [ 84%] 5611s tests/test_utils_comm.py::test_unpack_remotedata <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_comm.py PASSED [ 84%] 5618s tests/test_utils_test.py::test_bare_cluster <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 84%] 5618s tests/test_utils_test.py::test_gen_cluster <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 84%] 5618s tests/test_utils_test.py::test_gen_cluster_pytest_fixture <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 84%] 5619s tests/test_utils_test.py::test_gen_cluster_parametrized[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 84%] 5619s tests/test_utils_test.py::test_gen_cluster_multi_parametrized[a-True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 84%] 5620s tests/test_utils_test.py::test_gen_cluster_multi_parametrized[b-True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 84%] 5620s tests/test_utils_test.py::test_gen_cluster_parametrized_variadic_workers[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 84%] 5623s tests/test_utils_test.py::test_gen_cluster_set_config_nanny <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 84%] 5623s tests/test_utils_test.py::test_gen_cluster_cleans_up_client <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py SKIPPED [ 84%] 5623s tests/test_utils_test.py::test_gen_cluster_without_client <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 84%] 5624s tests/test_utils_test.py::test_gen_cluster_tls <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 84%] 5624s tests/test_utils_test.py::test_gen_cluster_validate <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 84%] 5624s tests/test_utils_test.py::test_gen_cluster_validate_override <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 84%] 5624s tests/test_utils_test.py::test_gen_test <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py XFAILn) [ 84%] 5624s tests/test_utils_test.py::test_gen_test_legacy_implicit <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py XFAIL [ 84%] 5624s tests/test_utils_test.py::test_gen_test_legacy_explicit <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py XFAIL [ 84%] 5624s tests/test_utils_test.py::test_gen_test_parametrized[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 84%] 5624s tests/test_utils_test.py::test_gen_test_double_parametrized[False-True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 84%] 5624s tests/test_utils_test.py::test_gen_test_pytest_fixture <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 84%] 5624s tests/test_utils_test.py::test_gen_test_config <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 85%] 5624s tests/test_utils_test.py::test_gen_test_config_default <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 85%] 5624s tests/test_utils_test.py::test_new_config <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 85%] 5625s tests/test_utils_test.py::test_lingering_client <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 85%] 5628s tests/test_utils_test.py::test_lingering_client_2 <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 85%] 5631s tests/test_utils_test.py::test_tls_cluster <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 85%] 5631s tests/test_utils_test.py::test_tls_scheduler <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 85%] 5631s tests/test_utils_test.py::test__UnhashableCallable <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 85%] 5631s tests/test_utils_test.py::test_assert_story <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 85%] 5631s tests/test_utils_test.py::test_assert_story_malformed_story[Missing payload, stimulus_id, ts] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 85%] 5631s tests/test_utils_test.py::test_assert_story_malformed_story[Missing (stimulus_id, ts)] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 85%] 5631s tests/test_utils_test.py::test_assert_story_malformed_story[Missing ts] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 85%] 5631s tests/test_utils_test.py::test_assert_story_malformed_story[ts is not a float] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 85%] 5631s tests/test_utils_test.py::test_assert_story_malformed_story[ts is in the future] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 85%] 5631s tests/test_utils_test.py::test_assert_story_malformed_story[ts is too old] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 85%] 5631s tests/test_utils_test.py::test_assert_story_malformed_story[stimulus_id is not a str] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 85%] 5631s tests/test_utils_test.py::test_assert_story_malformed_story[stimulus_id is an empty str] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 85%] 5631s tests/test_utils_test.py::test_assert_story_malformed_story[no payload] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 85%] 5631s tests/test_utils_test.py::test_assert_story_malformed_story[timestamps out of order] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 85%] 5631s tests/test_utils_test.py::test_assert_story_identity[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 85%] 5631s tests/test_utils_test.py::test_assert_story_identity[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 85%] 5633s tests/test_utils_test.py::test_check_process_leak <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 85%] 5635s tests/test_utils_test.py::test_check_process_leak_slow_cleanup <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 85%] 5637s tests/test_utils_test.py::test_check_process_leak_pre_cleanup[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 85%] 5639s tests/test_utils_test.py::test_check_process_leak_pre_cleanup[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 85%] 5640s tests/test_utils_test.py::test_check_process_leak_post_cleanup[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 85%] 5642s tests/test_utils_test.py::test_check_process_leak_post_cleanup[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 85%] 5646s tests/test_utils_test.py::test_start_failure_worker[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 85%] 5647s tests/test_utils_test.py::test_start_failure_worker[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 85%] 5649s tests/test_utils_test.py::test_start_failure_scheduler <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 85%] 5650s tests/test_utils_test.py::test_invalid_transitions <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 85%] 5650s tests/test_utils_test.py::test_invalid_worker_state <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 85%] 5650s tests/test_utils_test.py::test_raises_with_cause <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 86%] 5650s tests/test_utils_test.py::test_check_thread_leak <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py SKIPPED [ 86%] 5650s tests/test_utils_test.py::test_fail_hard[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 86%] 5650s tests/test_utils_test.py::test_fail_hard[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 86%] 5650s tests/test_utils_test.py::test_popen_write_during_terminate_deadlock <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 86%] 5660s tests/test_utils_test.py::test_popen_timeout <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 86%] 5660s tests/test_utils_test.py::test_popen_always_prints_output <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 86%] 5661s tests/test_utils_test.py::test_wait_for_state <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 86%] 5661s tests/test_utils_test.py::test_wait_for_stimulus <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 86%] 5661s tests/test_utils_test.py::test_ws_with_running_task[executing] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 86%] 5661s tests/test_utils_test.py::test_ws_with_running_task[long-running] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 86%] 5661s tests/test_utils_test.py::test_sizeof <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 86%] 5661s tests/test_utils_test.py::test_sizeof_error[12345.0-TypeError-Expected integer] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 86%] 5661s tests/test_utils_test.py::test_sizeof_error[-1-ValueError-larger than] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 86%] 5661s tests/test_utils_test.py::test_sizeof_error[0-ValueError-larger than] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 86%] 5661s tests/test_utils_test.py::test_sizeof_error[10-ValueError-larger than] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 86%] 5661s tests/test_utils_test.py::test_captured_logger <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 86%] 5661s tests/test_utils_test.py::test_captured_context_meter <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 86%] 5662s tests/test_variable.py::test_variable <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_variable.py PASSED [ 86%] 5663s tests/test_variable.py::test_delete_unset_variable <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_variable.py PASSED [ 86%] 5663s tests/test_variable.py::test_queue_with_data <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_variable.py PASSED [ 86%] 5666s tests/test_variable.py::test_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_variable.py PASSED [ 86%] 5666s tests/test_variable.py::test_hold_futures <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_variable.py PASSED [ 86%] 5667s tests/test_variable.py::test_timeout <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_variable.py PASSED [ 86%] 5670s tests/test_variable.py::test_timeout_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_variable.py PASSED [ 86%] 5671s tests/test_variable.py::test_cleanup <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_variable.py PASSED [ 86%] 5674s tests/test_variable.py::test_pickleable <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_variable.py PASSED [ 86%] 5675s tests/test_variable.py::test_timeout_get <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_variable.py PASSED [ 86%] 5675s tests/test_variable.py::test_race <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_variable.py SKIPPED [ 86%] 5675s tests/test_variable.py::test_Future_knows_status_immediately <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_variable.py PASSED [ 86%] 5676s tests/test_variable.py::test_erred_future <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_variable.py PASSED [ 86%] 5679s tests/test_variable.py::test_future_erred_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_variable.py PASSED [ 86%] 5679s tests/test_variable.py::test_variables_do_not_leak_client <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_variable.py PASSED [ 87%] 5680s tests/test_variable.py::test_unpickle_without_client <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_variable.py PASSED [ 87%] 5680s tests/test_variable.py::test_set_cancelled_future <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_variable.py PASSED [ 87%] 5680s tests/test_versions.py::test_versions_match <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_versions.py PASSED [ 87%] 5680s tests/test_versions.py::test_version_mismatch[source-MISMATCHED] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_versions.py PASSED [ 87%] 5680s tests/test_versions.py::test_version_mismatch[source-MISSING] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_versions.py PASSED [ 87%] 5680s tests/test_versions.py::test_version_mismatch[source-KEY_ERROR] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_versions.py PASSED [ 87%] 5681s tests/test_versions.py::test_version_mismatch[source-NONE] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_versions.py PASSED [ 87%] 5681s tests/test_versions.py::test_version_mismatch[scheduler-MISMATCHED] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_versions.py PASSED [ 87%] 5681s tests/test_versions.py::test_version_mismatch[scheduler-MISSING] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_versions.py PASSED [ 87%] 5681s tests/test_versions.py::test_version_mismatch[scheduler-KEY_ERROR] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_versions.py PASSED [ 87%] 5681s tests/test_versions.py::test_version_mismatch[scheduler-NONE] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_versions.py PASSED [ 87%] 5682s tests/test_versions.py::test_version_mismatch[worker-1-MISMATCHED] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_versions.py PASSED [ 87%] 5682s tests/test_versions.py::test_version_mismatch[worker-1-MISSING] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_versions.py PASSED [ 87%] 5682s tests/test_versions.py::test_version_mismatch[worker-1-KEY_ERROR] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_versions.py PASSED [ 87%] 5682s tests/test_versions.py::test_version_mismatch[worker-1-NONE] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_versions.py PASSED [ 87%] 5682s tests/test_versions.py::test_scheduler_mismatched_irrelevant_package <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_versions.py PASSED [ 87%] 5682s tests/test_versions.py::test_scheduler_additional_irrelevant_package <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_versions.py PASSED [ 87%] 5682s tests/test_versions.py::test_python_mismatch[source] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_versions.py PASSED [ 87%] 5683s tests/test_versions.py::test_python_mismatch[scheduler] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_versions.py PASSED [ 87%] 5683s tests/test_versions.py::test_python_mismatch[worker-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_versions.py PASSED [ 87%] 5683s tests/test_versions.py::test_version_warning_in_cluster <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_versions.py PASSED [ 87%] 5683s tests/test_versions.py::test_python_version <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_versions.py PASSED [ 87%] 5683s tests/test_versions.py::test_version_custom_pkgs <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_versions.py PASSED [ 87%] 5684s tests/test_worker.py::test_worker_nthreads <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 87%] 5684s tests/test_worker.py::test_str <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 87%] 5684s tests/test_worker.py::test_identity <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 87%] 5685s tests/test_worker.py::test_worker_bad_args <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 87%] 5687s tests/test_worker.py::test_upload_file <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 87%] 5687s tests/test_worker.py::test_upload_file_pyc <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py SKIPPED [ 87%] 5688s tests/test_worker.py::test_upload_egg <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 87%] 5688s tests/test_worker.py::test_upload_pyz <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 87%] 5688s tests/test_worker.py::test_upload_large_file <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py SKIPPED [ 87%] 5689s tests/test_worker.py::test_broadcast <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 88%] 5689s tests/test_worker.py::test_worker_with_port_zero <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 88%] 5689s tests/test_worker.py::test_worker_port_range <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 88%] 5689s tests/test_worker.py::test_worker_waits_for_scheduler <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py SKIPPED [ 88%] 5689s tests/test_worker.py::test_worker_task_data <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 88%] 5689s tests/test_worker.py::test_error_message <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 88%] 5690s tests/test_worker.py::test_chained_error_message <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 88%] 5690s tests/test_worker.py::test_base_exception_in_task[BaseException-True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py SKIPPED [ 88%] 5690s tests/test_worker.py::test_base_exception_in_task[BaseException-False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py SKIPPED [ 88%] 5690s tests/test_worker.py::test_base_exception_in_task[SystemExit-True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py SKIPPED [ 88%] 5690s tests/test_worker.py::test_base_exception_in_task[SystemExit-False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py SKIPPED [ 88%] 5690s tests/test_worker.py::test_base_exception_in_task[KeyboardInterrupt-True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py SKIPPED [ 88%] 5690s tests/test_worker.py::test_base_exception_in_task[KeyboardInterrupt-False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py SKIPPED [ 88%] 5690s tests/test_worker.py::test_base_exception_in_task[CancelledError-True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py SKIPPED [ 88%] 5690s tests/test_worker.py::test_base_exception_in_task[CancelledError-False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py SKIPPED [ 88%] 5690s tests/test_worker.py::test_gather <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 88%] 5691s tests/test_worker.py::test_gather_missing_keys <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 88%] 5691s tests/test_worker.py::test_gather_missing_workers <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 88%] 5691s tests/test_worker.py::test_gather_missing_workers_replicated[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py SKIPPED [ 88%] 5691s tests/test_worker.py::test_gather_missing_workers_replicated[True0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py SKIPPED [ 88%] 5691s tests/test_worker.py::test_gather_missing_workers_replicated[True1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py SKIPPED [ 88%] 5691s tests/test_worker.py::test_gather_missing_workers_replicated[True2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py SKIPPED [ 88%] 5691s tests/test_worker.py::test_gather_missing_workers_replicated[True3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py SKIPPED [ 88%] 5691s tests/test_worker.py::test_io_loop <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 88%] 5691s tests/test_worker.py::test_io_loop_alternate_loop <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 88%] 5692s tests/test_worker.py::test_access_key <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 88%] 5692s tests/test_worker.py::test_run_dask_worker <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 88%] 5693s tests/test_worker.py::test_run_dask_worker_kwonlyarg <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 88%] 5693s tests/test_worker.py::test_run_coroutine_dask_worker <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 88%] 5693s tests/test_worker.py::test_Executor <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 88%] 5693s tests/test_worker.py::test_close_on_disconnect <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 88%] 5694s tests/test_worker.py::test_memory_limit_auto <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 88%] 5694s tests/test_worker.py::test_inter_worker_communication <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 89%] 5695s tests/test_worker.py::test_clean <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 89%] 5695s tests/test_worker.py::test_message_breakup <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 89%] 5696s tests/test_worker.py::test_types <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 89%] 5696s tests/test_worker.py::test_system_monitor <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 89%] 5696s tests/test_worker.py::test_restrictions <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 89%] 5698s tests/test_worker.py::test_clean_nbytes <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 89%] 5700s tests/test_worker.py::test_gather_many_small[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 89%] 5703s tests/test_worker.py::test_gather_many_small[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 89%] 5704s tests/test_worker.py::test_multiple_transfers <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 89%] 5704s tests/test_worker.py::test_share_communication <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py XFAIL [ 89%] 5705s tests/test_worker.py::test_dont_overlap_communications_to_same_worker <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py XFAIL [ 89%] 5705s tests/test_worker.py::test_log_exception_on_failed_task <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 89%] 5706s tests/test_worker.py::test_clean_up_dependencies <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 89%] 5706s tests/test_worker.py::test_hold_onto_dependents <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 89%] 5706s tests/test_worker.py::test_worker_death_timeout <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py XPASS [ 89%] 5707s tests/test_worker.py::test_stop_doing_unnecessary_work <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 89%] 5708s tests/test_worker.py::test_priorities <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 89%] 5709s tests/test_worker.py::test_heartbeats <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 89%] 5709s tests/test_worker.py::test_worker_dir[Worker] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 89%] 5710s tests/test_worker.py::test_worker_dir[Nanny] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 89%] 5712s tests/test_worker.py::test_default_worker_dir <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 89%] 5712s tests/test_worker.py::test_dataframe_attribute_error <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 89%] 5713s tests/test_worker.py::test_pid <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 89%] 5713s tests/test_worker.py::test_get_client <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 89%] 5716s tests/test_worker.py::test_get_client_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 89%] 5717s tests/test_worker.py::test_get_client_coroutine <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 89%] 5720s tests/test_worker.py::test_get_client_coroutine_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py XFAIL/distributed/pull/7339) [ 89%] 5721s tests/test_worker.py::test_global_workers <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 89%] 5721s tests/test_worker.py::test_worker_fds <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 89%] 5721s tests/test_worker.py::test_service_hosts_match_worker <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 89%] 5722s tests/test_worker.py::test_start_services <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 89%] 5724s tests/test_worker.py::test_scheduler_delay <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 90%] 5725s tests/test_worker.py::test_statistical_profiling <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 90%] 5725s tests/test_worker.py::test_statistical_profiling_2 <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py SKIPPED [ 90%] 5726s tests/test_worker.py::test_statistical_profiling_cycle <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 90%] 5726s tests/test_worker.py::test_get_current_task <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 90%] 5726s tests/test_worker.py::test_deque_handler <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 90%] 5726s tests/test_worker.py::test_scheduler_address_config <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 90%] 5726s tests/test_worker.py::test_wait_for_outgoing <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py SKIPPED [ 90%] 5727s tests/test_worker.py::test_prefer_gather_from_local_address <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 90%] 5730s tests/test_worker.py::test_avoid_oversubscription <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 90%] 5731s tests/test_worker.py::test_custom_metrics <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 90%] 5732s tests/test_worker.py::test_register_worker_callbacks <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 90%] 5732s tests/test_worker.py::test_register_worker_callbacks_err <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 90%] 5732s tests/test_worker.py::test_local_directory <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 90%] 5732s tests/test_worker.py::test_local_directory_make_new_directory <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 90%] 5735s tests/test_worker.py::test_host_address <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 90%] 5735s tests/test_worker.py::test_interface_async[Worker] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 90%] 5737s tests/test_worker.py::test_interface_async[Nanny] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 90%] 5738s tests/test_worker.py::test_protocol_from_scheduler_address[Worker] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py SKIPPED [ 90%] 5738s tests/test_worker.py::test_protocol_from_scheduler_address[Nanny] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py SKIPPED [ 90%] 5738s tests/test_worker.py::test_worker_listens_on_same_interface_by_default[Worker] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 90%] 5740s tests/test_worker.py::test_worker_listens_on_same_interface_by_default[Nanny] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 90%] 5740s tests/test_worker.py::test_close_gracefully <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py SKIPPED [ 90%] 5740s tests/test_worker.py::test_close_gracefully_no_suspicious_tasks <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py SKIPPED [ 90%] 5740s tests/test_worker.py::test_close_while_executing[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 90%] 5740s tests/test_worker.py::test_close_while_executing[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py SKIPPED [ 90%] 5740s tests/test_worker.py::test_close_async_task_handles_cancellation <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py SKIPPED [ 90%] 5740s tests/test_worker.py::test_lifetime <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py SKIPPED [ 90%] 5740s tests/test_worker.py::test_lifetime_stagger <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 90%] 5741s tests/test_worker.py::test_bad_metrics <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 90%] 5741s tests/test_worker.py::test_bad_startup <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 90%] 5741s tests/test_worker.py::test_update_latency <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 90%] 5741s tests/test_worker.py::test_workerstate_executing <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py SKIPPED [ 90%] 5741s tests/test_worker.py::test_shutdown_on_scheduler_comm_closed <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 91%] 5741s tests/test_worker.py::test_heartbeat_comm_closed <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 91%] 5741s tests/test_worker.py::test_heartbeat_missing <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 91%] 5742s tests/test_worker.py::test_heartbeat_missing_real_cluster <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 91%] 5742s tests/test_worker.py::test_heartbeat_missing_doesnt_restart <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py SKIPPED [ 91%] 5742s tests/test_worker.py::test_bad_local_directory <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 91%] 5742s tests/test_worker.py::test_taskstate_metadata <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 91%] 5742s tests/test_worker.py::test_executor_offload <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 91%] 5743s tests/test_worker.py::test_story <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 91%] 5743s tests/test_worker.py::test_stimulus_story <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 91%] 5745s tests/test_worker.py::test_worker_descopes_data <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 91%] 5746s tests/test_worker.py::test_gather_dep_one_worker_always_busy <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 91%] 5748s tests/test_worker.py::test_gather_dep_local_workers_first <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 91%] 5750s tests/test_worker.py::test_gather_dep_from_remote_workers_if_all_local_workers_are_busy <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 91%] 5750s tests/test_worker.py::test_worker_client_uses_default_no_close <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 91%] 5750s tests/test_worker.py::test_worker_client_closes_if_created_on_worker_one_worker <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 91%] 5751s tests/test_worker.py::test_worker_client_closes_if_created_on_worker_last_worker_alive <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 91%] 5751s tests/test_worker.py::test_multiple_executors <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 91%] 5752s tests/test_worker.py::test_bad_executor_annotation <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 91%] 5754s tests/test_worker.py::test_process_executor <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 91%] 5756s tests/test_worker.py::test_process_executor_raise_exception <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 91%] 5757s tests/test_worker.py::test_worker_state_error_release_error_last <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 91%] 5757s tests/test_worker.py::test_worker_state_error_release_error_first <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 91%] 5758s tests/test_worker.py::test_worker_state_error_release_error_int <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 91%] 5759s tests/test_worker.py::test_worker_state_error_long_chain <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 91%] 5760s tests/test_worker.py::test_hold_on_to_replicas <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 91%] 5760s tests/test_worker.py::test_forget_dependents_after_release <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 91%] 5761s tests/test_worker.py::test_acquire_replicas <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 91%] 5761s tests/test_worker.py::test_acquire_replicas_same_channel <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 91%] 5763s tests/test_worker.py::test_acquire_replicas_many <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 91%] 5763s tests/test_worker.py::test_acquire_replicas_already_in_flight <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 91%] 5763s tests/test_worker.py::test_forget_acquire_replicas <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py SKIPPED [ 91%] 5764s tests/test_worker.py::test_remove_replicas_simple <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 92%] 5764s tests/test_worker.py::test_who_has_consistent_remove_replicas <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 92%] 5765s tests/test_worker.py::test_acquire_replicas_with_no_priority <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 92%] 5765s tests/test_worker.py::test_acquire_replicas_large_data <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 92%] 5766s tests/test_worker.py::test_missing_released_zombie_tasks <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 92%] 5766s tests/test_worker.py::test_missing_released_zombie_tasks_2 <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 92%] 5766s tests/test_worker.py::test_worker_status_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 92%] 5767s tests/test_worker.py::test_log_remove_worker <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 92%] 5768s tests/test_worker.py::test_task_flight_compute_oserror <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 92%] 5768s tests/test_worker.py::test_gather_dep_cancelled_rescheduled <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 92%] 5769s tests/test_worker.py::test_gather_dep_do_not_handle_response_of_not_requested_tasks <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 92%] 5769s tests/test_worker.py::test_gather_dep_no_longer_in_flight_tasks <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 92%] 5771s tests/test_worker.py::test_get_data_cancelled_error <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 92%] 5772s tests/test_worker.py::test_Worker__to_dict <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 92%] 5772s tests/test_worker.py::test_extension_methods <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 92%] 5772s tests/test_worker.py::test_benchmark_hardware <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 92%] 5772s tests/test_worker.py::test_tick_interval <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py SKIPPED [ 92%] 5772s tests/test_worker.py::test_broken_comm <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py SKIPPED [ 92%] 5772s tests/test_worker.py::test_do_not_block_event_loop_during_shutdown <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 92%] 5773s tests/test_worker.py::test_reconnect_argument_deprecated <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 92%] 5773s tests/test_worker.py::test_worker_running_before_running_plugins <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 92%] 5774s tests/test_worker.py::test_execute_preamble_abort_retirement <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 92%] 5774s tests/test_worker.py::test_deprecation_of_renamed_worker_attributes <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 92%] 5776s tests/test_worker.py::test_forward_output <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 92%] 5777s tests/test_worker.py::test_offload_getdata <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 92%] 5777s tests/test_worker.py::test_startstops <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 92%] 5778s tests/test_worker.py::test_suppress_keyerror_for_cancelled_tasks[cancelled] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 92%] 5778s tests/test_worker.py::test_suppress_keyerror_for_cancelled_tasks[resumed] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 92%] 5778s tests/test_worker.py::test_suppress_compute_failure_for_cancelled_tasks <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 92%] 5779s tests/test_worker_client.py::test_submit_from_worker <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_client.py PASSED [ 92%] 5779s tests/test_worker_client.py::test_submit_from_worker_async <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_client.py PASSED [ 92%] 5780s tests/test_worker_client.py::test_scatter_from_worker <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_client.py PASSED [ 92%] 5780s tests/test_worker_client.py::test_scatter_singleton <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_client.py PASSED [ 93%] 5781s tests/test_worker_client.py::test_gather_multi_machine <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_client.py PASSED [ 93%] 5781s tests/test_worker_client.py::test_same_loop <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_client.py PASSED [ 93%] 5784s tests/test_worker_client.py::test_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_client.py PASSED [ 93%] 5785s tests/test_worker_client.py::test_async <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_client.py PASSED [ 93%] 5786s tests/test_worker_client.py::test_separate_thread_false <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_client.py PASSED [ 93%] 5786s tests/test_worker_client.py::test_client_executor <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_client.py PASSED [ 93%] 5787s tests/test_worker_client.py::test_local_client_warning <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_client.py PASSED [ 93%] 5787s tests/test_worker_client.py::test_closing_worker_doesnt_close_client <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_client.py PASSED [ 93%] 5790s tests/test_worker_client.py::test_timeout <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_client.py PASSED [ 93%] 5790s tests/test_worker_client.py::test_secede_without_stealing_issue_1262 <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_client.py PASSED [ 93%] 5791s tests/test_worker_client.py::test_compute_within_worker_client <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_client.py PASSED [ 93%] 5791s tests/test_worker_client.py::test_worker_client_rejoins <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_client.py PASSED [ 93%] 5792s tests/test_worker_client.py::test_submit_different_names <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_client.py XPASS [ 93%] 5793s tests/test_worker_client.py::test_secede_does_not_claim_worker <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_client.py PASSED [ 93%] 5793s tests/test_worker_client.py::test_log_event <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_client.py PASSED [ 93%] 5794s tests/test_worker_client.py::test_log_event_implicit <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_client.py PASSED [ 93%] 5794s tests/test_worker_memory.py::test_parse_memory_limit_zero <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 93%] 5794s tests/test_worker_memory.py::test_resource_limit <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 93%] 5794s tests/test_worker_memory.py::test_parse_memory_limit_worker <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 93%] 5794s tests/test_worker_memory.py::test_parse_memory_limit_worker_relative <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 93%] 5796s tests/test_worker_memory.py::test_parse_memory_limit_nanny <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 93%] 5797s tests/test_worker_memory.py::test_dict_data_if_no_spill_to_disk <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 93%] 5797s tests/test_worker_memory.py::test_worker_data_callable_local_directory <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 93%] 5797s tests/test_worker_memory.py::test_worker_data_callable_local_directory_kwargs <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 93%] 5797s tests/test_worker_memory.py::test_worker_data_callable_kwargs <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 93%] 5797s tests/test_worker_memory.py::test_workerstate_fail_to_pickle_execute_1[executing] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 93%] 5797s tests/test_worker_memory.py::test_workerstate_fail_to_pickle_execute_1[long-running] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 93%] 5797s tests/test_worker_memory.py::test_workerstate_fail_to_pickle_flight <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 93%] 5798s tests/test_worker_memory.py::test_fail_to_pickle_execute_2 <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 93%] 5798s tests/test_worker_memory.py::test_fail_to_pickle_spill <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 93%] 5798s tests/test_worker_memory.py::test_spill_target_threshold <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 93%] 5799s tests/test_worker_memory.py::test_spill_constrained <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 93%] 5799s tests/test_worker_memory.py::test_spill_spill_threshold <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 94%] 5800s tests/test_worker_memory.py::test_spill_hysteresis[False-10000000000-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 94%] 5800s tests/test_worker_memory.py::test_spill_hysteresis[0.7-0-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 94%] 5801s tests/test_worker_memory.py::test_spill_hysteresis[0.4-0-7] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 94%] 5801s tests/test_worker_memory.py::test_pause_executor_manual <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 94%] 5803s tests/test_worker_memory.py::test_pause_executor_with_memory_monitor <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 94%] 5804s tests/test_worker_memory.py::test_pause_prevents_deps_fetch <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 94%] 5804s tests/test_worker_memory.py::test_avoid_memory_monitor_if_zero_limit_worker <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 94%] 5806s tests/test_worker_memory.py::test_avoid_memory_monitor_if_zero_limit_nanny <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 94%] 5807s tests/test_worker_memory.py::test_override_data_worker <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 94%] 5809s tests/test_worker_memory.py::test_override_data_nanny <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 94%] 5811s tests/test_worker_memory.py::test_override_data_vs_memory_monitor <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 94%] 5811s tests/test_worker_memory.py::test_manual_evict_proto <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 94%] 5811s tests/test_worker_memory.py::test_nanny_terminate <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py SKIPPED [ 94%] 5811s tests/test_worker_memory.py::test_disk_cleanup_on_terminate[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py SKIPPED [ 94%] 5811s tests/test_worker_memory.py::test_disk_cleanup_on_terminate[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py SKIPPED [ 94%] 5814s tests/test_worker_memory.py::test_pause_while_spilling <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 94%] 5814s tests/test_worker_memory.py::test_release_evloop_while_spilling <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py SKIPPED [ 94%] 5814s tests/test_worker_memory.py::test_deprecated_attributes[Worker-memory_limit-123000000000.0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 94%] 5814s tests/test_worker_memory.py::test_deprecated_attributes[Worker-memory_target_fraction-0.789] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 94%] 5814s tests/test_worker_memory.py::test_deprecated_attributes[Worker-memory_spill_fraction-0.789] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 94%] 5814s tests/test_worker_memory.py::test_deprecated_attributes[Worker-memory_pause_fraction-0.789] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 94%] 5816s tests/test_worker_memory.py::test_deprecated_attributes[Nanny-memory_limit-123000000000.0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 94%] 5818s tests/test_worker_memory.py::test_deprecated_attributes[Nanny-memory_terminate_fraction-0.789] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 94%] 5818s tests/test_worker_memory.py::test_deprecated_memory_monitor_method_worker <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 94%] 5821s tests/test_worker_memory.py::test_deprecated_memory_monitor_method_nanny <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 94%] 5821s tests/test_worker_memory.py::test_deprecated_params[memory_target_fraction] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 94%] 5821s tests/test_worker_memory.py::test_deprecated_params[memory_spill_fraction] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 94%] 5821s tests/test_worker_memory.py::test_deprecated_params[memory_pause_fraction] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 94%] 5823s tests/test_worker_memory.py::test_pause_while_idle <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 94%] 5826s tests/test_worker_memory.py::test_pause_while_saturated <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 94%] 5826s tests/test_worker_memory.py::test_worker_log_memory_limit_too_high <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 94%] 5826s tests/test_worker_memory.py::test_high_unmanaged_memory_warning <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 95%] 5827s tests/test_worker_memory.py::test_delete_spilled_keys <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 95%] 5827s tests/test_worker_metrics.py::test_task_lifecycle <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_metrics.py PASSED [ 95%] 5827s tests/test_worker_metrics.py::test_async_task <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_metrics.py PASSED [ 95%] 5830s tests/test_worker_metrics.py::test_custom_executor <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_metrics.py PASSED [ 95%] 5830s tests/test_worker_metrics.py::test_offload <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_metrics.py PASSED [ 95%] 5831s tests/test_worker_metrics.py::test_execute_failed <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_metrics.py PASSED [ 95%] 5831s tests/test_worker_metrics.py::test_cancelled_execute <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_metrics.py PASSED [ 95%] 5832s tests/test_worker_metrics.py::test_cancelled_flight <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_metrics.py PASSED [ 95%] 5833s tests/test_worker_metrics.py::test_gather_dep_busy <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_metrics.py PASSED [ 95%] 5834s tests/test_worker_metrics.py::test_gather_dep_no_task <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_metrics.py PASSED [ 95%] 5835s tests/test_worker_metrics.py::test_gather_dep_failed <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_metrics.py PASSED [ 95%] 5836s tests/test_worker_metrics.py::test_gather_dep_network_error <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_metrics.py PASSED [ 95%] 5837s tests/test_worker_metrics.py::test_memory_monitor <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_metrics.py PASSED [ 95%] 5837s tests/test_worker_metrics.py::test_user_metrics_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_metrics.py PASSED [ 95%] 5837s tests/test_worker_metrics.py::test_user_metrics_async <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_metrics.py PASSED [ 95%] 5838s tests/test_worker_metrics.py::test_user_metrics_fail <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_metrics.py PASSED [ 95%] 5838s tests/test_worker_metrics.py::test_user_metrics_weird <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_metrics.py PASSED [ 95%] 5842s tests/test_worker_metrics.py::test_do_not_leak_metrics <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_metrics.py PASSED [ 95%] 5844s tests/test_worker_metrics.py::test_reschedule <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_metrics.py PASSED [ 95%] 5844s tests/test_worker_metrics.py::test_send_metrics_to_scheduler <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_metrics.py PASSED [ 95%] 5844s tests/test_worker_metrics.py::test_no_spans_extension <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_metrics.py PASSED [ 95%] 5845s tests/test_worker_metrics.py::test_new_metrics_during_heartbeat <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_metrics.py PASSED [ 95%] 5848s tests/test_worker_metrics.py::test_delayed_ledger_is_not_reentrant <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_metrics.py PASSED [ 95%] 5848s tests/test_worker_metrics.py::test_int_metrics <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_metrics.py PASSED [ 95%] 5848s tests/test_worker_state_machine.py::test_instruction_match <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 95%] 5850s tests/test_worker_state_machine.py::test_TaskState_tracking <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 95%] 5850s tests/test_worker_state_machine.py::test_TaskState_get_nbytes <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 95%] 5850s tests/test_worker_state_machine.py::test_TaskState_eq <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 95%] 5850s tests/test_worker_state_machine.py::test_TaskState__to_dict <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 95%] 5850s tests/test_worker_state_machine.py::test_TaskState_repr <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 95%] 5850s tests/test_worker_state_machine.py::test_WorkerState__to_dict <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 95%] 5850s tests/test_worker_state_machine.py::test_WorkerState_pickle <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 96%] 5850s tests/test_worker_state_machine.py::test_pickle_exceptions[False-InvalidTransition-kwargs0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 96%] 5850s tests/test_worker_state_machine.py::test_pickle_exceptions[False-TransitionCounterMaxExceeded-kwargs1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 96%] 5850s tests/test_worker_state_machine.py::test_pickle_exceptions[False-InvalidTaskState-kwargs2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 96%] 5850s tests/test_worker_state_machine.py::test_pickle_exceptions[True-InvalidTransition-kwargs0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 96%] 5850s tests/test_worker_state_machine.py::test_pickle_exceptions[True-TransitionCounterMaxExceeded-kwargs1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 96%] 5850s tests/test_worker_state_machine.py::test_pickle_exceptions[True-InvalidTaskState-kwargs2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 96%] 5850s tests/test_worker_state_machine.py::test_slots[TaskState] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 96%] 5850s tests/test_worker_state_machine.py::test_slots[Instruction] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 96%] 5850s tests/test_worker_state_machine.py::test_slots[GatherDep] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 96%] 5850s tests/test_worker_state_machine.py::test_slots[Execute] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 96%] 5850s tests/test_worker_state_machine.py::test_slots[RetryBusyWorkerLater] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 96%] 5850s tests/test_worker_state_machine.py::test_slots[SendMessageToScheduler] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 96%] 5850s tests/test_worker_state_machine.py::test_slots[TaskFinishedMsg] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 96%] 5850s tests/test_worker_state_machine.py::test_slots[TaskErredMsg] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 96%] 5850s tests/test_worker_state_machine.py::test_slots[ReleaseWorkerDataMsg] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 96%] 5850s tests/test_worker_state_machine.py::test_slots[RescheduleMsg] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 96%] 5850s tests/test_worker_state_machine.py::test_slots[LongRunningMsg] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 96%] 5850s tests/test_worker_state_machine.py::test_slots[AddKeysMsg] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 96%] 5850s tests/test_worker_state_machine.py::test_slots[RequestRefreshWhoHasMsg] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 96%] 5850s tests/test_worker_state_machine.py::test_slots[StealResponseMsg] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 96%] 5850s tests/test_worker_state_machine.py::test_slots[StateMachineEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 96%] 5850s tests/test_worker_state_machine.py::test_slots[PauseEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 96%] 5850s tests/test_worker_state_machine.py::test_slots[UnpauseEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 96%] 5850s tests/test_worker_state_machine.py::test_slots[RetryBusyWorkerEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 96%] 5850s tests/test_worker_state_machine.py::test_slots[GatherDepDoneEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 96%] 5850s tests/test_worker_state_machine.py::test_slots[GatherDepSuccessEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 96%] 5850s tests/test_worker_state_machine.py::test_slots[GatherDepBusyEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 96%] 5850s tests/test_worker_state_machine.py::test_slots[GatherDepNetworkFailureEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 96%] 5850s tests/test_worker_state_machine.py::test_slots[GatherDepFailureEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 96%] 5850s tests/test_worker_state_machine.py::test_slots[RemoveWorkerEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 96%] 5850s tests/test_worker_state_machine.py::test_slots[ComputeTaskEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 96%] 5850s tests/test_worker_state_machine.py::test_slots[ExecuteDoneEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 96%] 5850s tests/test_worker_state_machine.py::test_slots[ExecuteSuccessEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 97%] 5850s tests/test_worker_state_machine.py::test_slots[ExecuteFailureEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 97%] 5850s tests/test_worker_state_machine.py::test_slots[RescheduleEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 97%] 5850s tests/test_worker_state_machine.py::test_slots[CancelComputeEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 97%] 5850s tests/test_worker_state_machine.py::test_slots[FindMissingEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 97%] 5850s tests/test_worker_state_machine.py::test_slots[RefreshWhoHasEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 97%] 5850s tests/test_worker_state_machine.py::test_slots[AcquireReplicasEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 97%] 5850s tests/test_worker_state_machine.py::test_slots[RemoveReplicasEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 97%] 5850s tests/test_worker_state_machine.py::test_slots[FreeKeysEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 97%] 5850s tests/test_worker_state_machine.py::test_slots[StealRequestEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 97%] 5850s tests/test_worker_state_machine.py::test_slots[UpdateDataEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 97%] 5850s tests/test_worker_state_machine.py::test_slots[SecedeEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 97%] 5850s tests/test_worker_state_machine.py::test_sendmsg_to_dict <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 97%] 5850s tests/test_worker_state_machine.py::test_merge_recs_instructions <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 97%] 5850s tests/test_worker_state_machine.py::test_event_to_dict_with_annotations <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 97%] 5850s tests/test_worker_state_machine.py::test_event_to_dict_without_annotations <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 97%] 5850s tests/test_worker_state_machine.py::test_computetask_to_dict <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 97%] 5850s tests/test_worker_state_machine.py::test_computetask_dummy <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 97%] 5850s tests/test_worker_state_machine.py::test_updatedata_to_dict <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 97%] 5850s tests/test_worker_state_machine.py::test_executesuccess_to_dict <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 97%] 5850s tests/test_worker_state_machine.py::test_executesuccess_dummy <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 97%] 5850s tests/test_worker_state_machine.py::test_executefailure_to_dict <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 97%] 5850s tests/test_worker_state_machine.py::test_executefailure_dummy <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 97%] 5851s tests/test_worker_state_machine.py::test_fetch_to_compute <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 97%] 5851s tests/test_worker_state_machine.py::test_fetch_via_amm_to_compute <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 97%] 5852s tests/test_worker_state_machine.py::test_lose_replica_during_fetch[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 97%] 5853s tests/test_worker_state_machine.py::test_lose_replica_during_fetch[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 97%] 5853s tests/test_worker_state_machine.py::test_fetch_to_missing_on_busy <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 97%] 5853s tests/test_worker_state_machine.py::test_new_replica_while_all_workers_in_flight <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 97%] 5854s tests/test_worker_state_machine.py::test_cancelled_while_in_flight <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 97%] 5854s tests/test_worker_state_machine.py::test_in_memory_while_in_flight <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 97%] 5855s tests/test_worker_state_machine.py::test_forget_data_needed <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 97%] 5855s tests/test_worker_state_machine.py::test_missing_handle_compute_dependency <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 98%] 5856s tests/test_worker_state_machine.py::test_missing_to_waiting <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 98%] 5857s tests/test_worker_state_machine.py::test_fetch_to_missing_on_refresh_who_has <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 98%] 5857s tests/test_worker_state_machine.py::test_fetch_to_missing_on_network_failure <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 98%] 5858s tests/test_worker_state_machine.py::test_deprecated_worker_attributes <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 98%] 5858s tests/test_worker_state_machine.py::test_aggregate_gather_deps[10000000-3-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 98%] 5858s tests/test_worker_state_machine.py::test_aggregate_gather_deps[10000000-3-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 98%] 5858s tests/test_worker_state_machine.py::test_aggregate_gather_deps[20000000-2-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 98%] 5858s tests/test_worker_state_machine.py::test_aggregate_gather_deps[20000000-2-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 98%] 5858s tests/test_worker_state_machine.py::test_aggregate_gather_deps[30000000-1-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 98%] 5858s tests/test_worker_state_machine.py::test_aggregate_gather_deps[30000000-1-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 98%] 5858s tests/test_worker_state_machine.py::test_aggregate_gather_deps[60000000-1-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 98%] 5858s tests/test_worker_state_machine.py::test_aggregate_gather_deps[60000000-1-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 98%] 5858s tests/test_worker_state_machine.py::test_gather_priority <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 98%] 5858s tests/test_worker_state_machine.py::test_task_acquires_resources[executing] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 98%] 5858s tests/test_worker_state_machine.py::test_task_acquires_resources[long-running] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 98%] 5858s tests/test_worker_state_machine.py::test_task_releases_resources[executing-ExecuteSuccessEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 98%] 5858s tests/test_worker_state_machine.py::test_task_releases_resources[executing-ExecuteFailureEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 98%] 5858s tests/test_worker_state_machine.py::test_task_releases_resources[executing-RescheduleEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 98%] 5858s tests/test_worker_state_machine.py::test_task_releases_resources[long-running-ExecuteSuccessEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 98%] 5858s tests/test_worker_state_machine.py::test_task_releases_resources[long-running-ExecuteFailureEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 98%] 5858s tests/test_worker_state_machine.py::test_task_releases_resources[long-running-RescheduleEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 98%] 5858s tests/test_worker_state_machine.py::test_task_with_dependencies_acquires_resources <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 98%] 5858s tests/test_worker_state_machine.py::test_resumed_task_releases_resources[executing-ExecuteSuccessEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 98%] 5858s tests/test_worker_state_machine.py::test_resumed_task_releases_resources[executing-ExecuteFailureEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 98%] 5858s tests/test_worker_state_machine.py::test_resumed_task_releases_resources[executing-RescheduleEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 98%] 5858s tests/test_worker_state_machine.py::test_resumed_task_releases_resources[long-running-ExecuteSuccessEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 98%] 5858s tests/test_worker_state_machine.py::test_resumed_task_releases_resources[long-running-ExecuteFailureEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 98%] 5858s tests/test_worker_state_machine.py::test_resumed_task_releases_resources[long-running-RescheduleEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 98%] 5858s tests/test_worker_state_machine.py::test_clean_log <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 98%] 5858s tests/test_worker_state_machine.py::test_running_task_in_all_running_tasks[executing] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 98%] 5858s tests/test_worker_state_machine.py::test_running_task_in_all_running_tasks[long-running] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 98%] 5858s tests/test_worker_state_machine.py::test_done_task_not_in_all_running_tasks[executing-ExecuteSuccessEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 99%] 5858s tests/test_worker_state_machine.py::test_done_task_not_in_all_running_tasks[executing-ExecuteFailureEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 99%] 5858s tests/test_worker_state_machine.py::test_done_task_not_in_all_running_tasks[executing-RescheduleEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 99%] 5858s tests/test_worker_state_machine.py::test_done_task_not_in_all_running_tasks[long-running-ExecuteSuccessEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 99%] 5858s tests/test_worker_state_machine.py::test_done_task_not_in_all_running_tasks[long-running-ExecuteFailureEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 99%] 5858s tests/test_worker_state_machine.py::test_done_task_not_in_all_running_tasks[long-running-RescheduleEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 99%] 5858s tests/test_worker_state_machine.py::test_done_resumed_task_not_in_all_running_tasks[executing-ExecuteSuccessEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 99%] 5858s tests/test_worker_state_machine.py::test_done_resumed_task_not_in_all_running_tasks[executing-ExecuteFailureEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 99%] 5858s tests/test_worker_state_machine.py::test_done_resumed_task_not_in_all_running_tasks[executing-RescheduleEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 99%] 5858s tests/test_worker_state_machine.py::test_done_resumed_task_not_in_all_running_tasks[long-running-ExecuteSuccessEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 99%] 5858s tests/test_worker_state_machine.py::test_done_resumed_task_not_in_all_running_tasks[long-running-ExecuteFailureEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 99%] 5858s tests/test_worker_state_machine.py::test_done_resumed_task_not_in_all_running_tasks[long-running-RescheduleEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 99%] 5858s tests/test_worker_state_machine.py::test_gather_dep_failure <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 99%] 5858s tests/test_worker_state_machine.py::test_recompute_erred_task <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 99%] 5858s tests/test_worker_state_machine.py::test_transfer_incoming_metrics <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 99%] 5858s tests/test_worker_state_machine.py::test_throttling_does_not_affect_first_transfer <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 99%] 5858s tests/test_worker_state_machine.py::test_message_target_does_not_affect_first_transfer_on_different_worker <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 99%] 5858s tests/test_worker_state_machine.py::test_throttle_incoming_transfers_on_count_limit <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 99%] 5858s tests/test_worker_state_machine.py::test_throttling_incoming_transfer_on_transfer_bytes_same_worker <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 99%] 5858s tests/test_worker_state_machine.py::test_throttling_incoming_transfer_on_transfer_bytes_different_workers <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 99%] 5858s tests/test_worker_state_machine.py::test_do_not_throttle_connections_while_below_threshold <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 99%] 5858s tests/test_worker_state_machine.py::test_throttle_on_transfer_bytes_regardless_of_threshold <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 99%] 5858s tests/test_worker_state_machine.py::test_worker_nbytes[executing] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 99%] 5858s tests/test_worker_state_machine.py::test_worker_nbytes[long-running] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 99%] 5858s tests/test_worker_state_machine.py::test_fetch_count <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 99%] 5858s tests/test_worker_state_machine.py::test_task_counter <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 99%] 5858s tests/test_worker_state_machine.py::test_remove_worker_while_in_flight[fail] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 99%] 5858s tests/test_worker_state_machine.py::test_remove_worker_while_in_flight[success] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 99%] 5858s tests/test_worker_state_machine.py::test_remove_worker_while_in_flight[no-key] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 99%] 5858s tests/test_worker_state_machine.py::test_remove_worker_while_in_flight[busy] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 99%] 5858s tests/test_worker_state_machine.py::test_remove_worker_while_in_flight_unused_peer <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 99%] 5858s tests/test_worker_state_machine.py::test_remove_worker_while_in_fetch <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 99%] 5858s tests/test_worker_state_machine.py::test_remove_worker_unknown <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [100%] 5858s 5858s =================================== FAILURES =================================== 5858s __________________________________ test_nanny __________________________________ 5858s 5858s fut = , timeout = 0 5858s 5858s async def wait_for(fut: Awaitable[T], timeout: float) -> T: 5858s async with asyncio.timeout(timeout): 5858s > return await fut 5858s 5858s /usr/lib/python3/dist-packages/distributed/utils.py:1914: 5858s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 5858s /usr/lib/python3/dist-packages/distributed/nanny.py:358: in start_unsafe 5858s comm = await self.rpc.connect(saddr) 5858s /usr/lib/python3/dist-packages/distributed/core.py:1485: in connect 5858s return await self._connect(addr=addr, timeout=timeout) 5858s /usr/lib/python3/dist-packages/distributed/core.py:1429: in _connect 5858s comm = await connect( 5858s /usr/lib/python3/dist-packages/distributed/comm/core.py:342: in connect 5858s comm = await wait_for( 5858s /usr/lib/python3/dist-packages/distributed/utils.py:1914: in wait_for 5858s return await fut 5858s /usr/lib/python3/dist-packages/distributed/comm/tcp.py:546: in connect 5858s stream = await self.client.connect( 5858s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 5858s 5858s self = 5858s host = '127.0.0.1', port = 33327, af = 5858s ssl_options = 5858s max_buffer_size = 4163037184.0, source_ip = None, source_port = None 5858s timeout = None 5858s 5858s async def connect( 5858s self, 5858s host: str, 5858s port: int, 5858s af: socket.AddressFamily = socket.AF_UNSPEC, 5858s ssl_options: Optional[Union[Dict[str, Any], ssl.SSLContext]] = None, 5858s max_buffer_size: Optional[int] = None, 5858s source_ip: Optional[str] = None, 5858s source_port: Optional[int] = None, 5858s timeout: Optional[Union[float, datetime.timedelta]] = None, 5858s ) -> IOStream: 5858s """Connect to the given host and port. 5858s 5858s Asynchronously returns an `.IOStream` (or `.SSLIOStream` if 5858s ``ssl_options`` is not None). 5858s 5858s Using the ``source_ip`` kwarg, one can specify the source 5858s IP address to use when establishing the connection. 5858s In case the user needs to resolve and 5858s use a specific interface, it has to be handled outside 5858s of Tornado as this depends very much on the platform. 5858s 5858s Raises `TimeoutError` if the input future does not complete before 5858s ``timeout``, which may be specified in any form allowed by 5858s `.IOLoop.add_timeout` (i.e. a `datetime.timedelta` or an absolute time 5858s relative to `.IOLoop.time`) 5858s 5858s Similarly, when the user requires a certain source port, it can 5858s be specified using the ``source_port`` arg. 5858s 5858s .. versionchanged:: 4.5 5858s Added the ``source_ip`` and ``source_port`` arguments. 5858s 5858s .. versionchanged:: 5.0 5858s Added the ``timeout`` argument. 5858s """ 5858s if timeout is not None: 5858s if isinstance(timeout, numbers.Real): 5858s timeout = IOLoop.current().time() + timeout 5858s elif isinstance(timeout, datetime.timedelta): 5858s timeout = IOLoop.current().time() + timeout.total_seconds() 5858s else: 5858s raise TypeError("Unsupported timeout %r" % timeout) 5858s if timeout is not None: 5858s addrinfo = await gen.with_timeout( 5858s timeout, self.resolver.resolve(host, port, af) 5858s ) 5858s else: 5858s addrinfo = await self.resolver.resolve(host, port, af) 5858s connector = _Connector( 5858s addrinfo, 5858s functools.partial( 5858s self._create_stream, 5858s max_buffer_size, 5858s source_ip=source_ip, 5858s source_port=source_port, 5858s ), 5858s ) 5858s > af, addr, stream = await connector.start(connect_timeout=timeout) 5858s E asyncio.exceptions.CancelledError 5858s 5858s /usr/lib/python3/dist-packages/tornado/tcpclient.py:279: CancelledError 5858s 5858s The above exception was the direct cause of the following exception: 5858s 5858s self = 5858s 5858s @final 5858s async def start(self): 5858s async with self._startup_lock: 5858s if self.status == Status.failed: 5858s assert self.__startup_exc is not None 5858s raise self.__startup_exc 5858s elif self.status != Status.init: 5858s return self 5858s timeout = getattr(self, "death_timeout", None) 5858s 5858s async def _close_on_failure(exc: Exception) -> None: 5858s await self.close(reason=f"failure-to-start-{str(type(exc))}") 5858s self.status = Status.failed 5858s self.__startup_exc = exc 5858s 5858s try: 5858s > await wait_for(self.start_unsafe(), timeout=timeout) 5858s 5858s /usr/lib/python3/dist-packages/distributed/core.py:528: 5858s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 5858s /usr/lib/python3/dist-packages/distributed/utils.py:1913: in wait_for 5858s async with asyncio.timeout(timeout): 5858s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 5858s 5858s self = 5858s exc_type = 5858s exc_val = CancelledError(), exc_tb = 5858s 5858s async def __aexit__( 5858s self, 5858s exc_type: Optional[Type[BaseException]], 5858s exc_val: Optional[BaseException], 5858s exc_tb: Optional[TracebackType], 5858s ) -> Optional[bool]: 5858s assert self._state in (_State.ENTERED, _State.EXPIRING) 5858s 5858s if self._timeout_handler is not None: 5858s self._timeout_handler.cancel() 5858s self._timeout_handler = None 5858s 5858s if self._state is _State.EXPIRING: 5858s self._state = _State.EXPIRED 5858s 5858s if self._task.uncancel() <= self._cancelling and exc_type is exceptions.CancelledError: 5858s # Since there are no new cancel requests, we're 5858s # handling this. 5858s > raise TimeoutError from exc_val 5858s E TimeoutError 5858s 5858s /usr/lib/python3.12/asyncio/timeouts.py:115: TimeoutError 5858s 5858s The above exception was the direct cause of the following exception: 5858s 5858s @contextlib.asynccontextmanager 5858s async def _cluster_factory(): 5858s workers = [] 5858s s = None 5858s try: 5858s for _ in range(60): 5858s try: 5858s > s, ws = await start_cluster( 5858s nthreads, 5858s scheduler, 5858s security=security, 5858s Worker=Worker, 5858s scheduler_kwargs=scheduler_kwargs, 5858s worker_kwargs=merge( 5858s {"death_timeout": min(15, int(deadline.remaining))}, 5858s worker_kwargs, 5858s ), 5858s ) 5858s 5858s /usr/lib/python3/dist-packages/distributed/utils_test.py:974: 5858s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 5858s /usr/lib/python3/dist-packages/distributed/utils_test.py:791: in start_cluster 5858s await asyncio.gather(*workers) 5858s /usr/lib/python3.12/asyncio/tasks.py:684: in _wrap_awaitable 5858s return await awaitable 5858s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 5858s 5858s self = 5858s 5858s @final 5858s async def start(self): 5858s async with self._startup_lock: 5858s if self.status == Status.failed: 5858s assert self.__startup_exc is not None 5858s raise self.__startup_exc 5858s elif self.status != Status.init: 5858s return self 5858s timeout = getattr(self, "death_timeout", None) 5858s 5858s async def _close_on_failure(exc: Exception) -> None: 5858s await self.close(reason=f"failure-to-start-{str(type(exc))}") 5858s self.status = Status.failed 5858s self.__startup_exc = exc 5858s 5858s try: 5858s await wait_for(self.start_unsafe(), timeout=timeout) 5858s except asyncio.TimeoutError as exc: 5858s await _close_on_failure(exc) 5858s > raise asyncio.TimeoutError( 5858s f"{type(self).__name__} start timed out after {timeout}s." 5858s ) from exc 5858s E TimeoutError: Nanny start timed out after 0s. 5858s 5858s /usr/lib/python3/dist-packages/distributed/core.py:531: TimeoutError 5858s 5858s During handling of the above exception, another exception occurred: 5858s 5858s fut = ._..test_func..async_fn at 0x7a4f452c7d80> 5858s timeout = 60 5858s 5858s async def wait_for(fut: Awaitable[T], timeout: float) -> T: 5858s async with asyncio.timeout(timeout): 5858s > return await fut 5858s 5858s /usr/lib/python3/dist-packages/distributed/utils.py:1914: 5858s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 5858s /usr/lib/python3/dist-packages/distributed/utils_test.py:1007: in async_fn 5858s _cluster_factory() as (s, workers), 5858s /usr/lib/python3.12/contextlib.py:210: in __aenter__ 5858s return await anext(self.gen) 5858s /usr/lib/python3/dist-packages/distributed/utils_test.py:991: in _cluster_factory 5858s await asyncio.sleep(1) 5858s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 5858s 5858s delay = 1, result = None 5858s 5858s async def sleep(delay, result=None): 5858s """Coroutine that completes after a given time (in seconds).""" 5858s if delay <= 0: 5858s await __sleep0() 5858s return result 5858s 5858s loop = events.get_running_loop() 5858s future = loop.create_future() 5858s h = loop.call_later(delay, 5858s futures._set_result_unless_cancelled, 5858s future, result) 5858s try: 5858s > return await future 5858s E asyncio.exceptions.CancelledError 5858s 5858s /usr/lib/python3.12/asyncio/tasks.py:665: CancelledError 5858s 5858s The above exception was the direct cause of the following exception: 5858s 5858s args = (), kwds = {} 5858s 5858s @wraps(func) 5858s def inner(*args, **kwds): 5858s with self._recreate_cm(): 5858s > return func(*args, **kwds) 5858s 5858s /usr/lib/python3.12/contextlib.py:81: 5858s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 5858s /usr/lib/python3.12/contextlib.py:81: in inner 5858s return func(*args, **kwds) 5858s /usr/lib/python3/dist-packages/distributed/utils_test.py:1090: in test_func 5858s return _run_and_close_tornado(async_fn_outer) 5858s /usr/lib/python3/dist-packages/distributed/utils_test.py:380: in _run_and_close_tornado 5858s return asyncio_run(inner_fn(), loop_factory=get_loop_factory()) 5858s /usr/lib/python3.12/asyncio/runners.py:195: in run 5858s return runner.run(main) 5858s /usr/lib/python3.12/asyncio/runners.py:118: in run 5858s return self._loop.run_until_complete(task) 5858s /usr/lib/python3.12/asyncio/base_events.py:691: in run_until_complete 5858s return future.result() 5858s /usr/lib/python3/dist-packages/distributed/utils_test.py:377: in inner_fn 5858s return await async_fn(*args, **kwargs) 5858s /usr/lib/python3/dist-packages/distributed/utils_test.py:1087: in async_fn_outer 5858s return await utils_wait_for(async_fn(), timeout=timeout * 2) 5858s /usr/lib/python3/dist-packages/distributed/utils.py:1913: in wait_for 5858s async with asyncio.timeout(timeout): 5858s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 5858s 5858s self = 5858s exc_type = 5858s exc_val = CancelledError(), exc_tb = 5858s 5858s async def __aexit__( 5858s self, 5858s exc_type: Optional[Type[BaseException]], 5858s exc_val: Optional[BaseException], 5858s exc_tb: Optional[TracebackType], 5858s ) -> Optional[bool]: 5858s assert self._state in (_State.ENTERED, _State.EXPIRING) 5858s 5858s if self._timeout_handler is not None: 5858s self._timeout_handler.cancel() 5858s self._timeout_handler = None 5858s 5858s if self._state is _State.EXPIRING: 5858s self._state = _State.EXPIRED 5858s 5858s if self._task.uncancel() <= self._cancelling and exc_type is exceptions.CancelledError: 5858s # Since there are no new cancel requests, we're 5858s # handling this. 5858s > raise TimeoutError from exc_val 5858s E TimeoutError 5858s 5858s /usr/lib/python3.12/asyncio/timeouts.py:115: TimeoutError 5858s ----------------------------- Captured stderr call ----------------------------- 5858s 2025-02-21 00:58:04,693 - distributed.scheduler - INFO - State start 5858s 2025-02-21 00:58:04,705 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37321 5858s 2025-02-21 00:58:04,708 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:45423/status 5858s 2025-02-21 00:58:04,710 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5858s 2025-02-21 00:58:04,739 - distributed.nanny - INFO - Start Nanny at: 'tls://127.0.0.1:46811' 5858s 2025-02-21 00:58:04,742 - distributed.nanny - INFO - Start Nanny at: 'tls://127.0.0.1:44373' 5858s 2025-02-21 00:58:05,906 - distributed.worker.memory - WARNING - Ignoring provided memory limit 8326074368 due to system memory limit of 7.75 GiB 5858s 2025-02-21 00:58:05,928 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36121 5858s 2025-02-21 00:58:05,929 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36121 5858s 2025-02-21 00:58:05,929 - distributed.worker - INFO - Worker name: 0 5858s 2025-02-21 00:58:05,929 - distributed.worker - INFO - dashboard at: 127.0.0.1:39421 5858s 2025-02-21 00:58:05,929 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37321 5858s 2025-02-21 00:58:05,929 - distributed.worker - INFO - ------------------------------------------------- 5858s 2025-02-21 00:58:05,929 - distributed.worker - INFO - Threads: 1 5858s 2025-02-21 00:58:05,929 - distributed.worker - INFO - Memory: 7.75 GiB 5858s 2025-02-21 00:58:05,929 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-xmawv6fv 5858s 2025-02-21 00:58:05,929 - distributed.worker - INFO - ------------------------------------------------- 5858s 2025-02-21 00:58:05,950 - distributed.worker.memory - WARNING - Ignoring provided memory limit 8326074368 due to system memory limit of 7.75 GiB 5858s 2025-02-21 00:58:05,983 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41341 5858s 2025-02-21 00:58:05,984 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41341 5858s 2025-02-21 00:58:05,984 - distributed.worker - INFO - Worker name: 1 5858s 2025-02-21 00:58:05,984 - distributed.worker - INFO - dashboard at: 127.0.0.1:33395 5858s 2025-02-21 00:58:05,984 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:37321 5858s 2025-02-21 00:58:05,984 - distributed.worker - INFO - ------------------------------------------------- 5858s 2025-02-21 00:58:05,984 - distributed.worker - INFO - Threads: 2 5858s 2025-02-21 00:58:05,984 - distributed.worker - INFO - Memory: 7.75 GiB 5858s 2025-02-21 00:58:05,984 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-yg2ch390 5858s 2025-02-21 00:58:05,984 - distributed.worker - INFO - ------------------------------------------------- 5858s 2025-02-21 00:58:06,382 - distributed.scheduler - INFO - Register worker addr: tls://127.0.0.1:36121 name: 0 5858s 2025-02-21 00:58:06,413 - distributed.worker - INFO - Starting Worker plugin shuffle 5858s 2025-02-21 00:58:06,414 - distributed.worker - INFO - Registered to: tls://127.0.0.1:37321 5858s 2025-02-21 00:58:06,414 - distributed.worker - INFO - ------------------------------------------------- 5858s 2025-02-21 00:58:06,414 - distributed.core - INFO - Starting established connection to tls://127.0.0.1:37321 5858s 2025-02-21 00:58:06,412 - distributed.scheduler - INFO - Starting worker compute stream, tls://127.0.0.1:36121 5858s 2025-02-21 00:58:06,415 - distributed.core - INFO - Starting established connection to tls://127.0.0.1:39920 5858s 2025-02-21 00:58:06,485 - distributed.scheduler - INFO - Register worker addr: tls://127.0.0.1:41341 name: 1 5858s 2025-02-21 00:58:06,515 - distributed.worker - INFO - Starting Worker plugin shuffle 5858s 2025-02-21 00:58:06,516 - distributed.worker - INFO - Registered to: tls://127.0.0.1:37321 5858s 2025-02-21 00:58:06,516 - distributed.worker - INFO - ------------------------------------------------- 5858s 2025-02-21 00:58:06,516 - distributed.core - INFO - Starting established connection to tls://127.0.0.1:37321 5858s 2025-02-21 00:58:06,514 - distributed.scheduler - INFO - Starting worker compute stream, tls://127.0.0.1:41341 5858s 2025-02-21 00:58:06,517 - distributed.core - INFO - Starting established connection to tls://127.0.0.1:39930 5858s 2025-02-21 00:58:06,518 - distributed.core - INFO - Connection to tls://127.0.0.1:39930 has been closed. 5858s 2025-02-21 00:58:06,518 - distributed.core - INFO - Connection to tls://127.0.0.1:37321 has been closed. 5858s 2025-02-21 00:58:06,518 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41341. Reason: worker-handle-scheduler-connection-broken 5858s 2025-02-21 00:58:06,518 - distributed.scheduler - INFO - Remove worker addr: tls://127.0.0.1:41341 name: 1 (stimulus_id='handle-worker-cleanup-1740099486.5182745') 5858s 2025-02-21 00:58:06,535 - distributed.nanny - INFO - Closing Nanny gracefully at 'tls://127.0.0.1:44373'. Reason: worker-handle-scheduler-connection-broken 5858s 2025-02-21 00:58:06,535 - distributed.worker - INFO - Removing Worker plugin shuffle 5858s 2025-02-21 00:58:06,537 - distributed.nanny - INFO - Worker closed 5858s 2025-02-21 00:58:08,758 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:44373'. Reason: nanny-close-gracefully 5858s 2025-02-21 00:58:08,758 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:44373' closed. 5858s 2025-02-21 00:58:36,543 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:46811'. Reason: nanny-close 5858s 2025-02-21 00:58:36,544 - distributed.nanny - INFO - Nanny asking worker to close. Reason: nanny-close 5858s 2025-02-21 00:58:36,545 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36121. Reason: nanny-close 5858s 2025-02-21 00:58:36,545 - distributed.worker - INFO - Removing Worker plugin shuffle 5858s 2025-02-21 00:58:36,547 - distributed.core - INFO - Received 'close-stream' from tls://127.0.0.1:39920; closing. 5858s 2025-02-21 00:58:36,547 - distributed.core - INFO - Connection to tls://127.0.0.1:37321 has been closed. 5858s 2025-02-21 00:58:36,548 - distributed.nanny - INFO - Worker closed 5858s 2025-02-21 00:58:36,547 - distributed.scheduler - INFO - Remove worker addr: tls://127.0.0.1:36121 name: 0 (stimulus_id='handle-worker-cleanup-1740099516.5475924') 5858s 2025-02-21 00:58:36,550 - distributed.scheduler - INFO - Lost all workers 5858s 2025-02-21 00:58:36,743 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:46811' closed. 5858s 2025-02-21 00:58:36,743 - distributed.scheduler - INFO - Closing scheduler. Reason: unknown 5858s 2025-02-21 00:58:36,746 - distributed.scheduler - INFO - Scheduler closing all comms 5858s 2025-02-21 00:58:36,748 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Cluster creation timeout; retrying 5858s Traceback (most recent call last): 5858s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 974, in _cluster_factory 5858s s, ws = await start_cluster( 5858s ^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 806, in start_cluster 5858s raise TimeoutError("Cluster creation timeout") 5858s TimeoutError: Cluster creation timeout 5858s 2025-02-21 00:58:37,751 - distributed.scheduler - INFO - State start 5858s 2025-02-21 00:58:37,757 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:40317 5858s 2025-02-21 00:58:37,760 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:34855/status 5858s 2025-02-21 00:58:37,762 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5858s 2025-02-21 00:58:37,771 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:36981'. Reason: failure-to-start- 5858s 2025-02-21 00:58:37,772 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:36981' closed. 5858s 2025-02-21 00:58:37,772 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:33331'. Reason: failure-to-start- 5858s 2025-02-21 00:58:37,772 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:33331' closed. 5858s 2025-02-21 00:58:37,772 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40317': TLS handshake failed with remote 'tls://127.0.0.1:40718': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1011) 5858s 2025-02-21 00:58:37,772 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40317': TLS handshake failed with remote 'tls://127.0.0.1:40726': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1011) 5858s 2025-02-21 00:58:37,772 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 5858s Traceback (most recent call last): 5858s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 5858s return await fut 5858s ^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 5858s comm = await self.rpc.connect(saddr) 5858s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1485, in connect 5858s return await self._connect(addr=addr, timeout=timeout) 5858s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1429, in _connect 5858s comm = await connect( 5858s ^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5858s comm = await wait_for( 5858s ^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 5858s return await fut 5858s ^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5858s stream = await self.client.connect( 5858s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5858s af, addr, stream = await connector.start(connect_timeout=timeout) 5858s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5858s asyncio.exceptions.CancelledError 5858s 5858s The above exception was the direct cause of the following exception: 5858s 5858s Traceback (most recent call last): 5858s File "/usr/lib/python3/dist-packages/distributed/core.py", line 528, in start 5858s await wait_for(self.start_unsafe(), timeout=timeout) 5858s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1913, in wait_for 5858s async with asyncio.timeout(timeout): 5858s ^^^^^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3.12/asyncio/timeouts.py", line 115, in __aexit__ 5858s raise TimeoutError from exc_val 5858s TimeoutError 5858s 5858s The above exception was the direct cause of the following exception: 5858s 5858s Traceback (most recent call last): 5858s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 974, in _cluster_factory 5858s s, ws = await start_cluster( 5858s ^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 791, in start_cluster 5858s await asyncio.gather(*workers) 5858s File "/usr/lib/python3.12/asyncio/tasks.py", line 684, in _wrap_awaitable 5858s return await awaitable 5858s ^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/core.py", line 531, in start 5858s raise asyncio.TimeoutError( 5858s TimeoutError: Nanny start timed out after 0s. 5858s 2025-02-21 00:58:38,777 - distributed.scheduler - INFO - State start 5858s 2025-02-21 00:58:38,786 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:39337 5858s 2025-02-21 00:58:38,790 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:41733/status 5858s 2025-02-21 00:58:38,792 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5858s 2025-02-21 00:58:38,805 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:43063'. Reason: failure-to-start- 5858s 2025-02-21 00:58:38,805 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:43063' closed. 5858s 2025-02-21 00:58:38,805 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:38979'. Reason: failure-to-start- 5858s 2025-02-21 00:58:38,805 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:38979' closed. 5858s 2025-02-21 00:58:38,806 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39337': TLS handshake failed with remote 'tls://127.0.0.1:45034': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1011) 5858s 2025-02-21 00:58:38,806 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39337': TLS handshake failed with remote 'tls://127.0.0.1:45036': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1011) 5858s 2025-02-21 00:58:38,806 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 5858s Traceback (most recent call last): 5858s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 5858s return await fut 5858s ^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 5858s comm = await self.rpc.connect(saddr) 5858s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1485, in connect 5858s return await self._connect(addr=addr, timeout=timeout) 5858s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1429, in _connect 5858s comm = await connect( 5858s ^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5858s comm = await wait_for( 5858s ^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 5858s return await fut 5858s ^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5858s stream = await self.client.connect( 5858s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5858s af, addr, stream = await connector.start(connect_timeout=timeout) 5858s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5858s asyncio.exceptions.CancelledError 5858s 5858s The above exception was the direct cause of the following exception: 5858s 5858s Traceback (most recent call last): 5858s File "/usr/lib/python3/dist-packages/distributed/core.py", line 528, in start 5858s await wait_for(self.start_unsafe(), timeout=timeout) 5858s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1913, in wait_for 5858s async with asyncio.timeout(timeout): 5858s ^^^^^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3.12/asyncio/timeouts.py", line 115, in __aexit__ 5858s raise TimeoutError from exc_val 5858s TimeoutError 5858s 5858s The above exception was the direct cause of the following exception: 5858s 5858s Traceback (most recent call last): 5858s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 974, in _cluster_factory 5858s s, ws = await start_cluster( 5858s ^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 791, in start_cluster 5858s await asyncio.gather(*workers) 5858s File "/usr/lib/python3.12/asyncio/tasks.py", line 684, in _wrap_awaitable 5858s return await awaitable 5858s ^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/core.py", line 531, in start 5858s raise asyncio.TimeoutError( 5858s TimeoutError: Nanny start timed out after 0s. 5858s 2025-02-21 00:58:39,811 - distributed.scheduler - INFO - State start 5858s 2025-02-21 00:58:39,818 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:33975 5858s 2025-02-21 00:58:39,822 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:35547/status 5858s 2025-02-21 00:58:39,824 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5858s 2025-02-21 00:58:39,836 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:46367'. Reason: failure-to-start- 5858s 2025-02-21 00:58:39,837 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:46367' closed. 5858s 2025-02-21 00:58:39,837 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:38557'. Reason: failure-to-start- 5858s 2025-02-21 00:58:39,837 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:38557' closed. 5858s 2025-02-21 00:58:39,837 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33975': TLS handshake failed with remote 'tls://127.0.0.1:33140': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1011) 5858s 2025-02-21 00:58:39,837 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33975': TLS handshake failed with remote 'tls://127.0.0.1:33152': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1011) 5858s 2025-02-21 00:58:39,838 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 5858s Traceback (most recent call last): 5858s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 5858s return await fut 5858s ^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 5858s comm = await self.rpc.connect(saddr) 5858s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1485, in connect 5858s return await self._connect(addr=addr, timeout=timeout) 5858s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1429, in _connect 5858s comm = await connect( 5858s ^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5858s comm = await wait_for( 5858s ^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 5858s return await fut 5858s ^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5858s stream = await self.client.connect( 5858s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5858s af, addr, stream = await connector.start(connect_timeout=timeout) 5858s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5858s asyncio.exceptions.CancelledError 5858s 5858s The above exception was the direct cause of the following exception: 5858s 5858s Traceback (most recent call last): 5858s File "/usr/lib/python3/dist-packages/distributed/core.py", line 528, in start 5858s await wait_for(self.start_unsafe(), timeout=timeout) 5858s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1913, in wait_for 5858s async with asyncio.timeout(timeout): 5858s ^^^^^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3.12/asyncio/timeouts.py", line 115, in __aexit__ 5858s raise TimeoutError from exc_val 5858s TimeoutError 5858s 5858s The above exception was the direct cause of the following exception: 5858s 5858s Traceback (most recent call last): 5858s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 974, in _cluster_factory 5858s s, ws = await start_cluster( 5858s ^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 791, in start_cluster 5858s await asyncio.gather(*workers) 5858s File "/usr/lib/python3.12/asyncio/tasks.py", line 684, in _wrap_awaitable 5858s return await awaitable 5858s ^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/core.py", line 531, in start 5858s raise asyncio.TimeoutError( 5858s TimeoutError: Nanny start timed out after 0s. 5858s 2025-02-21 00:58:40,843 - distributed.scheduler - INFO - State start 5858s 2025-02-21 00:58:40,850 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:34383 5858s 2025-02-21 00:58:40,853 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:40145/status 5858s 2025-02-21 00:58:40,857 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5858s 2025-02-21 00:58:40,868 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:34531'. Reason: failure-to-start- 5858s 2025-02-21 00:58:40,868 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:34531' closed. 5858s 2025-02-21 00:58:40,868 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:33285'. Reason: failure-to-start- 5858s 2025-02-21 00:58:40,868 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:33285' closed. 5858s 2025-02-21 00:58:40,869 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34383': TLS handshake failed with remote 'tls://127.0.0.1:42254': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1011) 5858s 2025-02-21 00:58:40,869 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34383': TLS handshake failed with remote 'tls://127.0.0.1:42260': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1011) 5858s 2025-02-21 00:58:40,869 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 5858s Traceback (most recent call last): 5858s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 5858s return await fut 5858s ^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 5858s comm = await self.rpc.connect(saddr) 5858s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1485, in connect 5858s return await self._connect(addr=addr, timeout=timeout) 5858s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1429, in _connect 5858s comm = await connect( 5858s ^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5858s comm = await wait_for( 5858s ^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 5858s return await fut 5858s ^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5858s stream = await self.client.connect( 5858s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5858s af, addr, stream = await connector.start(connect_timeout=timeout) 5858s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5858s asyncio.exceptions.CancelledError 5858s 5858s The above exception was the direct cause of the following exception: 5858s 5858s Traceback (most recent call last): 5858s File "/usr/lib/python3/dist-packages/distributed/core.py", line 528, in start 5858s await wait_for(self.start_unsafe(), timeout=timeout) 5858s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1913, in wait_for 5858s async with asyncio.timeout(timeout): 5858s ^^^^^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3.12/asyncio/timeouts.py", line 115, in __aexit__ 5858s raise TimeoutError from exc_val 5858s TimeoutError 5858s 5858s The above exception was the direct cause of the following exception: 5858s 5858s Traceback (most recent call last): 5858s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 974, in _cluster_factory 5858s s, ws = await start_cluster( 5858s ^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 791, in start_cluster 5858s await asyncio.gather(*workers) 5858s File "/usr/lib/python3.12/asyncio/tasks.py", line 684, in _wrap_awaitable 5858s return await awaitable 5858s ^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/core.py", line 531, in start 5858s raise asyncio.TimeoutError( 5858s TimeoutError: Nanny start timed out after 0s. 5858s 2025-02-21 00:58:41,874 - distributed.scheduler - INFO - State start 5858s 2025-02-21 00:58:41,885 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:34969 5858s 2025-02-21 00:58:41,889 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:33501/status 5858s 2025-02-21 00:58:41,892 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5858s 2025-02-21 00:58:41,907 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:38967'. Reason: failure-to-start- 5858s 2025-02-21 00:58:41,907 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:38967' closed. 5858s 2025-02-21 00:58:41,907 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:46181'. Reason: failure-to-start- 5858s 2025-02-21 00:58:41,908 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:46181' closed. 5858s 2025-02-21 00:58:41,908 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34969': TLS handshake failed with remote 'tls://127.0.0.1:50574': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1011) 5858s 2025-02-21 00:58:41,908 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34969': TLS handshake failed with remote 'tls://127.0.0.1:50578': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1011) 5858s 2025-02-21 00:58:41,908 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 5858s Traceback (most recent call last): 5858s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 5858s return await fut 5858s ^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 5858s comm = await self.rpc.connect(saddr) 5858s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1485, in connect 5858s return await self._connect(addr=addr, timeout=timeout) 5858s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1429, in _connect 5858s comm = await connect( 5858s ^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5858s comm = await wait_for( 5858s ^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 5858s return await fut 5858s ^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5858s stream = await self.client.connect( 5858s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5858s af, addr, stream = await connector.start(connect_timeout=timeout) 5858s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5858s asyncio.exceptions.CancelledError 5858s 5858s The above exception was the direct cause of the following exception: 5858s 5858s Traceback (most recent call last): 5858s File "/usr/lib/python3/dist-packages/distributed/core.py", line 528, in start 5858s await wait_for(self.start_unsafe(), timeout=timeout) 5858s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1913, in wait_for 5858s async with asyncio.timeout(timeout): 5858s ^^^^^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3.12/asyncio/timeouts.py", line 115, in __aexit__ 5858s raise TimeoutError from exc_val 5858s TimeoutError 5858s 5858s The above exception was the direct cause of the following exception: 5858s 5858s Traceback (most recent call last): 5858s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 974, in _cluster_factory 5858s s, ws = await start_cluster( 5858s ^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 791, in start_cluster 5858s await asyncio.gather(*workers) 5858s File "/usr/lib/python3.12/asyncio/tasks.py", line 684, in _wrap_awaitable 5858s return await awaitable 5858s ^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/core.py", line 531, in start 5858s raise asyncio.TimeoutError( 5858s TimeoutError: Nanny start timed out after 0s. 5858s 2025-02-21 00:58:42,916 - distributed.scheduler - INFO - State start 5858s 2025-02-21 00:58:42,926 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:35127 5858s 2025-02-21 00:58:42,929 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:44337/status 5858s 2025-02-21 00:58:42,933 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5858s 2025-02-21 00:58:42,945 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:43541'. Reason: failure-to-start- 5858s 2025-02-21 00:58:42,945 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:43541' closed. 5858s 2025-02-21 00:58:42,946 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:36459'. Reason: failure-to-start- 5858s 2025-02-21 00:58:42,946 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:36459' closed. 5858s 2025-02-21 00:58:42,947 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35127': TLS handshake failed with remote 'tls://127.0.0.1:37856': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1011) 5858s 2025-02-21 00:58:42,948 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35127': TLS handshake failed with remote 'tls://127.0.0.1:37872': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1011) 5858s 2025-02-21 00:58:42,948 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 5858s Traceback (most recent call last): 5858s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 5858s return await fut 5858s ^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 5858s comm = await self.rpc.connect(saddr) 5858s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1485, in connect 5858s return await self._connect(addr=addr, timeout=timeout) 5858s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1429, in _connect 5858s comm = await connect( 5858s ^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5858s comm = await wait_for( 5858s ^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 5858s return await fut 5858s ^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5858s stream = await self.client.connect( 5858s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5858s af, addr, stream = await connector.start(connect_timeout=timeout) 5858s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5858s asyncio.exceptions.CancelledError 5858s 5858s The above exception was the direct cause of the following exception: 5858s 5858s Traceback (most recent call last): 5858s File "/usr/lib/python3/dist-packages/distributed/core.py", line 528, in start 5858s await wait_for(self.start_unsafe(), timeout=timeout) 5858s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1913, in wait_for 5858s async with asyncio.timeout(timeout): 5858s ^^^^^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3.12/asyncio/timeouts.py", line 115, in __aexit__ 5858s raise TimeoutError from exc_val 5858s TimeoutError 5858s 5858s The above exception was the direct cause of the following exception: 5858s 5858s Traceback (most recent call last): 5858s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 974, in _cluster_factory 5858s s, ws = await start_cluster( 5858s ^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 791, in start_cluster 5858s await asyncio.gather(*workers) 5858s File "/usr/lib/python3.12/asyncio/tasks.py", line 684, in _wrap_awaitable 5858s return await awaitable 5858s ^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/core.py", line 531, in start 5858s raise asyncio.TimeoutError( 5858s TimeoutError: Nanny start timed out after 0s. 5858s 2025-02-21 00:58:43,953 - distributed.scheduler - INFO - State start 5858s 2025-02-21 00:58:43,960 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:34213 5858s 2025-02-21 00:58:43,964 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:45263/status 5858s 2025-02-21 00:58:43,967 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5858s 2025-02-21 00:58:43,988 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:34901'. Reason: failure-to-start- 5858s 2025-02-21 00:58:43,988 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:34901' closed. 5858s 2025-02-21 00:58:43,988 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:42971'. Reason: failure-to-start- 5858s 2025-02-21 00:58:43,989 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:42971' closed. 5858s 2025-02-21 00:58:43,989 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34213': TLS handshake failed with remote 'tls://127.0.0.1:43982': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1011) 5858s 2025-02-21 00:58:43,989 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34213': TLS handshake failed with remote 'tls://127.0.0.1:43992': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1011) 5858s 2025-02-21 00:58:43,990 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 5858s Traceback (most recent call last): 5858s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 5858s return await fut 5858s ^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 5858s comm = await self.rpc.connect(saddr) 5858s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1485, in connect 5858s return await self._connect(addr=addr, timeout=timeout) 5858s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1429, in _connect 5858s comm = await connect( 5858s ^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5858s comm = await wait_for( 5858s ^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 5858s return await fut 5858s ^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5858s stream = await self.client.connect( 5858s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5858s af, addr, stream = await connector.start(connect_timeout=timeout) 5858s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5858s asyncio.exceptions.CancelledError 5858s 5858s The above exception was the direct cause of the following exception: 5858s 5858s Traceback (most recent call last): 5858s File "/usr/lib/python3/dist-packages/distributed/core.py", line 528, in start 5858s await wait_for(self.start_unsafe(), timeout=timeout) 5858s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1913, in wait_for 5858s async with asyncio.timeout(timeout): 5858s ^^^^^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3.12/asyncio/timeouts.py", line 115, in __aexit__ 5858s raise TimeoutError from exc_val 5858s TimeoutError 5858s 5858s The above exception was the direct cause of the following exception: 5858s 5858s Traceback (most recent call last): 5858s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 974, in _cluster_factory 5858s s, ws = await start_cluster( 5858s ^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 791, in start_cluster 5858s await asyncio.gather(*workers) 5858s File "/usr/lib/python3.12/asyncio/tasks.py", line 684, in _wrap_awaitable 5858s return await awaitable 5858s ^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/core.py", line 531, in start 5858s raise asyncio.TimeoutError( 5858s TimeoutError: Nanny start timed out after 0s. 5858s 2025-02-21 00:58:44,994 - distributed.scheduler - INFO - State start 5858s 2025-02-21 00:58:45,006 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:38949 5858s 2025-02-21 00:58:45,010 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:37765/status 5858s 2025-02-21 00:58:45,013 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5858s 2025-02-21 00:58:45,028 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:41271'. Reason: failure-to-start- 5858s 2025-02-21 00:58:45,029 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:41271' closed. 5858s 2025-02-21 00:58:45,029 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:42023'. Reason: failure-to-start- 5858s 2025-02-21 00:58:45,029 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:42023' closed. 5858s 2025-02-21 00:58:45,029 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38949': TLS handshake failed with remote 'tls://127.0.0.1:47596': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1011) 5858s 2025-02-21 00:58:45,029 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38949': TLS handshake failed with remote 'tls://127.0.0.1:47600': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1011) 5858s 2025-02-21 00:58:45,030 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 5858s Traceback (most recent call last): 5858s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 5858s return await fut 5858s ^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 5858s comm = await self.rpc.connect(saddr) 5858s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1485, in connect 5858s return await self._connect(addr=addr, timeout=timeout) 5858s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1429, in _connect 5858s comm = await connect( 5858s ^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5858s comm = await wait_for( 5858s ^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 5858s return await fut 5858s ^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5858s stream = await self.client.connect( 5858s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5858s af, addr, stream = await connector.start(connect_timeout=timeout) 5858s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5858s asyncio.exceptions.CancelledError 5858s 5858s The above exception was the direct cause of the following exception: 5858s 5858s Traceback (most recent call last): 5858s File "/usr/lib/python3/dist-packages/distributed/core.py", line 528, in start 5858s await wait_for(self.start_unsafe(), timeout=timeout) 5858s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1913, in wait_for 5858s async with asyncio.timeout(timeout): 5858s ^^^^^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3.12/asyncio/timeouts.py", line 115, in __aexit__ 5858s raise TimeoutError from exc_val 5858s TimeoutError 5858s 5858s The above exception was the direct cause of the following exception: 5858s 5858s Traceback (most recent call last): 5858s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 974, in _cluster_factory 5858s s, ws = await start_cluster( 5858s ^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 791, in start_cluster 5858s await asyncio.gather(*workers) 5858s File "/usr/lib/python3.12/asyncio/tasks.py", line 684, in _wrap_awaitable 5858s return await awaitable 5858s ^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/core.py", line 531, in start 5858s raise asyncio.TimeoutError( 5858s TimeoutError: Nanny start timed out after 0s. 5858s 2025-02-21 00:58:46,036 - distributed.scheduler - INFO - State start 5858s 2025-02-21 00:58:46,044 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:36639 5858s 2025-02-21 00:58:46,047 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:43569/status 5858s 2025-02-21 00:58:46,050 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5858s 2025-02-21 00:58:46,063 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:41417'. Reason: failure-to-start- 5858s 2025-02-21 00:58:46,064 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:41417' closed. 5858s 2025-02-21 00:58:46,064 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:38179'. Reason: failure-to-start- 5858s 2025-02-21 00:58:46,064 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:38179' closed. 5858s 2025-02-21 00:58:46,065 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36639': TLS handshake failed with remote 'tls://127.0.0.1:38140': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1011) 5858s 2025-02-21 00:58:46,065 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36639': TLS handshake failed with remote 'tls://127.0.0.1:38156': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1011) 5858s 2025-02-21 00:58:46,065 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 5858s Traceback (most recent call last): 5858s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 5858s return await fut 5858s ^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 5858s comm = await self.rpc.connect(saddr) 5858s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1485, in connect 5858s return await self._connect(addr=addr, timeout=timeout) 5858s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1429, in _connect 5858s comm = await connect( 5858s ^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5858s comm = await wait_for( 5858s ^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 5858s return await fut 5858s ^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5858s stream = await self.client.connect( 5858s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5858s af, addr, stream = await connector.start(connect_timeout=timeout) 5858s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5858s asyncio.exceptions.CancelledError 5858s 5858s The above exception was the direct cause of the following exception: 5858s 5858s Traceback (most recent call last): 5858s File "/usr/lib/python3/dist-packages/distributed/core.py", line 528, in start 5858s await wait_for(self.start_unsafe(), timeout=timeout) 5858s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1913, in wait_for 5858s async with asyncio.timeout(timeout): 5858s ^^^^^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3.12/asyncio/timeouts.py", line 115, in __aexit__ 5858s raise TimeoutError from exc_val 5858s TimeoutError 5858s 5858s The above exception was the direct cause of the following exception: 5858s 5858s Traceback (most recent call last): 5858s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 974, in _cluster_factory 5858s s, ws = await start_cluster( 5858s ^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 791, in start_cluster 5858s await asyncio.gather(*workers) 5858s File "/usr/lib/python3.12/asyncio/tasks.py", line 684, in _wrap_awaitable 5858s return await awaitable 5858s ^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/core.py", line 531, in start 5858s raise asyncio.TimeoutError( 5858s TimeoutError: Nanny start timed out after 0s. 5858s 2025-02-21 00:58:47,070 - distributed.scheduler - INFO - State start 5858s 2025-02-21 00:58:47,078 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:43863 5858s 2025-02-21 00:58:47,081 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:33857/status 5858s 2025-02-21 00:58:47,083 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5858s 2025-02-21 00:58:47,094 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:38989'. Reason: failure-to-start- 5858s 2025-02-21 00:58:47,094 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:38989' closed. 5858s 2025-02-21 00:58:47,094 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:41449'. Reason: failure-to-start- 5858s 2025-02-21 00:58:47,094 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:41449' closed. 5858s 2025-02-21 00:58:47,095 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43863': TLS handshake failed with remote 'tls://127.0.0.1:52128': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1011) 5858s 2025-02-21 00:58:47,095 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43863': TLS handshake failed with remote 'tls://127.0.0.1:52140': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1011) 5858s 2025-02-21 00:58:47,095 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 5858s Traceback (most recent call last): 5858s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 5858s return await fut 5858s ^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 5858s comm = await self.rpc.connect(saddr) 5858s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1485, in connect 5858s return await self._connect(addr=addr, timeout=timeout) 5858s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1429, in _connect 5858s comm = await connect( 5858s ^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5858s comm = await wait_for( 5858s ^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 5858s return await fut 5858s ^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5858s stream = await self.client.connect( 5858s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5858s af, addr, stream = await connector.start(connect_timeout=timeout) 5858s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5858s asyncio.exceptions.CancelledError 5858s 5858s The above exception was the direct cause of the following exception: 5858s 5858s Traceback (most recent call last): 5858s File "/usr/lib/python3/dist-packages/distributed/core.py", line 528, in start 5858s await wait_for(self.start_unsafe(), timeout=timeout) 5858s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1913, in wait_for 5858s async with asyncio.timeout(timeout): 5858s ^^^^^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3.12/asyncio/timeouts.py", line 115, in __aexit__ 5858s raise TimeoutError from exc_val 5858s TimeoutError 5858s 5858s The above exception was the direct cause of the following exception: 5858s 5858s Traceback (most recent call last): 5858s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 974, in _cluster_factory 5858s s, ws = await start_cluster( 5858s ^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 791, in start_cluster 5858s await asyncio.gather(*workers) 5858s File "/usr/lib/python3.12/asyncio/tasks.py", line 684, in _wrap_awaitable 5858s return await awaitable 5858s ^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/core.py", line 531, in start 5858s raise asyncio.TimeoutError( 5858s TimeoutError: Nanny start timed out after 0s. 5858s 2025-02-21 00:58:48,099 - distributed.scheduler - INFO - State start 5858s 2025-02-21 00:58:48,107 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:38041 5858s 2025-02-21 00:58:48,110 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:42549/status 5858s 2025-02-21 00:58:48,112 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5858s 2025-02-21 00:58:48,120 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:38989'. Reason: failure-to-start- 5858s 2025-02-21 00:58:48,120 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:38989' closed. 5858s 2025-02-21 00:58:48,121 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:44673'. Reason: failure-to-start- 5858s 2025-02-21 00:58:48,121 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:44673' closed. 5858s 2025-02-21 00:58:48,121 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38041': TLS handshake failed with remote 'tls://127.0.0.1:53078': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1011) 5858s 2025-02-21 00:58:48,121 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38041': TLS handshake failed with remote 'tls://127.0.0.1:53080': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1011) 5858s 2025-02-21 00:58:48,121 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 5858s Traceback (most recent call last): 5858s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 5858s return await fut 5858s ^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 5858s comm = await self.rpc.connect(saddr) 5858s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1485, in connect 5858s return await self._connect(addr=addr, timeout=timeout) 5858s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1429, in _connect 5858s comm = await connect( 5858s ^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5858s comm = await wait_for( 5858s ^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 5858s return await fut 5858s ^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5858s stream = await self.client.connect( 5858s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5858s af, addr, stream = await connector.start(connect_timeout=timeout) 5858s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5858s asyncio.exceptions.CancelledError 5858s 5858s The above exception was the direct cause of the following exception: 5858s 5858s Traceback (most recent call last): 5858s File "/usr/lib/python3/dist-packages/distributed/core.py", line 528, in start 5858s await wait_for(self.start_unsafe(), timeout=timeout) 5858s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1913, in wait_for 5858s async with asyncio.timeout(timeout): 5858s ^^^^^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3.12/asyncio/timeouts.py", line 115, in __aexit__ 5858s raise TimeoutError from exc_val 5858s TimeoutError 5858s 5858s The above exception was the direct cause of the following exception: 5858s 5858s Traceback (most recent call last): 5858s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 974, in _cluster_factory 5858s s, ws = await start_cluster( 5858s ^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 791, in start_cluster 5858s await asyncio.gather(*workers) 5858s File "/usr/lib/python3.12/asyncio/tasks.py", line 684, in _wrap_awaitable 5858s return await awaitable 5858s ^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/core.py", line 531, in start 5858s raise asyncio.TimeoutError( 5858s TimeoutError: Nanny start timed out after 0s. 5858s 2025-02-21 00:58:49,126 - distributed.scheduler - INFO - State start 5858s 2025-02-21 00:58:49,134 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44039 5858s 2025-02-21 00:58:49,137 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:39157/status 5858s 2025-02-21 00:58:49,140 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5858s 2025-02-21 00:58:49,152 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:46373'. Reason: failure-to-start- 5858s 2025-02-21 00:58:49,153 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:46373' closed. 5858s 2025-02-21 00:58:49,153 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:38183'. Reason: failure-to-start- 5858s 2025-02-21 00:58:49,153 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:38183' closed. 5858s 2025-02-21 00:58:49,154 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44039': TLS handshake failed with remote 'tls://127.0.0.1:39188': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1011) 5858s 2025-02-21 00:58:49,154 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44039': TLS handshake failed with remote 'tls://127.0.0.1:39198': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1011) 5858s 2025-02-21 00:58:49,154 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 5858s Traceback (most recent call last): 5858s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 5858s return await fut 5858s ^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 5858s comm = await self.rpc.connect(saddr) 5858s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1485, in connect 5858s return await self._connect(addr=addr, timeout=timeout) 5858s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1429, in _connect 5858s comm = await connect( 5858s ^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5858s comm = await wait_for( 5858s ^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 5858s return await fut 5858s ^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5858s stream = await self.client.connect( 5858s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5858s af, addr, stream = await connector.start(connect_timeout=timeout) 5858s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5858s asyncio.exceptions.CancelledError 5858s 5858s The above exception was the direct cause of the following exception: 5858s 5858s Traceback (most recent call last): 5858s File "/usr/lib/python3/dist-packages/distributed/core.py", line 528, in start 5858s await wait_for(self.start_unsafe(), timeout=timeout) 5858s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1913, in wait_for 5858s async with asyncio.timeout(timeout): 5858s ^^^^^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3.12/asyncio/timeouts.py", line 115, in __aexit__ 5858s raise TimeoutError from exc_val 5858s TimeoutError 5858s 5858s The above exception was the direct cause of the following exception: 5858s 5858s Traceback (most recent call last): 5858s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 974, in _cluster_factory 5858s s, ws = await start_cluster( 5858s ^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 791, in start_cluster 5858s await asyncio.gather(*workers) 5858s File "/usr/lib/python3.12/asyncio/tasks.py", line 684, in _wrap_awaitable 5858s return await awaitable 5858s ^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/core.py", line 531, in start 5858s raise asyncio.TimeoutError( 5858s TimeoutError: Nanny start timed out after 0s. 5858s 2025-02-21 00:58:50,157 - distributed.scheduler - INFO - State start 5858s 2025-02-21 00:58:50,164 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37819 5858s 2025-02-21 00:58:50,167 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:34607/status 5858s 2025-02-21 00:58:50,168 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5858s 2025-02-21 00:58:50,177 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:36565'. Reason: failure-to-start- 5858s 2025-02-21 00:58:50,178 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:36565' closed. 5858s 2025-02-21 00:58:50,178 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:43769'. Reason: failure-to-start- 5858s 2025-02-21 00:58:50,178 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:43769' closed. 5858s 2025-02-21 00:58:50,178 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37819': TLS handshake failed with remote 'tls://127.0.0.1:44252': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1011) 5858s 2025-02-21 00:58:50,178 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37819': TLS handshake failed with remote 'tls://127.0.0.1:44266': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1011) 5858s 2025-02-21 00:58:50,178 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 5858s Traceback (most recent call last): 5858s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 5858s return await fut 5858s ^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 5858s comm = await self.rpc.connect(saddr) 5858s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1485, in connect 5858s return await self._connect(addr=addr, timeout=timeout) 5858s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1429, in _connect 5858s comm = await connect( 5858s ^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5858s comm = await wait_for( 5858s ^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 5858s return await fut 5858s ^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5858s stream = await self.client.connect( 5858s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5858s af, addr, stream = await connector.start(connect_timeout=timeout) 5858s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5858s asyncio.exceptions.CancelledError 5858s 5858s The above exception was the direct cause of the following exception: 5858s 5858s Traceback (most recent call last): 5858s File "/usr/lib/python3/dist-packages/distributed/core.py", line 528, in start 5858s await wait_for(self.start_unsafe(), timeout=timeout) 5858s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1913, in wait_for 5858s async with asyncio.timeout(timeout): 5858s ^^^^^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3.12/asyncio/timeouts.py", line 115, in __aexit__ 5858s raise TimeoutError from exc_val 5858s TimeoutError 5858s 5858s The above exception was the direct cause of the following exception: 5858s 5858s Traceback (most recent call last): 5858s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 974, in _cluster_factory 5858s s, ws = await start_cluster( 5858s ^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 791, in start_cluster 5858s await asyncio.gather(*workers) 5858s File "/usr/lib/python3.12/asyncio/tasks.py", line 684, in _wrap_awaitable 5858s return await awaitable 5858s ^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/core.py", line 531, in start 5858s raise asyncio.TimeoutError( 5858s TimeoutError: Nanny start timed out after 0s. 5858s 2025-02-21 00:58:51,184 - distributed.scheduler - INFO - State start 5858s 2025-02-21 00:58:51,192 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:38139 5858s 2025-02-21 00:58:51,195 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:38177/status 5858s 2025-02-21 00:58:51,198 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5858s 2025-02-21 00:58:51,211 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:38645'. Reason: failure-to-start- 5858s 2025-02-21 00:58:51,212 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:38645' closed. 5858s 2025-02-21 00:58:51,212 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:36063'. Reason: failure-to-start- 5858s 2025-02-21 00:58:51,212 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:36063' closed. 5858s 2025-02-21 00:58:51,213 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38139': TLS handshake failed with remote 'tls://127.0.0.1:60424': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1011) 5858s 2025-02-21 00:58:51,213 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38139': TLS handshake failed with remote 'tls://127.0.0.1:60440': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1011) 5858s 2025-02-21 00:58:51,213 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 5858s Traceback (most recent call last): 5858s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 5858s return await fut 5858s ^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 5858s comm = await self.rpc.connect(saddr) 5858s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1485, in connect 5858s return await self._connect(addr=addr, timeout=timeout) 5858s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1429, in _connect 5858s comm = await connect( 5858s ^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5858s comm = await wait_for( 5858s ^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 5858s return await fut 5858s ^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5858s stream = await self.client.connect( 5858s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5858s af, addr, stream = await connector.start(connect_timeout=timeout) 5858s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5858s asyncio.exceptions.CancelledError 5858s 5858s The above exception was the direct cause of the following exception: 5858s 5858s Traceback (most recent call last): 5858s File "/usr/lib/python3/dist-packages/distributed/core.py", line 528, in start 5858s await wait_for(self.start_unsafe(), timeout=timeout) 5858s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1913, in wait_for 5858s async with asyncio.timeout(timeout): 5858s ^^^^^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3.12/asyncio/timeouts.py", line 115, in __aexit__ 5858s raise TimeoutError from exc_val 5858s TimeoutError 5858s 5858s The above exception was the direct cause of the following exception: 5858s 5858s Traceback (most recent call last): 5858s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 974, in _cluster_factory 5858s s, ws = await start_cluster( 5858s ^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 791, in start_cluster 5858s await asyncio.gather(*workers) 5858s File "/usr/lib/python3.12/asyncio/tasks.py", line 684, in _wrap_awaitable 5858s return await awaitable 5858s ^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/core.py", line 531, in start 5858s raise asyncio.TimeoutError( 5858s TimeoutError: Nanny start timed out after 0s. 5858s 2025-02-21 00:58:52,216 - distributed.scheduler - INFO - State start 5858s 2025-02-21 00:58:52,225 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:34605 5858s 2025-02-21 00:58:52,228 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:38457/status 5858s 2025-02-21 00:58:52,229 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5858s 2025-02-21 00:58:52,243 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:42169'. Reason: failure-to-start- 5858s 2025-02-21 00:58:52,243 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:42169' closed. 5858s 2025-02-21 00:58:52,243 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:33043'. Reason: failure-to-start- 5858s 2025-02-21 00:58:52,244 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:33043' closed. 5858s 2025-02-21 00:58:52,244 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34605': TLS handshake failed with remote 'tls://127.0.0.1:53544': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1011) 5858s 2025-02-21 00:58:52,244 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34605': TLS handshake failed with remote 'tls://127.0.0.1:53554': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1011) 5858s 2025-02-21 00:58:52,244 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 5858s Traceback (most recent call last): 5858s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 5858s return await fut 5858s ^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 5858s comm = await self.rpc.connect(saddr) 5858s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1485, in connect 5858s return await self._connect(addr=addr, timeout=timeout) 5858s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1429, in _connect 5858s comm = await connect( 5858s ^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5858s comm = await wait_for( 5858s ^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 5858s return await fut 5858s ^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5858s stream = await self.client.connect( 5858s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5858s af, addr, stream = await connector.start(connect_timeout=timeout) 5858s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5858s asyncio.exceptions.CancelledError 5858s 5858s The above exception was the direct cause of the following exception: 5858s 5858s Traceback (most recent call last): 5858s File "/usr/lib/python3/dist-packages/distributed/core.py", line 528, in start 5858s await wait_for(self.start_unsafe(), timeout=timeout) 5858s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1913, in wait_for 5858s async with asyncio.timeout(timeout): 5858s ^^^^^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3.12/asyncio/timeouts.py", line 115, in __aexit__ 5858s raise TimeoutError from exc_val 5858s TimeoutError 5858s 5858s The above exception was the direct cause of the following exception: 5858s 5858s Traceback (most recent call last): 5858s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 974, in _cluster_factory 5858s s, ws = await start_cluster( 5858s ^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 791, in start_cluster 5858s await asyncio.gather(*workers) 5858s File "/usr/lib/python3.12/asyncio/tasks.py", line 684, in _wrap_awaitable 5858s return await awaitable 5858s ^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/core.py", line 531, in start 5858s raise asyncio.TimeoutError( 5858s TimeoutError: Nanny start timed out after 0s. 5858s 2025-02-21 00:58:53,249 - distributed.scheduler - INFO - State start 5858s 2025-02-21 00:58:53,260 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:34103 5858s 2025-02-21 00:58:53,264 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:36105/status 5858s 2025-02-21 00:58:53,268 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5858s 2025-02-21 00:58:53,284 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:43609'. Reason: failure-to-start- 5858s 2025-02-21 00:58:53,284 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:43609' closed. 5858s 2025-02-21 00:58:53,284 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:34467'. Reason: failure-to-start- 5858s 2025-02-21 00:58:53,285 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:34467' closed. 5858s 2025-02-21 00:58:53,285 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34103': TLS handshake failed with remote 'tls://127.0.0.1:50488': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1011) 5858s 2025-02-21 00:58:53,285 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34103': TLS handshake failed with remote 'tls://127.0.0.1:50496': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1011) 5858s 2025-02-21 00:58:53,285 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 5858s Traceback (most recent call last): 5858s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 5858s return await fut 5858s ^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 5858s comm = await self.rpc.connect(saddr) 5858s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1485, in connect 5858s return await self._connect(addr=addr, timeout=timeout) 5858s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1429, in _connect 5858s comm = await connect( 5858s ^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5858s comm = await wait_for( 5858s ^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 5858s return await fut 5858s ^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5858s stream = await self.client.connect( 5858s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5858s af, addr, stream = await connector.start(connect_timeout=timeout) 5858s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5858s asyncio.exceptions.CancelledError 5858s 5858s The above exception was the direct cause of the following exception: 5858s 5858s Traceback (most recent call last): 5858s File "/usr/lib/python3/dist-packages/distributed/core.py", line 528, in start 5858s await wait_for(self.start_unsafe(), timeout=timeout) 5858s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1913, in wait_for 5858s async with asyncio.timeout(timeout): 5858s ^^^^^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3.12/asyncio/timeouts.py", line 115, in __aexit__ 5858s raise TimeoutError from exc_val 5858s TimeoutError 5858s 5858s The above exception was the direct cause of the following exception: 5858s 5858s Traceback (most recent call last): 5858s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 974, in _cluster_factory 5858s s, ws = await start_cluster( 5858s ^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 791, in start_cluster 5858s await asyncio.gather(*workers) 5858s File "/usr/lib/python3.12/asyncio/tasks.py", line 684, in _wrap_awaitable 5858s return await awaitable 5858s ^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/core.py", line 531, in start 5858s raise asyncio.TimeoutError( 5858s TimeoutError: Nanny start timed out after 0s. 5858s 2025-02-21 00:58:54,289 - distributed.scheduler - INFO - State start 5858s 2025-02-21 00:58:54,296 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37615 5858s 2025-02-21 00:58:54,299 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:44689/status 5858s 2025-02-21 00:58:54,301 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5858s 2025-02-21 00:58:54,310 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:43201'. Reason: failure-to-start- 5858s 2025-02-21 00:58:54,310 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:43201' closed. 5858s 2025-02-21 00:58:54,311 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:46399'. Reason: failure-to-start- 5858s 2025-02-21 00:58:54,311 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:46399' closed. 5858s 2025-02-21 00:58:54,311 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37615': TLS handshake failed with remote 'tls://127.0.0.1:47438': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1011) 5858s 2025-02-21 00:58:54,311 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37615': TLS handshake failed with remote 'tls://127.0.0.1:47440': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1011) 5858s 2025-02-21 00:58:54,311 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 5858s Traceback (most recent call last): 5858s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 5858s return await fut 5858s ^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 5858s comm = await self.rpc.connect(saddr) 5858s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1485, in connect 5858s return await self._connect(addr=addr, timeout=timeout) 5858s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1429, in _connect 5858s comm = await connect( 5858s ^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5858s comm = await wait_for( 5858s ^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 5858s return await fut 5858s ^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5858s stream = await self.client.connect( 5858s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5858s af, addr, stream = await connector.start(connect_timeout=timeout) 5858s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5858s asyncio.exceptions.CancelledError 5858s 5858s The above exception was the direct cause of the following exception: 5858s 5858s Traceback (most recent call last): 5858s File "/usr/lib/python3/dist-packages/distributed/core.py", line 528, in start 5858s await wait_for(self.start_unsafe(), timeout=timeout) 5858s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1913, in wait_for 5858s async with asyncio.timeout(timeout): 5858s ^^^^^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3.12/asyncio/timeouts.py", line 115, in __aexit__ 5858s raise TimeoutError from exc_val 5858s TimeoutError 5858s 5858s The above exception was the direct cause of the following exception: 5858s 5858s Traceback (most recent call last): 5858s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 974, in _cluster_factory 5858s s, ws = await start_cluster( 5858s ^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 791, in start_cluster 5858s await asyncio.gather(*workers) 5858s File "/usr/lib/python3.12/asyncio/tasks.py", line 684, in _wrap_awaitable 5858s return await awaitable 5858s ^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/core.py", line 531, in start 5858s raise asyncio.TimeoutError( 5858s TimeoutError: Nanny start timed out after 0s. 5858s 2025-02-21 00:58:55,330 - distributed.scheduler - INFO - State start 5858s 2025-02-21 00:58:55,344 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:40899 5858s 2025-02-21 00:58:55,347 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:40549/status 5858s 2025-02-21 00:58:55,349 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5858s 2025-02-21 00:58:55,362 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:42507'. Reason: failure-to-start- 5858s 2025-02-21 00:58:55,363 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:42507' closed. 5858s 2025-02-21 00:58:55,363 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:45785'. Reason: failure-to-start- 5858s 2025-02-21 00:58:55,363 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:45785' closed. 5858s 2025-02-21 00:58:55,365 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40899': TLS handshake failed with remote 'tls://127.0.0.1:52354': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1011) 5858s 2025-02-21 00:58:55,365 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40899': TLS handshake failed with remote 'tls://127.0.0.1:52368': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1011) 5858s 2025-02-21 00:58:55,365 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 5858s Traceback (most recent call last): 5858s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 5858s return await fut 5858s ^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 5858s comm = await self.rpc.connect(saddr) 5858s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1485, in connect 5858s return await self._connect(addr=addr, timeout=timeout) 5858s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1429, in _connect 5858s comm = await connect( 5858s ^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5858s comm = await wait_for( 5858s ^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 5858s return await fut 5858s ^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5858s stream = await self.client.connect( 5858s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5858s af, addr, stream = await connector.start(connect_timeout=timeout) 5858s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5858s asyncio.exceptions.CancelledError 5858s 5858s The above exception was the direct cause of the following exception: 5858s 5858s Traceback (most recent call last): 5858s File "/usr/lib/python3/dist-packages/distributed/core.py", line 528, in start 5858s await wait_for(self.start_unsafe(), timeout=timeout) 5858s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1913, in wait_for 5858s async with asyncio.timeout(timeout): 5858s ^^^^^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3.12/asyncio/timeouts.py", line 115, in __aexit__ 5858s raise TimeoutError from exc_val 5858s TimeoutError 5858s 5858s The above exception was the direct cause of the following exception: 5858s 5858s Traceback (most recent call last): 5858s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 974, in _cluster_factory 5858s s, ws = await start_cluster( 5858s ^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 791, in start_cluster 5858s await asyncio.gather(*workers) 5858s File "/usr/lib/python3.12/asyncio/tasks.py", line 684, in _wrap_awaitable 5858s return await awaitable 5858s ^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/core.py", line 531, in start 5858s raise asyncio.TimeoutError( 5858s TimeoutError: Nanny start timed out after 0s. 5858s 2025-02-21 00:58:56,368 - distributed.scheduler - INFO - State start 5858s 2025-02-21 00:58:56,381 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:34139 5858s 2025-02-21 00:58:56,386 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:35499/status 5858s 2025-02-21 00:58:56,388 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5858s 2025-02-21 00:58:56,399 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:40119'. Reason: failure-to-start- 5858s 2025-02-21 00:58:56,399 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:40119' closed. 5858s 2025-02-21 00:58:56,400 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:45053'. Reason: failure-to-start- 5858s 2025-02-21 00:58:56,400 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:45053' closed. 5858s 2025-02-21 00:58:56,401 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34139': TLS handshake failed with remote 'tls://127.0.0.1:59148': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1011) 5858s 2025-02-21 00:58:56,401 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34139': TLS handshake failed with remote 'tls://127.0.0.1:59152': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1011) 5858s 2025-02-21 00:58:56,401 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 5858s Traceback (most recent call last): 5858s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 5858s return await fut 5858s ^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 5858s comm = await self.rpc.connect(saddr) 5858s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1485, in connect 5858s return await self._connect(addr=addr, timeout=timeout) 5858s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1429, in _connect 5858s comm = await connect( 5858s ^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5858s comm = await wait_for( 5858s ^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 5858s return await fut 5858s ^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5858s stream = await self.client.connect( 5858s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5858s af, addr, stream = await connector.start(connect_timeout=timeout) 5858s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5858s asyncio.exceptions.CancelledError 5858s 5858s The above exception was the direct cause of the following exception: 5858s 5858s Traceback (most recent call last): 5858s File "/usr/lib/python3/dist-packages/distributed/core.py", line 528, in start 5858s await wait_for(self.start_unsafe(), timeout=timeout) 5858s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1913, in wait_for 5858s async with asyncio.timeout(timeout): 5858s ^^^^^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3.12/asyncio/timeouts.py", line 115, in __aexit__ 5858s raise TimeoutError from exc_val 5858s TimeoutError 5858s 5858s The above exception was the direct cause of the following exception: 5858s 5858s Traceback (most recent call last): 5858s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 974, in _cluster_factory 5858s s, ws = await start_cluster( 5858s ^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 791, in start_cluster 5858s await asyncio.gather(*workers) 5858s File "/usr/lib/python3.12/asyncio/tasks.py", line 684, in _wrap_awaitable 5858s return await awaitable 5858s ^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/core.py", line 531, in start 5858s raise asyncio.TimeoutError( 5858s TimeoutError: Nanny start timed out after 0s. 5858s 2025-02-21 00:58:57,408 - distributed.scheduler - INFO - State start 5858s 2025-02-21 00:58:57,416 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:45123 5858s 2025-02-21 00:58:57,419 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:41501/status 5858s 2025-02-21 00:58:57,421 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5858s 2025-02-21 00:58:57,434 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:40095'. Reason: failure-to-start- 5858s 2025-02-21 00:58:57,434 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:40095' closed. 5858s 2025-02-21 00:58:57,435 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:44399'. Reason: failure-to-start- 5858s 2025-02-21 00:58:57,435 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:44399' closed. 5858s 2025-02-21 00:58:57,436 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45123': TLS handshake failed with remote 'tls://127.0.0.1:35218': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1011) 5858s 2025-02-21 00:58:57,436 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45123': TLS handshake failed with remote 'tls://127.0.0.1:35230': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1011) 5858s 2025-02-21 00:58:57,436 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 5858s Traceback (most recent call last): 5858s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 5858s return await fut 5858s ^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 5858s comm = await self.rpc.connect(saddr) 5858s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1485, in connect 5858s return await self._connect(addr=addr, timeout=timeout) 5858s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1429, in _connect 5858s comm = await connect( 5858s ^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5858s comm = await wait_for( 5858s ^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 5858s return await fut 5858s ^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5858s stream = await self.client.connect( 5858s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5858s af, addr, stream = await connector.start(connect_timeout=timeout) 5858s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5858s asyncio.exceptions.CancelledError 5858s 5858s The above exception was the direct cause of the following exception: 5858s 5858s Traceback (most recent call last): 5858s File "/usr/lib/python3/dist-packages/distributed/core.py", line 528, in start 5858s await wait_for(self.start_unsafe(), timeout=timeout) 5858s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1913, in wait_for 5858s async with asyncio.timeout(timeout): 5858s ^^^^^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3.12/asyncio/timeouts.py", line 115, in __aexit__ 5858s raise TimeoutError from exc_val 5858s TimeoutError 5858s 5858s The above exception was the direct cause of the following exception: 5858s 5858s Traceback (most recent call last): 5858s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 974, in _cluster_factory 5858s s, ws = await start_cluster( 5858s ^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 791, in start_cluster 5858s await asyncio.gather(*workers) 5858s File "/usr/lib/python3.12/asyncio/tasks.py", line 684, in _wrap_awaitable 5858s return await awaitable 5858s ^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/core.py", line 531, in start 5858s raise asyncio.TimeoutError( 5858s TimeoutError: Nanny start timed out after 0s. 5858s 2025-02-21 00:58:58,440 - distributed.scheduler - INFO - State start 5858s 2025-02-21 00:58:58,448 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:35955 5858s 2025-02-21 00:58:58,464 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:45087/status 5858s 2025-02-21 00:58:58,474 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5858s 2025-02-21 00:58:58,486 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:44281'. Reason: failure-to-start- 5858s 2025-02-21 00:58:58,486 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:44281' closed. 5858s 2025-02-21 00:58:58,486 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:35879'. Reason: failure-to-start- 5858s 2025-02-21 00:58:58,486 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:35879' closed. 5858s 2025-02-21 00:58:58,487 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35955': TLS handshake failed with remote 'tls://127.0.0.1:41244': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1011) 5858s 2025-02-21 00:58:58,487 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35955': TLS handshake failed with remote 'tls://127.0.0.1:41254': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1011) 5858s 2025-02-21 00:58:58,487 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 5858s Traceback (most recent call last): 5858s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 5858s return await fut 5858s ^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 5858s comm = await self.rpc.connect(saddr) 5858s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1485, in connect 5858s return await self._connect(addr=addr, timeout=timeout) 5858s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1429, in _connect 5858s comm = await connect( 5858s ^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5858s comm = await wait_for( 5858s ^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 5858s return await fut 5858s ^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5858s stream = await self.client.connect( 5858s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5858s af, addr, stream = await connector.start(connect_timeout=timeout) 5858s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5858s asyncio.exceptions.CancelledError 5858s 5858s The above exception was the direct cause of the following exception: 5858s 5858s Traceback (most recent call last): 5858s File "/usr/lib/python3/dist-packages/distributed/core.py", line 528, in start 5858s await wait_for(self.start_unsafe(), timeout=timeout) 5858s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1913, in wait_for 5858s async with asyncio.timeout(timeout): 5858s ^^^^^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3.12/asyncio/timeouts.py", line 115, in __aexit__ 5858s raise TimeoutError from exc_val 5858s TimeoutError 5858s 5858s The above exception was the direct cause of the following exception: 5858s 5858s Traceback (most recent call last): 5858s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 974, in _cluster_factory 5858s s, ws = await start_cluster( 5858s ^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 791, in start_cluster 5858s await asyncio.gather(*workers) 5858s File "/usr/lib/python3.12/asyncio/tasks.py", line 684, in _wrap_awaitable 5858s return await awaitable 5858s ^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/core.py", line 531, in start 5858s raise asyncio.TimeoutError( 5858s TimeoutError: Nanny start timed out after 0s. 5858s 2025-02-21 00:58:59,491 - distributed.scheduler - INFO - State start 5858s 2025-02-21 00:58:59,499 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:39719 5858s 2025-02-21 00:58:59,502 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:35813/status 5858s 2025-02-21 00:58:59,505 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5858s 2025-02-21 00:58:59,516 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:36891'. Reason: failure-to-start- 5858s 2025-02-21 00:58:59,517 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:36891' closed. 5858s 2025-02-21 00:58:59,517 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:35197'. Reason: failure-to-start- 5858s 2025-02-21 00:58:59,517 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:35197' closed. 5858s 2025-02-21 00:58:59,518 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39719': TLS handshake failed with remote 'tls://127.0.0.1:39404': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1011) 5858s 2025-02-21 00:58:59,518 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39719': TLS handshake failed with remote 'tls://127.0.0.1:39412': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1011) 5858s 2025-02-21 00:58:59,518 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 5858s Traceback (most recent call last): 5858s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 5858s return await fut 5858s ^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 5858s comm = await self.rpc.connect(saddr) 5858s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1485, in connect 5858s return await self._connect(addr=addr, timeout=timeout) 5858s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1429, in _connect 5858s comm = await connect( 5858s ^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5858s comm = await wait_for( 5858s ^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 5858s return await fut 5858s ^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5858s stream = await self.client.connect( 5858s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5858s af, addr, stream = await connector.start(connect_timeout=timeout) 5858s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5858s asyncio.exceptions.CancelledError 5858s 5858s The above exception was the direct cause of the following exception: 5858s 5858s Traceback (most recent call last): 5858s File "/usr/lib/python3/dist-packages/distributed/core.py", line 528, in start 5858s await wait_for(self.start_unsafe(), timeout=timeout) 5858s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1913, in wait_for 5858s async with asyncio.timeout(timeout): 5858s ^^^^^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3.12/asyncio/timeouts.py", line 115, in __aexit__ 5858s raise TimeoutError from exc_val 5858s TimeoutError 5858s 5858s The above exception was the direct cause of the following exception: 5858s 5858s Traceback (most recent call last): 5858s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 974, in _cluster_factory 5858s s, ws = await start_cluster( 5858s ^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 791, in start_cluster 5858s await asyncio.gather(*workers) 5858s File "/usr/lib/python3.12/asyncio/tasks.py", line 684, in _wrap_awaitable 5858s return await awaitable 5858s ^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/core.py", line 531, in start 5858s raise asyncio.TimeoutError( 5858s TimeoutError: Nanny start timed out after 0s. 5858s 2025-02-21 00:59:00,522 - distributed.scheduler - INFO - State start 5858s 2025-02-21 00:59:00,532 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:38339 5858s 2025-02-21 00:59:00,536 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:44377/status 5858s 2025-02-21 00:59:00,538 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5858s 2025-02-21 00:59:00,558 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:38257'. Reason: failure-to-start- 5858s 2025-02-21 00:59:00,559 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:38257' closed. 5858s 2025-02-21 00:59:00,559 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:34945'. Reason: failure-to-start- 5858s 2025-02-21 00:59:00,559 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:34945' closed. 5858s 2025-02-21 00:59:00,560 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38339': TLS handshake failed with remote 'tls://127.0.0.1:58270': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1011) 5858s 2025-02-21 00:59:00,560 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38339': TLS handshake failed with remote 'tls://127.0.0.1:58278': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1011) 5858s 2025-02-21 00:59:00,560 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 5858s Traceback (most recent call last): 5858s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 5858s return await fut 5858s ^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 5858s comm = await self.rpc.connect(saddr) 5858s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1485, in connect 5858s return await self._connect(addr=addr, timeout=timeout) 5858s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1429, in _connect 5858s comm = await connect( 5858s ^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5858s comm = await wait_for( 5858s ^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 5858s return await fut 5858s ^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5858s stream = await self.client.connect( 5858s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5858s af, addr, stream = await connector.start(connect_timeout=timeout) 5858s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5858s asyncio.exceptions.CancelledError 5858s 5858s The above exception was the direct cause of the following exception: 5858s 5858s Traceback (most recent call last): 5858s File "/usr/lib/python3/dist-packages/distributed/core.py", line 528, in start 5858s await wait_for(self.start_unsafe(), timeout=timeout) 5858s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1913, in wait_for 5858s async with asyncio.timeout(timeout): 5858s ^^^^^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3.12/asyncio/timeouts.py", line 115, in __aexit__ 5858s raise TimeoutError from exc_val 5858s TimeoutError 5858s 5858s The above exception was the direct cause of the following exception: 5858s 5858s Traceback (most recent call last): 5858s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 974, in _cluster_factory 5858s s, ws = await start_cluster( 5858s ^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 791, in start_cluster 5858s await asyncio.gather(*workers) 5858s File "/usr/lib/python3.12/asyncio/tasks.py", line 684, in _wrap_awaitable 5858s return await awaitable 5858s ^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/core.py", line 531, in start 5858s raise asyncio.TimeoutError( 5858s TimeoutError: Nanny start timed out after 0s. 5858s 2025-02-21 00:59:01,563 - distributed.scheduler - INFO - State start 5858s 2025-02-21 00:59:01,572 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:39473 5858s 2025-02-21 00:59:01,575 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:43807/status 5858s 2025-02-21 00:59:01,578 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5858s 2025-02-21 00:59:01,589 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:32953'. Reason: failure-to-start- 5858s 2025-02-21 00:59:01,589 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:32953' closed. 5858s 2025-02-21 00:59:01,589 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:35989'. Reason: failure-to-start- 5858s 2025-02-21 00:59:01,590 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:35989' closed. 5858s 2025-02-21 00:59:01,590 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39473': TLS handshake failed with remote 'tls://127.0.0.1:46122': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1011) 5858s 2025-02-21 00:59:01,590 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39473': TLS handshake failed with remote 'tls://127.0.0.1:46130': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1011) 5858s 2025-02-21 00:59:01,590 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 5858s Traceback (most recent call last): 5858s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 5858s return await fut 5858s ^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 5858s comm = await self.rpc.connect(saddr) 5858s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1485, in connect 5858s return await self._connect(addr=addr, timeout=timeout) 5858s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1429, in _connect 5858s comm = await connect( 5858s ^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5858s comm = await wait_for( 5858s ^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 5858s return await fut 5858s ^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5858s stream = await self.client.connect( 5858s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5858s af, addr, stream = await connector.start(connect_timeout=timeout) 5858s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5858s asyncio.exceptions.CancelledError 5858s 5858s The above exception was the direct cause of the following exception: 5858s 5858s Traceback (most recent call last): 5858s File "/usr/lib/python3/dist-packages/distributed/core.py", line 528, in start 5858s await wait_for(self.start_unsafe(), timeout=timeout) 5858s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1913, in wait_for 5858s async with asyncio.timeout(timeout): 5858s ^^^^^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3.12/asyncio/timeouts.py", line 115, in __aexit__ 5858s raise TimeoutError from exc_val 5858s TimeoutError 5858s 5858s The above exception was the direct cause of the following exception: 5858s 5858s Traceback (most recent call last): 5858s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 974, in _cluster_factory 5858s s, ws = await start_cluster( 5858s ^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 791, in start_cluster 5858s await asyncio.gather(*workers) 5858s File "/usr/lib/python3.12/asyncio/tasks.py", line 684, in _wrap_awaitable 5858s return await awaitable 5858s ^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/core.py", line 531, in start 5858s raise asyncio.TimeoutError( 5858s TimeoutError: Nanny start timed out after 0s. 5858s 2025-02-21 00:59:02,596 - distributed.scheduler - INFO - State start 5858s 2025-02-21 00:59:02,603 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:36579 5858s 2025-02-21 00:59:02,606 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:33841/status 5858s 2025-02-21 00:59:02,608 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5858s 2025-02-21 00:59:02,620 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:39053'. Reason: failure-to-start- 5858s 2025-02-21 00:59:02,620 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:39053' closed. 5858s 2025-02-21 00:59:02,620 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:42717'. Reason: failure-to-start- 5858s 2025-02-21 00:59:02,621 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:42717' closed. 5858s 2025-02-21 00:59:02,621 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36579': TLS handshake failed with remote 'tls://127.0.0.1:33518': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1011) 5858s 2025-02-21 00:59:02,621 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36579': TLS handshake failed with remote 'tls://127.0.0.1:33520': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1011) 5858s 2025-02-21 00:59:02,621 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 5858s Traceback (most recent call last): 5858s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 5858s return await fut 5858s ^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 5858s comm = await self.rpc.connect(saddr) 5858s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1485, in connect 5858s return await self._connect(addr=addr, timeout=timeout) 5858s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1429, in _connect 5858s comm = await connect( 5858s ^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5858s comm = await wait_for( 5858s ^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 5858s return await fut 5858s ^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5858s stream = await self.client.connect( 5858s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5858s af, addr, stream = await connector.start(connect_timeout=timeout) 5858s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5858s asyncio.exceptions.CancelledError 5858s 5858s The above exception was the direct cause of the following exception: 5858s 5858s Traceback (most recent call last): 5858s File "/usr/lib/python3/dist-packages/distributed/core.py", line 528, in start 5858s await wait_for(self.start_unsafe(), timeout=timeout) 5858s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1913, in wait_for 5858s async with asyncio.timeout(timeout): 5858s ^^^^^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3.12/asyncio/timeouts.py", line 115, in __aexit__ 5858s raise TimeoutError from exc_val 5858s TimeoutError 5858s 5858s The above exception was the direct cause of the following exception: 5858s 5858s Traceback (most recent call last): 5858s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 974, in _cluster_factory 5858s s, ws = await start_cluster( 5858s ^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 791, in start_cluster 5858s await asyncio.gather(*workers) 5858s File "/usr/lib/python3.12/asyncio/tasks.py", line 684, in _wrap_awaitable 5858s return await awaitable 5858s ^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/core.py", line 531, in start 5858s raise asyncio.TimeoutError( 5858s TimeoutError: Nanny start timed out after 0s. 5858s 2025-02-21 00:59:03,626 - distributed.scheduler - INFO - State start 5858s 2025-02-21 00:59:03,633 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:40829 5858s 2025-02-21 00:59:03,636 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:39253/status 5858s 2025-02-21 00:59:03,637 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5858s 2025-02-21 00:59:03,648 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:34147'. Reason: failure-to-start- 5858s 2025-02-21 00:59:03,648 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:34147' closed. 5858s 2025-02-21 00:59:03,648 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:37111'. Reason: failure-to-start- 5858s 2025-02-21 00:59:03,648 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:37111' closed. 5858s 2025-02-21 00:59:03,649 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40829': TLS handshake failed with remote 'tls://127.0.0.1:39316': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1011) 5858s 2025-02-21 00:59:03,649 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40829': TLS handshake failed with remote 'tls://127.0.0.1:39332': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1011) 5858s 2025-02-21 00:59:03,649 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 5858s Traceback (most recent call last): 5858s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 5858s return await fut 5858s ^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 5858s comm = await self.rpc.connect(saddr) 5858s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1485, in connect 5858s return await self._connect(addr=addr, timeout=timeout) 5858s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1429, in _connect 5858s comm = await connect( 5858s ^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5858s comm = await wait_for( 5858s ^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 5858s return await fut 5858s ^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5858s stream = await self.client.connect( 5858s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5858s af, addr, stream = await connector.start(connect_timeout=timeout) 5858s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5858s asyncio.exceptions.CancelledError 5858s 5858s The above exception was the direct cause of the following exception: 5858s 5858s Traceback (most recent call last): 5858s File "/usr/lib/python3/dist-packages/distributed/core.py", line 528, in start 5858s await wait_for(self.start_unsafe(), timeout=timeout) 5858s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1913, in wait_for 5858s async with asyncio.timeout(timeout): 5858s ^^^^^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3.12/asyncio/timeouts.py", line 115, in __aexit__ 5858s raise TimeoutError from exc_val 5858s TimeoutError 5858s 5858s The above exception was the direct cause of the following exception: 5858s 5858s Traceback (most recent call last): 5858s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 974, in _cluster_factory 5858s s, ws = await start_cluster( 5858s ^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 791, in start_cluster 5858s await asyncio.gather(*workers) 5858s File "/usr/lib/python3.12/asyncio/tasks.py", line 684, in _wrap_awaitable 5858s return await awaitable 5858s ^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/core.py", line 531, in start 5858s raise asyncio.TimeoutError( 5858s TimeoutError: Nanny start timed out after 0s. 5858s 2025-02-21 00:59:04,653 - distributed.scheduler - INFO - State start 5858s 2025-02-21 00:59:04,661 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:33327 5858s 2025-02-21 00:59:04,664 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:40655/status 5858s 2025-02-21 00:59:04,667 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5858s 2025-02-21 00:59:04,683 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:45433'. Reason: failure-to-start- 5858s 2025-02-21 00:59:04,683 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:45433' closed. 5858s 2025-02-21 00:59:04,683 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:44009'. Reason: failure-to-start- 5858s 2025-02-21 00:59:04,684 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:44009' closed. 5858s 2025-02-21 00:59:04,685 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33327': TLS handshake failed with remote 'tls://127.0.0.1:37946': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1011) 5858s 2025-02-21 00:59:04,685 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33327': TLS handshake failed with remote 'tls://127.0.0.1:37956': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1011) 5858s 2025-02-21 00:59:04,685 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 5858s Traceback (most recent call last): 5858s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 5858s return await fut 5858s ^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 5858s comm = await self.rpc.connect(saddr) 5858s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1485, in connect 5858s return await self._connect(addr=addr, timeout=timeout) 5858s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1429, in _connect 5858s comm = await connect( 5858s ^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5858s comm = await wait_for( 5858s ^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 5858s return await fut 5858s ^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5858s stream = await self.client.connect( 5858s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5858s af, addr, stream = await connector.start(connect_timeout=timeout) 5858s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5858s asyncio.exceptions.CancelledError 5858s 5858s The above exception was the direct cause of the following exception: 5858s 5858s Traceback (most recent call last): 5858s File "/usr/lib/python3/dist-packages/distributed/core.py", line 528, in start 5858s await wait_for(self.start_unsafe(), timeout=timeout) 5858s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1913, in wait_for 5858s async with asyncio.timeout(timeout): 5858s ^^^^^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3.12/asyncio/timeouts.py", line 115, in __aexit__ 5858s raise TimeoutError from exc_val 5858s TimeoutError 5858s 5858s The above exception was the direct cause of the following exception: 5858s 5858s Traceback (most recent call last): 5858s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 974, in _cluster_factory 5858s s, ws = await start_cluster( 5858s ^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 791, in start_cluster 5858s await asyncio.gather(*workers) 5858s File "/usr/lib/python3.12/asyncio/tasks.py", line 684, in _wrap_awaitable 5858s return await awaitable 5858s ^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/core.py", line 531, in start 5858s raise asyncio.TimeoutError( 5858s TimeoutError: Nanny start timed out after 0s. 5858s _____________________________ test_retire_workers ______________________________ 5858s 5858s fut = ._..test_func..async_fn at 0x7a4f452c7840> 5858s timeout = 60 5858s 5858s async def wait_for(fut: Awaitable[T], timeout: float) -> T: 5858s async with asyncio.timeout(timeout): 5858s > return await fut 5858s 5858s /usr/lib/python3/dist-packages/distributed/utils.py:1914: 5858s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 5858s /usr/lib/python3/dist-packages/distributed/utils_test.py:1007: in async_fn 5858s _cluster_factory() as (s, workers), 5858s /usr/lib/python3.12/contextlib.py:210: in __aenter__ 5858s return await anext(self.gen) 5858s /usr/lib/python3/dist-packages/distributed/utils_test.py:974: in _cluster_factory 5858s s, ws = await start_cluster( 5858s /usr/lib/python3/dist-packages/distributed/utils_test.py:768: in start_cluster 5858s s = await Scheduler( 5858s /usr/lib/python3/dist-packages/distributed/core.py:528: in start 5858s await wait_for(self.start_unsafe(), timeout=timeout) 5858s /usr/lib/python3/dist-packages/distributed/utils.py:1914: in wait_for 5858s return await fut 5858s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 5858s 5858s self = 5858s 5858s async def start_unsafe(self) -> Self: 5858s """Clear out old state and restart all running coroutines""" 5858s await super().start_unsafe() 5858s 5858s enable_gc_diagnosis() 5858s 5858s self._clear_task_state() 5858s 5858s for addr in self._start_address: 5858s await self.listen( 5858s addr, 5858s allow_offload=False, 5858s handshake_overrides={"pickle-protocol": 4, "compression": None}, 5858s **self.security.get_listen_args("scheduler"), 5858s ) 5858s self.ip = get_address_host(self.listen_address) 5858s listen_ip = self.ip 5858s 5858s if listen_ip == "0.0.0.0": 5858s listen_ip = "" 5858s 5858s if self.address.startswith("inproc://"): 5858s listen_ip = "localhost" 5858s 5858s # Services listen on all addresses 5858s self.start_services(listen_ip) 5858s 5858s for listener in self.listeners: 5858s logger.info(" Scheduler at: %25s", listener.contact_address) 5858s for name, server in self.services.items(): 5858s if name == "dashboard": 5858s addr = get_address_host(listener.contact_address) 5858s try: 5858s link = format_dashboard_link(addr, server.port) 5858s # formatting dashboard link can fail if distributed.dashboard.link 5858s # refers to non-existant env vars. 5858s except KeyError as e: 5858s logger.warning( 5858s f"Failed to format dashboard link, unknown value: {e}" 5858s ) 5858s link = f":{server.port}" 5858s else: 5858s link = f"{listen_ip}:{server.port}" 5858s logger.info("%11s at: %25s", name, link) 5858s 5858s if self.scheduler_file: 5858s with open(self.scheduler_file, "w") as f: 5858s json.dump(self.identity(), f, indent=2) 5858s 5858s fn = self.scheduler_file # remove file when we close the process 5858s 5858s def del_scheduler_file() -> None: 5858s if os.path.exists(fn): 5858s os.remove(fn) 5858s 5858s weakref.finalize(self, del_scheduler_file) 5858s 5858s await self.preloads.start() 5858s 5858s if self.jupyter: 5858s # Allow insecure communications from local users 5858s if self.address.startswith("tls://"): 5858s await self.listen("tcp://localhost:0") 5858s os.environ["DASK_SCHEDULER_ADDRESS"] = self.listeners[-1].contact_address 5858s 5858s > await asyncio.gather( 5858s *[plugin.start(self) for plugin in list(self.plugins.values())] 5858s ) 5858s E asyncio.exceptions.CancelledError 5858s 5858s /usr/lib/python3/dist-packages/distributed/scheduler.py:4259: CancelledError 5858s 5858s The above exception was the direct cause of the following exception: 5858s 5858s args = (), kwds = {} 5858s 5858s @wraps(func) 5858s def inner(*args, **kwds): 5858s with self._recreate_cm(): 5858s > return func(*args, **kwds) 5858s 5858s /usr/lib/python3.12/contextlib.py:81: 5858s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 5858s /usr/lib/python3.12/contextlib.py:81: in inner 5858s return func(*args, **kwds) 5858s /usr/lib/python3/dist-packages/distributed/utils_test.py:1090: in test_func 5858s return _run_and_close_tornado(async_fn_outer) 5858s /usr/lib/python3/dist-packages/distributed/utils_test.py:380: in _run_and_close_tornado 5858s return asyncio_run(inner_fn(), loop_factory=get_loop_factory()) 5858s /usr/lib/python3.12/asyncio/runners.py:195: in run 5858s return runner.run(main) 5858s /usr/lib/python3.12/asyncio/runners.py:118: in run 5858s return self._loop.run_until_complete(task) 5858s /usr/lib/python3.12/asyncio/base_events.py:691: in run_until_complete 5858s return future.result() 5858s /usr/lib/python3/dist-packages/distributed/utils_test.py:377: in inner_fn 5858s return await async_fn(*args, **kwargs) 5858s /usr/lib/python3/dist-packages/distributed/utils_test.py:1087: in async_fn_outer 5858s return await utils_wait_for(async_fn(), timeout=timeout * 2) 5858s /usr/lib/python3/dist-packages/distributed/utils.py:1913: in wait_for 5858s async with asyncio.timeout(timeout): 5858s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 5858s 5858s self = 5858s exc_type = 5858s exc_val = CancelledError(), exc_tb = 5858s 5858s async def __aexit__( 5858s self, 5858s exc_type: Optional[Type[BaseException]], 5858s exc_val: Optional[BaseException], 5858s exc_tb: Optional[TracebackType], 5858s ) -> Optional[bool]: 5858s assert self._state in (_State.ENTERED, _State.EXPIRING) 5858s 5858s if self._timeout_handler is not None: 5858s self._timeout_handler.cancel() 5858s self._timeout_handler = None 5858s 5858s if self._state is _State.EXPIRING: 5858s self._state = _State.EXPIRED 5858s 5858s if self._task.uncancel() <= self._cancelling and exc_type is exceptions.CancelledError: 5858s # Since there are no new cancel requests, we're 5858s # handling this. 5858s > raise TimeoutError from exc_val 5858s E TimeoutError 5858s 5858s /usr/lib/python3.12/asyncio/timeouts.py:115: TimeoutError 5858s ----------------------------- Captured stderr call ----------------------------- 5858s 2025-02-21 00:59:08,646 - distributed.scheduler - INFO - State start 5858s 2025-02-21 00:59:08,654 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:42955 5858s 2025-02-21 00:59:08,657 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:41239/status 5858s 2025-02-21 00:59:08,660 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5858s 2025-02-21 00:59:08,688 - distributed.nanny - INFO - Start Nanny at: 'tls://127.0.0.1:43253' 5858s 2025-02-21 00:59:08,690 - distributed.nanny - INFO - Start Nanny at: 'tls://127.0.0.1:44387' 5858s 2025-02-21 00:59:09,860 - distributed.worker.memory - WARNING - Ignoring provided memory limit 8326074368 due to system memory limit of 7.75 GiB 5858s 2025-02-21 00:59:09,887 - distributed.worker.memory - WARNING - Ignoring provided memory limit 8326074368 due to system memory limit of 7.75 GiB 5858s 2025-02-21 00:59:09,888 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:42223 5858s 2025-02-21 00:59:09,888 - distributed.worker - INFO - Listening to: tls://127.0.0.1:42223 5858s 2025-02-21 00:59:09,888 - distributed.worker - INFO - Worker name: 1 5858s 2025-02-21 00:59:09,888 - distributed.worker - INFO - dashboard at: 127.0.0.1:34745 5858s 2025-02-21 00:59:09,888 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42955 5858s 2025-02-21 00:59:09,888 - distributed.worker - INFO - ------------------------------------------------- 5858s 2025-02-21 00:59:09,888 - distributed.worker - INFO - Threads: 2 5858s 2025-02-21 00:59:09,888 - distributed.worker - INFO - Memory: 7.75 GiB 5858s 2025-02-21 00:59:09,888 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-t46rdvjj 5858s 2025-02-21 00:59:09,889 - distributed.worker - INFO - ------------------------------------------------- 5858s 2025-02-21 00:59:09,908 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34367 5858s 2025-02-21 00:59:09,909 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34367 5858s 2025-02-21 00:59:09,909 - distributed.worker - INFO - Worker name: 0 5858s 2025-02-21 00:59:09,909 - distributed.worker - INFO - dashboard at: 127.0.0.1:32859 5858s 2025-02-21 00:59:09,909 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:42955 5858s 2025-02-21 00:59:09,909 - distributed.worker - INFO - ------------------------------------------------- 5858s 2025-02-21 00:59:09,909 - distributed.worker - INFO - Threads: 1 5858s 2025-02-21 00:59:09,909 - distributed.worker - INFO - Memory: 7.75 GiB 5858s 2025-02-21 00:59:09,909 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-b0v8gt1c 5858s 2025-02-21 00:59:09,909 - distributed.worker - INFO - ------------------------------------------------- 5858s 2025-02-21 00:59:10,299 - distributed.scheduler - INFO - Register worker addr: tls://127.0.0.1:34367 name: 0 5858s 2025-02-21 00:59:10,329 - distributed.worker - INFO - Starting Worker plugin shuffle 5858s 2025-02-21 00:59:10,330 - distributed.worker - INFO - Registered to: tls://127.0.0.1:42955 5858s 2025-02-21 00:59:10,330 - distributed.worker - INFO - ------------------------------------------------- 5858s 2025-02-21 00:59:10,331 - distributed.core - INFO - Starting established connection to tls://127.0.0.1:42955 5858s 2025-02-21 00:59:10,328 - distributed.scheduler - INFO - Starting worker compute stream, tls://127.0.0.1:34367 5858s 2025-02-21 00:59:10,331 - distributed.core - INFO - Starting established connection to tls://127.0.0.1:57042 5858s 2025-02-21 00:59:10,388 - distributed.scheduler - INFO - Register worker addr: tls://127.0.0.1:42223 name: 1 5858s 2025-02-21 00:59:10,419 - distributed.worker - INFO - Starting Worker plugin shuffle 5858s 2025-02-21 00:59:10,420 - distributed.worker - INFO - Registered to: tls://127.0.0.1:42955 5858s 2025-02-21 00:59:10,420 - distributed.worker - INFO - ------------------------------------------------- 5858s 2025-02-21 00:59:10,420 - distributed.core - INFO - Starting established connection to tls://127.0.0.1:42955 5858s 2025-02-21 00:59:10,418 - distributed.scheduler - INFO - Starting worker compute stream, tls://127.0.0.1:42223 5858s 2025-02-21 00:59:10,421 - distributed.core - INFO - Starting established connection to tls://127.0.0.1:57028 5858s 2025-02-21 00:59:10,422 - distributed.core - INFO - Connection to tls://127.0.0.1:57028 has been closed. 5858s 2025-02-21 00:59:10,422 - distributed.core - INFO - Connection to tls://127.0.0.1:42955 has been closed. 5858s 2025-02-21 00:59:10,422 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:42223. Reason: worker-handle-scheduler-connection-broken 5858s 2025-02-21 00:59:10,422 - distributed.scheduler - INFO - Remove worker addr: tls://127.0.0.1:42223 name: 1 (stimulus_id='handle-worker-cleanup-1740099550.422529') 5858s 2025-02-21 00:59:10,434 - distributed.nanny - INFO - Closing Nanny gracefully at 'tls://127.0.0.1:44387'. Reason: worker-handle-scheduler-connection-broken 5858s 2025-02-21 00:59:10,434 - distributed.worker - INFO - Removing Worker plugin shuffle 5858s 2025-02-21 00:59:10,436 - distributed.nanny - INFO - Worker closed 5858s 2025-02-21 00:59:12,438 - distributed.nanny - ERROR - Worker process died unexpectedly 5858s 2025-02-21 00:59:12,633 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:44387'. Reason: nanny-close-gracefully 5858s 2025-02-21 00:59:12,633 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:44387' closed. 5858s 2025-02-21 00:59:40,443 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:43253'. Reason: nanny-close 5858s 2025-02-21 00:59:40,444 - distributed.nanny - INFO - Nanny asking worker to close. Reason: nanny-close 5858s 2025-02-21 00:59:40,444 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34367. Reason: nanny-close 5858s 2025-02-21 00:59:40,445 - distributed.worker - INFO - Removing Worker plugin shuffle 5858s 2025-02-21 00:59:40,446 - distributed.core - INFO - Received 'close-stream' from tls://127.0.0.1:57042; closing. 5858s 2025-02-21 00:59:40,446 - distributed.core - INFO - Connection to tls://127.0.0.1:42955 has been closed. 5858s 2025-02-21 00:59:40,448 - distributed.nanny - INFO - Worker closed 5858s 2025-02-21 00:59:40,446 - distributed.scheduler - INFO - Remove worker addr: tls://127.0.0.1:34367 name: 0 (stimulus_id='handle-worker-cleanup-1740099580.4466338') 5858s 2025-02-21 00:59:40,451 - distributed.scheduler - INFO - Lost all workers 5858s 2025-02-21 00:59:40,670 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:43253' closed. 5858s 2025-02-21 00:59:40,670 - distributed.scheduler - INFO - Closing scheduler. Reason: unknown 5858s 2025-02-21 00:59:40,674 - distributed.scheduler - INFO - Scheduler closing all comms 5858s 2025-02-21 00:59:40,680 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Cluster creation timeout; retrying 5858s Traceback (most recent call last): 5858s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 974, in _cluster_factory 5858s s, ws = await start_cluster( 5858s ^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 806, in start_cluster 5858s raise TimeoutError("Cluster creation timeout") 5858s TimeoutError: Cluster creation timeout 5858s 2025-02-21 00:59:41,684 - distributed.scheduler - INFO - State start 5858s 2025-02-21 00:59:41,691 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:39993 5858s 2025-02-21 00:59:41,694 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:45571/status 5858s 2025-02-21 00:59:41,697 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5858s 2025-02-21 00:59:41,709 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:45115'. Reason: failure-to-start- 5858s 2025-02-21 00:59:41,709 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:45115' closed. 5858s 2025-02-21 00:59:41,709 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:38117'. Reason: failure-to-start- 5858s 2025-02-21 00:59:41,710 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:38117' closed. 5858s 2025-02-21 00:59:41,710 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39993': TLS handshake failed with remote 'tls://127.0.0.1:48362': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1011) 5858s 2025-02-21 00:59:41,710 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39993': TLS handshake failed with remote 'tls://127.0.0.1:48370': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1011) 5858s 2025-02-21 00:59:41,710 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 5858s Traceback (most recent call last): 5858s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 5858s return await fut 5858s ^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 5858s comm = await self.rpc.connect(saddr) 5858s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1485, in connect 5858s return await self._connect(addr=addr, timeout=timeout) 5858s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1429, in _connect 5858s comm = await connect( 5858s ^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5858s comm = await wait_for( 5858s ^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 5858s return await fut 5858s ^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5858s stream = await self.client.connect( 5858s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5858s af, addr, stream = await connector.start(connect_timeout=timeout) 5858s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5858s asyncio.exceptions.CancelledError 5858s 5858s The above exception was the direct cause of the following exception: 5858s 5858s Traceback (most recent call last): 5858s File "/usr/lib/python3/dist-packages/distributed/core.py", line 528, in start 5858s await wait_for(self.start_unsafe(), timeout=timeout) 5858s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1913, in wait_for 5858s async with asyncio.timeout(timeout): 5858s ^^^^^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3.12/asyncio/timeouts.py", line 115, in __aexit__ 5858s raise TimeoutError from exc_val 5858s TimeoutError 5858s 5858s The above exception was the direct cause of the following exception: 5858s 5858s Traceback (most recent call last): 5858s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 974, in _cluster_factory 5858s s, ws = await start_cluster( 5858s ^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 791, in start_cluster 5858s await asyncio.gather(*workers) 5858s File "/usr/lib/python3.12/asyncio/tasks.py", line 684, in _wrap_awaitable 5858s return await awaitable 5858s ^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/core.py", line 531, in start 5858s raise asyncio.TimeoutError( 5858s TimeoutError: Nanny start timed out after 0s. 5858s 2025-02-21 00:59:42,715 - distributed.scheduler - INFO - State start 5858s 2025-02-21 00:59:42,723 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:42477 5858s 2025-02-21 00:59:42,727 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:46873/status 5858s 2025-02-21 00:59:42,729 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5858s 2025-02-21 00:59:42,740 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:35627'. Reason: failure-to-start- 5858s 2025-02-21 00:59:42,741 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:35627' closed. 5858s 2025-02-21 00:59:42,741 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:37395'. Reason: failure-to-start- 5858s 2025-02-21 00:59:42,741 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:37395' closed. 5858s 2025-02-21 00:59:42,742 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42477': TLS handshake failed with remote 'tls://127.0.0.1:50856': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1011) 5858s 2025-02-21 00:59:42,742 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42477': TLS handshake failed with remote 'tls://127.0.0.1:50862': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1011) 5858s 2025-02-21 00:59:42,742 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 5858s Traceback (most recent call last): 5858s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 5858s return await fut 5858s ^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 5858s comm = await self.rpc.connect(saddr) 5858s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1485, in connect 5858s return await self._connect(addr=addr, timeout=timeout) 5858s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1429, in _connect 5858s comm = await connect( 5858s ^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5858s comm = await wait_for( 5858s ^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 5858s return await fut 5858s ^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5858s stream = await self.client.connect( 5858s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5858s af, addr, stream = await connector.start(connect_timeout=timeout) 5858s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5858s asyncio.exceptions.CancelledError 5858s 5858s The above exception was the direct cause of the following exception: 5858s 5858s Traceback (most recent call last): 5858s File "/usr/lib/python3/dist-packages/distributed/core.py", line 528, in start 5858s await wait_for(self.start_unsafe(), timeout=timeout) 5858s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1913, in wait_for 5858s async with asyncio.timeout(timeout): 5858s ^^^^^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3.12/asyncio/timeouts.py", line 115, in __aexit__ 5858s raise TimeoutError from exc_val 5858s TimeoutError 5858s 5858s The above exception was the direct cause of the following exception: 5858s 5858s Traceback (most recent call last): 5858s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 974, in _cluster_factory 5858s s, ws = await start_cluster( 5858s ^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 791, in start_cluster 5858s await asyncio.gather(*workers) 5858s File "/usr/lib/python3.12/asyncio/tasks.py", line 684, in _wrap_awaitable 5858s return await awaitable 5858s ^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/core.py", line 531, in start 5858s raise asyncio.TimeoutError( 5858s TimeoutError: Nanny start timed out after 0s. 5858s 2025-02-21 00:59:43,748 - distributed.scheduler - INFO - State start 5858s 2025-02-21 00:59:43,756 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44413 5858s 2025-02-21 00:59:43,759 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:46593/status 5858s 2025-02-21 00:59:43,762 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5858s 2025-02-21 00:59:43,774 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:32773'. Reason: failure-to-start- 5858s 2025-02-21 00:59:43,774 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:32773' closed. 5858s 2025-02-21 00:59:43,774 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:37413'. Reason: failure-to-start- 5858s 2025-02-21 00:59:43,774 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:37413' closed. 5858s 2025-02-21 00:59:43,775 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44413': TLS handshake failed with remote 'tls://127.0.0.1:59062': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1011) 5858s 2025-02-21 00:59:43,775 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44413': TLS handshake failed with remote 'tls://127.0.0.1:59076': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1011) 5858s 2025-02-21 00:59:43,775 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 5858s Traceback (most recent call last): 5858s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 5858s return await fut 5858s ^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 5858s comm = await self.rpc.connect(saddr) 5858s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1485, in connect 5858s return await self._connect(addr=addr, timeout=timeout) 5858s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1429, in _connect 5858s comm = await connect( 5858s ^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5858s comm = await wait_for( 5858s ^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 5858s return await fut 5858s ^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5858s stream = await self.client.connect( 5858s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5858s af, addr, stream = await connector.start(connect_timeout=timeout) 5858s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5858s asyncio.exceptions.CancelledError 5858s 5858s The above exception was the direct cause of the following exception: 5858s 5858s Traceback (most recent call last): 5858s File "/usr/lib/python3/dist-packages/distributed/core.py", line 528, in start 5858s await wait_for(self.start_unsafe(), timeout=timeout) 5858s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1913, in wait_for 5858s async with asyncio.timeout(timeout): 5858s ^^^^^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3.12/asyncio/timeouts.py", line 115, in __aexit__ 5858s raise TimeoutError from exc_val 5858s TimeoutError 5858s 5858s The above exception was the direct cause of the following exception: 5858s 5858s Traceback (most recent call last): 5858s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 974, in _cluster_factory 5858s s, ws = await start_cluster( 5858s ^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 791, in start_cluster 5858s await asyncio.gather(*workers) 5858s File "/usr/lib/python3.12/asyncio/tasks.py", line 684, in _wrap_awaitable 5858s return await awaitable 5858s ^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/core.py", line 531, in start 5858s raise asyncio.TimeoutError( 5858s TimeoutError: Nanny start timed out after 0s. 5858s 2025-02-21 00:59:44,779 - distributed.scheduler - INFO - State start 5858s 2025-02-21 00:59:44,787 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:33977 5858s 2025-02-21 00:59:44,795 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:35621/status 5858s 2025-02-21 00:59:44,802 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5858s 2025-02-21 00:59:44,817 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:36741'. Reason: failure-to-start- 5858s 2025-02-21 00:59:44,817 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:36741' closed. 5858s 2025-02-21 00:59:44,817 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:33117'. Reason: failure-to-start- 5858s 2025-02-21 00:59:44,817 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:33117' closed. 5858s 2025-02-21 00:59:44,818 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33977': TLS handshake failed with remote 'tls://127.0.0.1:39622': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1011) 5858s 2025-02-21 00:59:44,818 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33977': TLS handshake failed with remote 'tls://127.0.0.1:39630': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1011) 5858s 2025-02-21 00:59:44,818 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 5858s Traceback (most recent call last): 5858s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 5858s return await fut 5858s ^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 5858s comm = await self.rpc.connect(saddr) 5858s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1485, in connect 5858s return await self._connect(addr=addr, timeout=timeout) 5858s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1429, in _connect 5858s comm = await connect( 5858s ^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5858s comm = await wait_for( 5858s ^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 5858s return await fut 5858s ^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5858s stream = await self.client.connect( 5858s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5858s af, addr, stream = await connector.start(connect_timeout=timeout) 5858s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5858s asyncio.exceptions.CancelledError 5858s 5858s The above exception was the direct cause of the following exception: 5858s 5858s Traceback (most recent call last): 5858s File "/usr/lib/python3/dist-packages/distributed/core.py", line 528, in start 5858s await wait_for(self.start_unsafe(), timeout=timeout) 5858s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1913, in wait_for 5858s async with asyncio.timeout(timeout): 5858s ^^^^^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3.12/asyncio/timeouts.py", line 115, in __aexit__ 5858s raise TimeoutError from exc_val 5858s TimeoutError 5858s 5858s The above exception was the direct cause of the following exception: 5858s 5858s Traceback (most recent call last): 5858s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 974, in _cluster_factory 5858s s, ws = await start_cluster( 5858s ^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 791, in start_cluster 5858s await asyncio.gather(*workers) 5858s File "/usr/lib/python3.12/asyncio/tasks.py", line 684, in _wrap_awaitable 5858s return await awaitable 5858s ^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/core.py", line 531, in start 5858s raise asyncio.TimeoutError( 5858s TimeoutError: Nanny start timed out after 0s. 5858s 2025-02-21 00:59:45,822 - distributed.scheduler - INFO - State start 5858s 2025-02-21 00:59:45,837 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:46495 5858s 2025-02-21 00:59:45,844 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:33365/status 5858s 2025-02-21 00:59:45,849 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5858s 2025-02-21 00:59:45,868 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:33249'. Reason: failure-to-start- 5858s 2025-02-21 00:59:45,869 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:33249' closed. 5858s 2025-02-21 00:59:45,869 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:42827'. Reason: failure-to-start- 5858s 2025-02-21 00:59:45,869 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:42827' closed. 5858s 2025-02-21 00:59:45,870 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46495': TLS handshake failed with remote 'tls://127.0.0.1:33376': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1011) 5858s 2025-02-21 00:59:45,870 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46495': TLS handshake failed with remote 'tls://127.0.0.1:33378': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1011) 5858s 2025-02-21 00:59:45,870 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 5858s Traceback (most recent call last): 5858s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 5858s return await fut 5858s ^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 5858s comm = await self.rpc.connect(saddr) 5858s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1485, in connect 5858s return await self._connect(addr=addr, timeout=timeout) 5858s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1429, in _connect 5858s comm = await connect( 5858s ^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5858s comm = await wait_for( 5858s ^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 5858s return await fut 5858s ^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5858s stream = await self.client.connect( 5858s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5858s af, addr, stream = await connector.start(connect_timeout=timeout) 5858s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5858s asyncio.exceptions.CancelledError 5858s 5858s The above exception was the direct cause of the following exception: 5858s 5858s Traceback (most recent call last): 5858s File "/usr/lib/python3/dist-packages/distributed/core.py", line 528, in start 5858s await wait_for(self.start_unsafe(), timeout=timeout) 5858s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1913, in wait_for 5858s async with asyncio.timeout(timeout): 5858s ^^^^^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3.12/asyncio/timeouts.py", line 115, in __aexit__ 5858s raise TimeoutError from exc_val 5858s TimeoutError 5858s 5858s The above exception was the direct cause of the following exception: 5858s 5858s Traceback (most recent call last): 5858s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 974, in _cluster_factory 5858s s, ws = await start_cluster( 5858s ^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 791, in start_cluster 5858s await asyncio.gather(*workers) 5858s File "/usr/lib/python3.12/asyncio/tasks.py", line 684, in _wrap_awaitable 5858s return await awaitable 5858s ^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/core.py", line 531, in start 5858s raise asyncio.TimeoutError( 5858s TimeoutError: Nanny start timed out after 0s. 5858s 2025-02-21 00:59:46,875 - distributed.scheduler - INFO - State start 5858s 2025-02-21 00:59:46,884 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44665 5858s 2025-02-21 00:59:46,887 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:36429/status 5858s 2025-02-21 00:59:46,890 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5858s 2025-02-21 00:59:46,902 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:37381'. Reason: failure-to-start- 5858s 2025-02-21 00:59:46,903 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:37381' closed. 5858s 2025-02-21 00:59:46,903 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:44905'. Reason: failure-to-start- 5858s 2025-02-21 00:59:46,903 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:44905' closed. 5858s 2025-02-21 00:59:46,908 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44665': TLS handshake failed with remote 'tls://127.0.0.1:40420': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1011) 5858s 2025-02-21 00:59:46,908 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44665': TLS handshake failed with remote 'tls://127.0.0.1:40434': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1011) 5858s 2025-02-21 00:59:46,909 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 5858s Traceback (most recent call last): 5858s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 5858s return await fut 5858s ^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 5858s comm = await self.rpc.connect(saddr) 5858s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1485, in connect 5858s return await self._connect(addr=addr, timeout=timeout) 5858s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1429, in _connect 5858s comm = await connect( 5858s ^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5858s comm = await wait_for( 5858s ^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 5858s return await fut 5858s ^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5858s stream = await self.client.connect( 5858s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5858s af, addr, stream = await connector.start(connect_timeout=timeout) 5858s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5858s asyncio.exceptions.CancelledError 5858s 5858s The above exception was the direct cause of the following exception: 5858s 5858s Traceback (most recent call last): 5858s File "/usr/lib/python3/dist-packages/distributed/core.py", line 528, in start 5858s await wait_for(self.start_unsafe(), timeout=timeout) 5858s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1913, in wait_for 5858s async with asyncio.timeout(timeout): 5858s ^^^^^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3.12/asyncio/timeouts.py", line 115, in __aexit__ 5858s raise TimeoutError from exc_val 5858s TimeoutError 5858s 5858s The above exception was the direct cause of the following exception: 5858s 5858s Traceback (most recent call last): 5858s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 974, in _cluster_factory 5858s s, ws = await start_cluster( 5858s ^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 791, in start_cluster 5858s await asyncio.gather(*workers) 5858s File "/usr/lib/python3.12/asyncio/tasks.py", line 684, in _wrap_awaitable 5858s return await awaitable 5858s ^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/core.py", line 531, in start 5858s raise asyncio.TimeoutError( 5858s TimeoutError: Nanny start timed out after 0s. 5858s 2025-02-21 00:59:47,912 - distributed.scheduler - INFO - State start 5858s 2025-02-21 00:59:47,920 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37597 5858s 2025-02-21 00:59:47,924 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:32959/status 5858s 2025-02-21 00:59:47,927 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5858s 2025-02-21 00:59:47,941 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:38883'. Reason: failure-to-start- 5858s 2025-02-21 00:59:47,942 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:38883' closed. 5858s 2025-02-21 00:59:47,942 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:35401'. Reason: failure-to-start- 5858s 2025-02-21 00:59:47,942 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:35401' closed. 5858s 2025-02-21 00:59:47,943 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37597': TLS handshake failed with remote 'tls://127.0.0.1:38080': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1011) 5858s 2025-02-21 00:59:47,943 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37597': TLS handshake failed with remote 'tls://127.0.0.1:38092': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1011) 5858s 2025-02-21 00:59:47,943 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 5858s Traceback (most recent call last): 5858s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 5858s return await fut 5858s ^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 5858s comm = await self.rpc.connect(saddr) 5858s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1485, in connect 5858s return await self._connect(addr=addr, timeout=timeout) 5858s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1429, in _connect 5858s comm = await connect( 5858s ^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5858s comm = await wait_for( 5858s ^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 5858s return await fut 5858s ^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5858s stream = await self.client.connect( 5858s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5858s af, addr, stream = await connector.start(connect_timeout=timeout) 5858s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5858s asyncio.exceptions.CancelledError 5858s 5858s The above exception was the direct cause of the following exception: 5858s 5858s Traceback (most recent call last): 5858s File "/usr/lib/python3/dist-packages/distributed/core.py", line 528, in start 5858s await wait_for(self.start_unsafe(), timeout=timeout) 5858s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1913, in wait_for 5858s async with asyncio.timeout(timeout): 5858s ^^^^^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3.12/asyncio/timeouts.py", line 115, in __aexit__ 5858s raise TimeoutError from exc_val 5858s TimeoutError 5858s 5858s The above exception was the direct cause of the following exception: 5858s 5858s Traceback (most recent call last): 5858s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 974, in _cluster_factory 5858s s, ws = await start_cluster( 5858s ^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 791, in start_cluster 5858s await asyncio.gather(*workers) 5858s File "/usr/lib/python3.12/asyncio/tasks.py", line 684, in _wrap_awaitable 5858s return await awaitable 5858s ^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/core.py", line 531, in start 5858s raise asyncio.TimeoutError( 5858s TimeoutError: Nanny start timed out after 0s. 5858s 2025-02-21 00:59:48,947 - distributed.scheduler - INFO - State start 5858s 2025-02-21 00:59:48,954 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:36911 5858s 2025-02-21 00:59:48,957 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:42975/status 5858s 2025-02-21 00:59:48,959 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5858s 2025-02-21 00:59:48,970 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:36987'. Reason: failure-to-start- 5858s 2025-02-21 00:59:48,970 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:36987' closed. 5858s 2025-02-21 00:59:48,970 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:37613'. Reason: failure-to-start- 5858s 2025-02-21 00:59:48,970 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:37613' closed. 5858s 2025-02-21 00:59:48,971 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36911': TLS handshake failed with remote 'tls://127.0.0.1:40040': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1011) 5858s 2025-02-21 00:59:48,971 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36911': TLS handshake failed with remote 'tls://127.0.0.1:40054': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1011) 5858s 2025-02-21 00:59:48,971 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 5858s Traceback (most recent call last): 5858s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 5858s return await fut 5858s ^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 5858s comm = await self.rpc.connect(saddr) 5858s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1485, in connect 5858s return await self._connect(addr=addr, timeout=timeout) 5858s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1429, in _connect 5858s comm = await connect( 5858s ^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5858s comm = await wait_for( 5858s ^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 5858s return await fut 5858s ^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5858s stream = await self.client.connect( 5858s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5858s af, addr, stream = await connector.start(connect_timeout=timeout) 5858s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5858s asyncio.exceptions.CancelledError 5858s 5858s The above exception was the direct cause of the following exception: 5858s 5858s Traceback (most recent call last): 5858s File "/usr/lib/python3/dist-packages/distributed/core.py", line 528, in start 5858s await wait_for(self.start_unsafe(), timeout=timeout) 5858s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1913, in wait_for 5858s async with asyncio.timeout(timeout): 5858s ^^^^^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3.12/asyncio/timeouts.py", line 115, in __aexit__ 5858s raise TimeoutError from exc_val 5858s TimeoutError 5858s 5858s The above exception was the direct cause of the following exception: 5858s 5858s Traceback (most recent call last): 5858s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 974, in _cluster_factory 5858s s, ws = await start_cluster( 5858s ^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 791, in start_cluster 5858s await asyncio.gather(*workers) 5858s File "/usr/lib/python3.12/asyncio/tasks.py", line 684, in _wrap_awaitable 5858s return await awaitable 5858s ^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/core.py", line 531, in start 5858s raise asyncio.TimeoutError( 5858s TimeoutError: Nanny start timed out after 0s. 5858s 2025-02-21 00:59:49,976 - distributed.scheduler - INFO - State start 5858s 2025-02-21 00:59:49,983 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:33291 5858s 2025-02-21 00:59:49,985 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:37885/status 5858s 2025-02-21 00:59:49,987 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5858s 2025-02-21 00:59:49,994 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:45111'. Reason: failure-to-start- 5858s 2025-02-21 00:59:49,995 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:45111' closed. 5858s 2025-02-21 00:59:49,995 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:37675'. Reason: failure-to-start- 5858s 2025-02-21 00:59:49,996 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:37675' closed. 5858s 2025-02-21 00:59:49,997 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33291': TLS handshake failed with remote 'tls://127.0.0.1:57116': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1011) 5858s 2025-02-21 00:59:49,997 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33291': TLS handshake failed with remote 'tls://127.0.0.1:57120': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1011) 5858s 2025-02-21 00:59:49,997 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 5858s Traceback (most recent call last): 5858s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 5858s return await fut 5858s ^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 5858s comm = await self.rpc.connect(saddr) 5858s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1485, in connect 5858s return await self._connect(addr=addr, timeout=timeout) 5858s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1429, in _connect 5858s comm = await connect( 5858s ^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5858s comm = await wait_for( 5858s ^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 5858s return await fut 5858s ^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5858s stream = await self.client.connect( 5858s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5858s af, addr, stream = await connector.start(connect_timeout=timeout) 5858s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5858s asyncio.exceptions.CancelledError 5858s 5858s The above exception was the direct cause of the following exception: 5858s 5858s Traceback (most recent call last): 5858s File "/usr/lib/python3/dist-packages/distributed/core.py", line 528, in start 5858s await wait_for(self.start_unsafe(), timeout=timeout) 5858s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1913, in wait_for 5858s async with asyncio.timeout(timeout): 5858s ^^^^^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3.12/asyncio/timeouts.py", line 115, in __aexit__ 5858s raise TimeoutError from exc_val 5858s TimeoutError 5858s 5858s The above exception was the direct cause of the following exception: 5858s 5858s Traceback (most recent call last): 5858s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 974, in _cluster_factory 5858s s, ws = await start_cluster( 5858s ^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 791, in start_cluster 5858s await asyncio.gather(*workers) 5858s File "/usr/lib/python3.12/asyncio/tasks.py", line 684, in _wrap_awaitable 5858s return await awaitable 5858s ^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/core.py", line 531, in start 5858s raise asyncio.TimeoutError( 5858s TimeoutError: Nanny start timed out after 0s. 5858s 2025-02-21 00:59:51,001 - distributed.scheduler - INFO - State start 5858s 2025-02-21 00:59:51,009 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44217 5858s 2025-02-21 00:59:51,013 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:34793/status 5858s 2025-02-21 00:59:51,015 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5858s 2025-02-21 00:59:51,025 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:33863'. Reason: failure-to-start- 5858s 2025-02-21 00:59:51,025 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:33863' closed. 5858s 2025-02-21 00:59:51,026 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:34139'. Reason: failure-to-start- 5858s 2025-02-21 00:59:51,026 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:34139' closed. 5858s 2025-02-21 00:59:51,026 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44217': TLS handshake failed with remote 'tls://127.0.0.1:54428': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1011) 5858s 2025-02-21 00:59:51,026 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44217': TLS handshake failed with remote 'tls://127.0.0.1:54442': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1011) 5858s 2025-02-21 00:59:51,026 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 5858s Traceback (most recent call last): 5858s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 5858s return await fut 5858s ^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 5858s comm = await self.rpc.connect(saddr) 5858s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1485, in connect 5858s return await self._connect(addr=addr, timeout=timeout) 5858s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1429, in _connect 5858s comm = await connect( 5858s ^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5858s comm = await wait_for( 5858s ^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 5858s return await fut 5858s ^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5858s stream = await self.client.connect( 5858s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5858s af, addr, stream = await connector.start(connect_timeout=timeout) 5858s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5858s asyncio.exceptions.CancelledError 5858s 5858s The above exception was the direct cause of the following exception: 5858s 5858s Traceback (most recent call last): 5858s File "/usr/lib/python3/dist-packages/distributed/core.py", line 528, in start 5858s await wait_for(self.start_unsafe(), timeout=timeout) 5858s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1913, in wait_for 5858s async with asyncio.timeout(timeout): 5858s ^^^^^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3.12/asyncio/timeouts.py", line 115, in __aexit__ 5858s raise TimeoutError from exc_val 5858s TimeoutError 5858s 5858s The above exception was the direct cause of the following exception: 5858s 5858s Traceback (most recent call last): 5858s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 974, in _cluster_factory 5858s s, ws = await start_cluster( 5858s ^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 791, in start_cluster 5858s await asyncio.gather(*workers) 5858s File "/usr/lib/python3.12/asyncio/tasks.py", line 684, in _wrap_awaitable 5858s return await awaitable 5858s ^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/core.py", line 531, in start 5858s raise asyncio.TimeoutError( 5858s TimeoutError: Nanny start timed out after 0s. 5858s 2025-02-21 00:59:52,030 - distributed.scheduler - INFO - State start 5858s 2025-02-21 00:59:52,041 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44159 5858s 2025-02-21 00:59:52,045 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:43565/status 5858s 2025-02-21 00:59:52,047 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5858s 2025-02-21 00:59:52,057 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:34521'. Reason: failure-to-start- 5858s 2025-02-21 00:59:52,057 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:34521' closed. 5858s 2025-02-21 00:59:52,057 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:33555'. Reason: failure-to-start- 5858s 2025-02-21 00:59:52,057 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:33555' closed. 5858s 2025-02-21 00:59:52,058 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44159': TLS handshake failed with remote 'tls://127.0.0.1:38848': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1011) 5858s 2025-02-21 00:59:52,058 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44159': TLS handshake failed with remote 'tls://127.0.0.1:38860': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1011) 5858s 2025-02-21 00:59:52,058 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 5858s Traceback (most recent call last): 5858s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 5858s return await fut 5858s ^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 5858s comm = await self.rpc.connect(saddr) 5858s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1485, in connect 5858s return await self._connect(addr=addr, timeout=timeout) 5858s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1429, in _connect 5858s comm = await connect( 5858s ^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5858s comm = await wait_for( 5858s ^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 5858s return await fut 5858s ^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5858s stream = await self.client.connect( 5858s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5858s af, addr, stream = await connector.start(connect_timeout=timeout) 5858s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5858s asyncio.exceptions.CancelledError 5858s 5858s The above exception was the direct cause of the following exception: 5858s 5858s Traceback (most recent call last): 5858s File "/usr/lib/python3/dist-packages/distributed/core.py", line 528, in start 5858s await wait_for(self.start_unsafe(), timeout=timeout) 5858s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1913, in wait_for 5858s async with asyncio.timeout(timeout): 5858s ^^^^^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3.12/asyncio/timeouts.py", line 115, in __aexit__ 5858s raise TimeoutError from exc_val 5858s TimeoutError 5858s 5858s The above exception was the direct cause of the following exception: 5858s 5858s Traceback (most recent call last): 5858s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 974, in _cluster_factory 5858s s, ws = await start_cluster( 5858s ^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 791, in start_cluster 5858s await asyncio.gather(*workers) 5858s File "/usr/lib/python3.12/asyncio/tasks.py", line 684, in _wrap_awaitable 5858s return await awaitable 5858s ^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/core.py", line 531, in start 5858s raise asyncio.TimeoutError( 5858s TimeoutError: Nanny start timed out after 0s. 5858s 2025-02-21 00:59:53,061 - distributed.scheduler - INFO - State start 5858s 2025-02-21 00:59:53,068 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:46871 5858s 2025-02-21 00:59:53,071 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:40379/status 5858s 2025-02-21 00:59:53,074 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5858s 2025-02-21 00:59:53,086 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:40077'. Reason: failure-to-start- 5858s 2025-02-21 00:59:53,086 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:40077' closed. 5858s 2025-02-21 00:59:53,086 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:46677'. Reason: failure-to-start- 5858s 2025-02-21 00:59:53,087 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:46677' closed. 5858s 2025-02-21 00:59:53,087 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46871': TLS handshake failed with remote 'tls://127.0.0.1:46272': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1011) 5858s 2025-02-21 00:59:53,087 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46871': TLS handshake failed with remote 'tls://127.0.0.1:46280': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1011) 5858s 2025-02-21 00:59:53,087 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 5858s Traceback (most recent call last): 5858s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 5858s return await fut 5858s ^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 5858s comm = await self.rpc.connect(saddr) 5858s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1485, in connect 5858s return await self._connect(addr=addr, timeout=timeout) 5858s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1429, in _connect 5858s comm = await connect( 5858s ^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5858s comm = await wait_for( 5858s ^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 5858s return await fut 5858s ^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5858s stream = await self.client.connect( 5858s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5858s af, addr, stream = await connector.start(connect_timeout=timeout) 5858s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5858s asyncio.exceptions.CancelledError 5858s 5858s The above exception was the direct cause of the following exception: 5858s 5858s Traceback (most recent call last): 5858s File "/usr/lib/python3/dist-packages/distributed/core.py", line 528, in start 5858s await wait_for(self.start_unsafe(), timeout=timeout) 5858s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1913, in wait_for 5858s async with asyncio.timeout(timeout): 5858s ^^^^^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3.12/asyncio/timeouts.py", line 115, in __aexit__ 5858s raise TimeoutError from exc_val 5858s TimeoutError 5858s 5858s The above exception was the direct cause of the following exception: 5858s 5858s Traceback (most recent call last): 5858s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 974, in _cluster_factory 5858s s, ws = await start_cluster( 5858s ^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 791, in start_cluster 5858s await asyncio.gather(*workers) 5858s File "/usr/lib/python3.12/asyncio/tasks.py", line 684, in _wrap_awaitable 5858s return await awaitable 5858s ^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/core.py", line 531, in start 5858s raise asyncio.TimeoutError( 5858s TimeoutError: Nanny start timed out after 0s. 5858s 2025-02-21 00:59:54,096 - distributed.scheduler - INFO - State start 5858s 2025-02-21 00:59:54,110 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37263 5858s 2025-02-21 00:59:54,114 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:44119/status 5858s 2025-02-21 00:59:54,116 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5858s 2025-02-21 00:59:54,125 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:42309'. Reason: failure-to-start- 5858s 2025-02-21 00:59:54,126 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:42309' closed. 5858s 2025-02-21 00:59:54,126 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:41595'. Reason: failure-to-start- 5858s 2025-02-21 00:59:54,126 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:41595' closed. 5858s 2025-02-21 00:59:54,126 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37263': TLS handshake failed with remote 'tls://127.0.0.1:35872': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1011) 5858s 2025-02-21 00:59:54,126 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37263': TLS handshake failed with remote 'tls://127.0.0.1:35888': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1011) 5858s 2025-02-21 00:59:54,126 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 5858s Traceback (most recent call last): 5858s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 5858s return await fut 5858s ^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 5858s comm = await self.rpc.connect(saddr) 5858s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1485, in connect 5858s return await self._connect(addr=addr, timeout=timeout) 5858s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1429, in _connect 5858s comm = await connect( 5858s ^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5858s comm = await wait_for( 5858s ^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 5858s return await fut 5858s ^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5858s stream = await self.client.connect( 5858s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5858s af, addr, stream = await connector.start(connect_timeout=timeout) 5858s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5858s asyncio.exceptions.CancelledError 5858s 5858s The above exception was the direct cause of the following exception: 5858s 5858s Traceback (most recent call last): 5858s File "/usr/lib/python3/dist-packages/distributed/core.py", line 528, in start 5858s await wait_for(self.start_unsafe(), timeout=timeout) 5858s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1913, in wait_for 5858s async with asyncio.timeout(timeout): 5858s ^^^^^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3.12/asyncio/timeouts.py", line 115, in __aexit__ 5858s raise TimeoutError from exc_val 5858s TimeoutError 5858s 5858s The above exception was the direct cause of the following exception: 5858s 5858s Traceback (most recent call last): 5858s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 974, in _cluster_factory 5858s s, ws = await start_cluster( 5858s ^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 791, in start_cluster 5858s await asyncio.gather(*workers) 5858s File "/usr/lib/python3.12/asyncio/tasks.py", line 684, in _wrap_awaitable 5858s return await awaitable 5858s ^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/core.py", line 531, in start 5858s raise asyncio.TimeoutError( 5858s TimeoutError: Nanny start timed out after 0s. 5858s 2025-02-21 00:59:55,132 - distributed.scheduler - INFO - State start 5858s 2025-02-21 00:59:55,139 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37585 5858s 2025-02-21 00:59:55,142 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:46263/status 5858s 2025-02-21 00:59:55,144 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5858s 2025-02-21 00:59:55,160 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:39767'. Reason: failure-to-start- 5858s 2025-02-21 00:59:55,160 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:39767' closed. 5858s 2025-02-21 00:59:55,160 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:38821'. Reason: failure-to-start- 5858s 2025-02-21 00:59:55,161 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:38821' closed. 5858s 2025-02-21 00:59:55,161 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37585': TLS handshake failed with remote 'tls://127.0.0.1:43178': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1011) 5858s 2025-02-21 00:59:55,161 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37585': TLS handshake failed with remote 'tls://127.0.0.1:43186': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1011) 5858s 2025-02-21 00:59:55,161 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 5858s Traceback (most recent call last): 5858s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 5858s return await fut 5858s ^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 5858s comm = await self.rpc.connect(saddr) 5858s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1485, in connect 5858s return await self._connect(addr=addr, timeout=timeout) 5858s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1429, in _connect 5858s comm = await connect( 5858s ^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5858s comm = await wait_for( 5858s ^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 5858s return await fut 5858s ^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5858s stream = await self.client.connect( 5858s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5858s af, addr, stream = await connector.start(connect_timeout=timeout) 5858s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5858s asyncio.exceptions.CancelledError 5858s 5858s The above exception was the direct cause of the following exception: 5858s 5858s Traceback (most recent call last): 5858s File "/usr/lib/python3/dist-packages/distributed/core.py", line 528, in start 5858s await wait_for(self.start_unsafe(), timeout=timeout) 5858s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1913, in wait_for 5858s async with asyncio.timeout(timeout): 5858s ^^^^^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3.12/asyncio/timeouts.py", line 115, in __aexit__ 5858s raise TimeoutError from exc_val 5858s TimeoutError 5858s 5858s The above exception was the direct cause of the following exception: 5858s 5858s Traceback (most recent call last): 5858s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 974, in _cluster_factory 5858s s, ws = await start_cluster( 5858s ^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 791, in start_cluster 5858s await asyncio.gather(*workers) 5858s File "/usr/lib/python3.12/asyncio/tasks.py", line 684, in _wrap_awaitable 5858s return await awaitable 5858s ^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/core.py", line 531, in start 5858s raise asyncio.TimeoutError( 5858s TimeoutError: Nanny start timed out after 0s. 5858s 2025-02-21 00:59:56,165 - distributed.scheduler - INFO - State start 5858s 2025-02-21 00:59:56,175 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:36897 5858s 2025-02-21 00:59:56,178 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:39827/status 5858s 2025-02-21 00:59:56,180 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5858s 2025-02-21 00:59:56,191 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:46507'. Reason: failure-to-start- 5858s 2025-02-21 00:59:56,191 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:46507' closed. 5858s 2025-02-21 00:59:56,191 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:35911'. Reason: failure-to-start- 5858s 2025-02-21 00:59:56,192 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:35911' closed. 5858s 2025-02-21 00:59:56,192 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36897': TLS handshake failed with remote 'tls://127.0.0.1:49308': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1011) 5858s 2025-02-21 00:59:56,192 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36897': TLS handshake failed with remote 'tls://127.0.0.1:49312': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1011) 5858s 2025-02-21 00:59:56,192 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 5858s Traceback (most recent call last): 5858s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 5858s return await fut 5858s ^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 5858s comm = await self.rpc.connect(saddr) 5858s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1485, in connect 5858s return await self._connect(addr=addr, timeout=timeout) 5858s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1429, in _connect 5858s comm = await connect( 5858s ^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5858s comm = await wait_for( 5858s ^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 5858s return await fut 5858s ^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5858s stream = await self.client.connect( 5858s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5858s af, addr, stream = await connector.start(connect_timeout=timeout) 5858s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5858s asyncio.exceptions.CancelledError 5858s 5858s The above exception was the direct cause of the following exception: 5858s 5858s Traceback (most recent call last): 5858s File "/usr/lib/python3/dist-packages/distributed/core.py", line 528, in start 5858s await wait_for(self.start_unsafe(), timeout=timeout) 5858s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1913, in wait_for 5858s async with asyncio.timeout(timeout): 5858s ^^^^^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3.12/asyncio/timeouts.py", line 115, in __aexit__ 5858s raise TimeoutError from exc_val 5858s TimeoutError 5858s 5858s The above exception was the direct cause of the following exception: 5858s 5858s Traceback (most recent call last): 5858s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 974, in _cluster_factory 5858s s, ws = await start_cluster( 5858s ^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 791, in start_cluster 5858s await asyncio.gather(*workers) 5858s File "/usr/lib/python3.12/asyncio/tasks.py", line 684, in _wrap_awaitable 5858s return await awaitable 5858s ^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/core.py", line 531, in start 5858s raise asyncio.TimeoutError( 5858s TimeoutError: Nanny start timed out after 0s. 5858s 2025-02-21 00:59:57,196 - distributed.scheduler - INFO - State start 5858s 2025-02-21 00:59:57,209 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:40759 5858s 2025-02-21 00:59:57,212 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:45643/status 5858s 2025-02-21 00:59:57,214 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5858s 2025-02-21 00:59:57,225 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:46009'. Reason: failure-to-start- 5858s 2025-02-21 00:59:57,226 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:46009' closed. 5858s 2025-02-21 00:59:57,226 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:45485'. Reason: failure-to-start- 5858s 2025-02-21 00:59:57,226 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:45485' closed. 5858s 2025-02-21 00:59:57,226 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40759': TLS handshake failed with remote 'tls://127.0.0.1:51664': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1011) 5858s 2025-02-21 00:59:57,227 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40759': TLS handshake failed with remote 'tls://127.0.0.1:51666': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1011) 5858s 2025-02-21 00:59:57,227 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 5858s Traceback (most recent call last): 5858s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 5858s return await fut 5858s ^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 5858s comm = await self.rpc.connect(saddr) 5858s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1485, in connect 5858s return await self._connect(addr=addr, timeout=timeout) 5858s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1429, in _connect 5858s comm = await connect( 5858s ^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5858s comm = await wait_for( 5858s ^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 5858s return await fut 5858s ^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5858s stream = await self.client.connect( 5858s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5858s af, addr, stream = await connector.start(connect_timeout=timeout) 5858s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5858s asyncio.exceptions.CancelledError 5858s 5858s The above exception was the direct cause of the following exception: 5858s 5858s Traceback (most recent call last): 5858s File "/usr/lib/python3/dist-packages/distributed/core.py", line 528, in start 5858s await wait_for(self.start_unsafe(), timeout=timeout) 5858s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1913, in wait_for 5858s async with asyncio.timeout(timeout): 5858s ^^^^^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3.12/asyncio/timeouts.py", line 115, in __aexit__ 5858s raise TimeoutError from exc_val 5858s TimeoutError 5858s 5858s The above exception was the direct cause of the following exception: 5858s 5858s Traceback (most recent call last): 5858s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 974, in _cluster_factory 5858s s, ws = await start_cluster( 5858s ^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 791, in start_cluster 5858s await asyncio.gather(*workers) 5858s File "/usr/lib/python3.12/asyncio/tasks.py", line 684, in _wrap_awaitable 5858s return await awaitable 5858s ^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/core.py", line 531, in start 5858s raise asyncio.TimeoutError( 5858s TimeoutError: Nanny start timed out after 0s. 5858s 2025-02-21 00:59:58,232 - distributed.scheduler - INFO - State start 5858s 2025-02-21 00:59:58,244 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:36213 5858s 2025-02-21 00:59:58,248 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:36889/status 5858s 2025-02-21 00:59:58,252 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5858s 2025-02-21 00:59:58,268 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:46463'. Reason: failure-to-start- 5858s 2025-02-21 00:59:58,268 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:46463' closed. 5858s 2025-02-21 00:59:58,269 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:34299'. Reason: failure-to-start- 5858s 2025-02-21 00:59:58,269 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:34299' closed. 5858s 2025-02-21 00:59:58,271 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36213': TLS handshake failed with remote 'tls://127.0.0.1:55370': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1011) 5858s 2025-02-21 00:59:58,271 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36213': TLS handshake failed with remote 'tls://127.0.0.1:55382': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1011) 5858s 2025-02-21 00:59:58,271 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 5858s Traceback (most recent call last): 5858s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 5858s return await fut 5858s ^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 5858s comm = await self.rpc.connect(saddr) 5858s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1485, in connect 5858s return await self._connect(addr=addr, timeout=timeout) 5858s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1429, in _connect 5858s comm = await connect( 5858s ^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5858s comm = await wait_for( 5858s ^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 5858s return await fut 5858s ^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5858s stream = await self.client.connect( 5858s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5858s af, addr, stream = await connector.start(connect_timeout=timeout) 5858s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5858s asyncio.exceptions.CancelledError 5858s 5858s The above exception was the direct cause of the following exception: 5858s 5858s Traceback (most recent call last): 5858s File "/usr/lib/python3/dist-packages/distributed/core.py", line 528, in start 5858s await wait_for(self.start_unsafe(), timeout=timeout) 5858s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1913, in wait_for 5858s async with asyncio.timeout(timeout): 5858s ^^^^^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3.12/asyncio/timeouts.py", line 115, in __aexit__ 5858s raise TimeoutError from exc_val 5858s TimeoutError 5858s 5858s The above exception was the direct cause of the following exception: 5858s 5858s Traceback (most recent call last): 5858s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 974, in _cluster_factory 5858s s, ws = await start_cluster( 5858s ^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 791, in start_cluster 5858s await asyncio.gather(*workers) 5858s File "/usr/lib/python3.12/asyncio/tasks.py", line 684, in _wrap_awaitable 5858s return await awaitable 5858s ^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/core.py", line 531, in start 5858s raise asyncio.TimeoutError( 5858s TimeoutError: Nanny start timed out after 0s. 5858s 2025-02-21 00:59:59,276 - distributed.scheduler - INFO - State start 5858s 2025-02-21 00:59:59,286 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:38223 5858s 2025-02-21 00:59:59,290 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:32951/status 5858s 2025-02-21 00:59:59,293 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5858s 2025-02-21 00:59:59,304 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:33033'. Reason: failure-to-start- 5858s 2025-02-21 00:59:59,304 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:33033' closed. 5858s 2025-02-21 00:59:59,304 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:34767'. Reason: failure-to-start- 5858s 2025-02-21 00:59:59,305 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:34767' closed. 5858s 2025-02-21 00:59:59,305 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38223': TLS handshake failed with remote 'tls://127.0.0.1:56266': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1011) 5858s 2025-02-21 00:59:59,305 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38223': TLS handshake failed with remote 'tls://127.0.0.1:56272': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1011) 5858s 2025-02-21 00:59:59,305 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 5858s Traceback (most recent call last): 5858s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 5858s return await fut 5858s ^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 5858s comm = await self.rpc.connect(saddr) 5858s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1485, in connect 5858s return await self._connect(addr=addr, timeout=timeout) 5858s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1429, in _connect 5858s comm = await connect( 5858s ^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5858s comm = await wait_for( 5858s ^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 5858s return await fut 5858s ^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5858s stream = await self.client.connect( 5858s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5858s af, addr, stream = await connector.start(connect_timeout=timeout) 5858s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5858s asyncio.exceptions.CancelledError 5858s 5858s The above exception was the direct cause of the following exception: 5858s 5858s Traceback (most recent call last): 5858s File "/usr/lib/python3/dist-packages/distributed/core.py", line 528, in start 5858s await wait_for(self.start_unsafe(), timeout=timeout) 5858s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1913, in wait_for 5858s async with asyncio.timeout(timeout): 5858s ^^^^^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3.12/asyncio/timeouts.py", line 115, in __aexit__ 5858s raise TimeoutError from exc_val 5858s TimeoutError 5858s 5858s The above exception was the direct cause of the following exception: 5858s 5858s Traceback (most recent call last): 5858s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 974, in _cluster_factory 5858s s, ws = await start_cluster( 5858s ^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 791, in start_cluster 5858s await asyncio.gather(*workers) 5858s File "/usr/lib/python3.12/asyncio/tasks.py", line 684, in _wrap_awaitable 5858s return await awaitable 5858s ^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/core.py", line 531, in start 5858s raise asyncio.TimeoutError( 5858s TimeoutError: Nanny start timed out after 0s. 5858s 2025-02-21 01:00:00,316 - distributed.scheduler - INFO - State start 5858s 2025-02-21 01:00:00,326 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:32857 5858s 2025-02-21 01:00:00,330 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:42005/status 5858s 2025-02-21 01:00:00,334 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5858s 2025-02-21 01:00:00,349 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:36287'. Reason: failure-to-start- 5858s 2025-02-21 01:00:00,349 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:36287' closed. 5858s 2025-02-21 01:00:00,349 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:46377'. Reason: failure-to-start- 5858s 2025-02-21 01:00:00,349 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:46377' closed. 5858s 2025-02-21 01:00:00,350 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:32857': TLS handshake failed with remote 'tls://127.0.0.1:42718': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1011) 5858s 2025-02-21 01:00:00,350 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:32857': TLS handshake failed with remote 'tls://127.0.0.1:42730': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1011) 5858s 2025-02-21 01:00:00,350 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 5858s Traceback (most recent call last): 5858s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 5858s return await fut 5858s ^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 5858s comm = await self.rpc.connect(saddr) 5858s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1485, in connect 5858s return await self._connect(addr=addr, timeout=timeout) 5858s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1429, in _connect 5858s comm = await connect( 5858s ^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5858s comm = await wait_for( 5858s ^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 5858s return await fut 5858s ^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5858s stream = await self.client.connect( 5858s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5858s af, addr, stream = await connector.start(connect_timeout=timeout) 5858s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5858s asyncio.exceptions.CancelledError 5858s 5858s The above exception was the direct cause of the following exception: 5858s 5858s Traceback (most recent call last): 5858s File "/usr/lib/python3/dist-packages/distributed/core.py", line 528, in start 5858s await wait_for(self.start_unsafe(), timeout=timeout) 5858s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1913, in wait_for 5858s async with asyncio.timeout(timeout): 5858s ^^^^^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3.12/asyncio/timeouts.py", line 115, in __aexit__ 5858s raise TimeoutError from exc_val 5858s TimeoutError 5858s 5858s The above exception was the direct cause of the following exception: 5858s 5858s Traceback (most recent call last): 5858s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 974, in _cluster_factory 5858s s, ws = await start_cluster( 5858s ^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 791, in start_cluster 5858s await asyncio.gather(*workers) 5858s File "/usr/lib/python3.12/asyncio/tasks.py", line 684, in _wrap_awaitable 5858s return await awaitable 5858s ^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/core.py", line 531, in start 5858s raise asyncio.TimeoutError( 5858s TimeoutError: Nanny start timed out after 0s. 5858s 2025-02-21 01:00:01,354 - distributed.scheduler - INFO - State start 5858s 2025-02-21 01:00:01,367 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:40481 5858s 2025-02-21 01:00:01,369 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:33613/status 5858s 2025-02-21 01:00:01,371 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5858s 2025-02-21 01:00:01,383 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:36521'. Reason: failure-to-start- 5858s 2025-02-21 01:00:01,383 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:36521' closed. 5858s 2025-02-21 01:00:01,383 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:45147'. Reason: failure-to-start- 5858s 2025-02-21 01:00:01,383 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:45147' closed. 5858s 2025-02-21 01:00:01,384 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40481': TLS handshake failed with remote 'tls://127.0.0.1:44172': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1011) 5858s 2025-02-21 01:00:01,384 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40481': TLS handshake failed with remote 'tls://127.0.0.1:44182': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1011) 5858s 2025-02-21 01:00:01,384 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 5858s Traceback (most recent call last): 5858s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 5858s return await fut 5858s ^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 5858s comm = await self.rpc.connect(saddr) 5858s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1485, in connect 5858s return await self._connect(addr=addr, timeout=timeout) 5858s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1429, in _connect 5858s comm = await connect( 5858s ^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5858s comm = await wait_for( 5858s ^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 5858s return await fut 5858s ^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5858s stream = await self.client.connect( 5858s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5858s af, addr, stream = await connector.start(connect_timeout=timeout) 5858s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5858s asyncio.exceptions.CancelledError 5858s 5858s The above exception was the direct cause of the following exception: 5858s 5858s Traceback (most recent call last): 5858s File "/usr/lib/python3/dist-packages/distributed/core.py", line 528, in start 5858s await wait_for(self.start_unsafe(), timeout=timeout) 5858s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1913, in wait_for 5858s async with asyncio.timeout(timeout): 5858s ^^^^^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3.12/asyncio/timeouts.py", line 115, in __aexit__ 5858s raise TimeoutError from exc_val 5858s TimeoutError 5858s 5858s The above exception was the direct cause of the following exception: 5858s 5858s Traceback (most recent call last): 5858s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 974, in _cluster_factory 5858s s, ws = await start_cluster( 5858s ^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 791, in start_cluster 5858s await asyncio.gather(*workers) 5858s File "/usr/lib/python3.12/asyncio/tasks.py", line 684, in _wrap_awaitable 5858s return await awaitable 5858s ^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/core.py", line 531, in start 5858s raise asyncio.TimeoutError( 5858s TimeoutError: Nanny start timed out after 0s. 5858s 2025-02-21 01:00:02,388 - distributed.scheduler - INFO - State start 5858s 2025-02-21 01:00:02,407 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:35049 5858s 2025-02-21 01:00:02,411 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:37793/status 5858s 2025-02-21 01:00:02,415 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5858s 2025-02-21 01:00:02,442 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:40755'. Reason: failure-to-start- 5858s 2025-02-21 01:00:02,443 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:40755' closed. 5858s 2025-02-21 01:00:02,443 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:40619'. Reason: failure-to-start- 5858s 2025-02-21 01:00:02,443 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:40619' closed. 5858s 2025-02-21 01:00:02,448 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35049': TLS handshake failed with remote 'tls://127.0.0.1:55638': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1011) 5858s 2025-02-21 01:00:02,448 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35049': TLS handshake failed with remote 'tls://127.0.0.1:55652': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1011) 5858s 2025-02-21 01:00:02,449 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 5858s Traceback (most recent call last): 5858s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 5858s return await fut 5858s ^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 5858s comm = await self.rpc.connect(saddr) 5858s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1485, in connect 5858s return await self._connect(addr=addr, timeout=timeout) 5858s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1429, in _connect 5858s comm = await connect( 5858s ^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5858s comm = await wait_for( 5858s ^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 5858s return await fut 5858s ^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5858s stream = await self.client.connect( 5858s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5858s af, addr, stream = await connector.start(connect_timeout=timeout) 5858s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5858s asyncio.exceptions.CancelledError 5858s 5858s The above exception was the direct cause of the following exception: 5858s 5858s Traceback (most recent call last): 5858s File "/usr/lib/python3/dist-packages/distributed/core.py", line 528, in start 5858s await wait_for(self.start_unsafe(), timeout=timeout) 5858s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1913, in wait_for 5858s async with asyncio.timeout(timeout): 5858s ^^^^^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3.12/asyncio/timeouts.py", line 115, in __aexit__ 5858s raise TimeoutError from exc_val 5858s TimeoutError 5858s 5858s The above exception was the direct cause of the following exception: 5858s 5858s Traceback (most recent call last): 5858s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 974, in _cluster_factory 5858s s, ws = await start_cluster( 5858s ^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 791, in start_cluster 5858s await asyncio.gather(*workers) 5858s File "/usr/lib/python3.12/asyncio/tasks.py", line 684, in _wrap_awaitable 5858s return await awaitable 5858s ^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/core.py", line 531, in start 5858s raise asyncio.TimeoutError( 5858s TimeoutError: Nanny start timed out after 0s. 5858s 2025-02-21 01:00:03,454 - distributed.scheduler - INFO - State start 5858s 2025-02-21 01:00:03,465 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:34247 5858s 2025-02-21 01:00:03,468 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:35619/status 5858s 2025-02-21 01:00:03,470 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5858s 2025-02-21 01:00:03,486 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:35245'. Reason: failure-to-start- 5858s 2025-02-21 01:00:03,486 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:35245' closed. 5858s 2025-02-21 01:00:03,486 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:33255'. Reason: failure-to-start- 5858s 2025-02-21 01:00:03,486 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:33255' closed. 5858s 2025-02-21 01:00:03,487 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34247': TLS handshake failed with remote 'tls://127.0.0.1:47886': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1011) 5858s 2025-02-21 01:00:03,487 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34247': TLS handshake failed with remote 'tls://127.0.0.1:47898': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1011) 5858s 2025-02-21 01:00:03,487 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 5858s Traceback (most recent call last): 5858s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 5858s return await fut 5858s ^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 5858s comm = await self.rpc.connect(saddr) 5858s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1485, in connect 5858s return await self._connect(addr=addr, timeout=timeout) 5858s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1429, in _connect 5858s comm = await connect( 5858s ^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5858s comm = await wait_for( 5858s ^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 5858s return await fut 5858s ^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5858s stream = await self.client.connect( 5858s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5858s af, addr, stream = await connector.start(connect_timeout=timeout) 5858s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5858s asyncio.exceptions.CancelledError 5858s 5858s The above exception was the direct cause of the following exception: 5858s 5858s Traceback (most recent call last): 5858s File "/usr/lib/python3/dist-packages/distributed/core.py", line 528, in start 5858s await wait_for(self.start_unsafe(), timeout=timeout) 5858s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1913, in wait_for 5858s async with asyncio.timeout(timeout): 5858s ^^^^^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3.12/asyncio/timeouts.py", line 115, in __aexit__ 5858s raise TimeoutError from exc_val 5858s TimeoutError 5858s 5858s The above exception was the direct cause of the following exception: 5858s 5858s Traceback (most recent call last): 5858s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 974, in _cluster_factory 5858s s, ws = await start_cluster( 5858s ^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 791, in start_cluster 5858s await asyncio.gather(*workers) 5858s File "/usr/lib/python3.12/asyncio/tasks.py", line 684, in _wrap_awaitable 5858s return await awaitable 5858s ^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/core.py", line 531, in start 5858s raise asyncio.TimeoutError( 5858s TimeoutError: Nanny start timed out after 0s. 5858s 2025-02-21 01:00:04,493 - distributed.scheduler - INFO - State start 5858s 2025-02-21 01:00:04,504 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44845 5858s 2025-02-21 01:00:04,508 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:44961/status 5858s 2025-02-21 01:00:04,510 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5858s 2025-02-21 01:00:04,526 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:46099'. Reason: failure-to-start- 5858s 2025-02-21 01:00:04,526 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:46099' closed. 5858s 2025-02-21 01:00:04,527 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:46549'. Reason: failure-to-start- 5858s 2025-02-21 01:00:04,527 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:46549' closed. 5858s 2025-02-21 01:00:04,528 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44845': TLS handshake failed with remote 'tls://127.0.0.1:42654': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1011) 5858s 2025-02-21 01:00:04,528 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44845': TLS handshake failed with remote 'tls://127.0.0.1:42664': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1011) 5858s 2025-02-21 01:00:04,528 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 5858s Traceback (most recent call last): 5858s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 5858s return await fut 5858s ^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 5858s comm = await self.rpc.connect(saddr) 5858s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1485, in connect 5858s return await self._connect(addr=addr, timeout=timeout) 5858s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1429, in _connect 5858s comm = await connect( 5858s ^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5858s comm = await wait_for( 5858s ^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 5858s return await fut 5858s ^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5858s stream = await self.client.connect( 5858s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5858s af, addr, stream = await connector.start(connect_timeout=timeout) 5858s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5858s asyncio.exceptions.CancelledError 5858s 5858s The above exception was the direct cause of the following exception: 5858s 5858s Traceback (most recent call last): 5858s File "/usr/lib/python3/dist-packages/distributed/core.py", line 528, in start 5858s await wait_for(self.start_unsafe(), timeout=timeout) 5858s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1913, in wait_for 5858s async with asyncio.timeout(timeout): 5858s ^^^^^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3.12/asyncio/timeouts.py", line 115, in __aexit__ 5858s raise TimeoutError from exc_val 5858s TimeoutError 5858s 5858s The above exception was the direct cause of the following exception: 5858s 5858s Traceback (most recent call last): 5858s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 974, in _cluster_factory 5858s s, ws = await start_cluster( 5858s ^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 791, in start_cluster 5858s await asyncio.gather(*workers) 5858s File "/usr/lib/python3.12/asyncio/tasks.py", line 684, in _wrap_awaitable 5858s return await awaitable 5858s ^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/core.py", line 531, in start 5858s raise asyncio.TimeoutError( 5858s TimeoutError: Nanny start timed out after 0s. 5858s 2025-02-21 01:00:05,533 - distributed.scheduler - INFO - State start 5858s 2025-02-21 01:00:05,541 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:43345 5858s 2025-02-21 01:00:05,544 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:43147/status 5858s 2025-02-21 01:00:05,547 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5858s 2025-02-21 01:00:05,559 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:37991'. Reason: failure-to-start- 5858s 2025-02-21 01:00:05,559 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:37991' closed. 5858s 2025-02-21 01:00:05,560 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:44255'. Reason: failure-to-start- 5858s 2025-02-21 01:00:05,560 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:44255' closed. 5858s 2025-02-21 01:00:05,560 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43345': TLS handshake failed with remote 'tls://127.0.0.1:34084': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1011) 5858s 2025-02-21 01:00:05,560 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43345': TLS handshake failed with remote 'tls://127.0.0.1:34096': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1011) 5858s 2025-02-21 01:00:05,560 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 5858s Traceback (most recent call last): 5858s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 5858s return await fut 5858s ^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 5858s comm = await self.rpc.connect(saddr) 5858s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1485, in connect 5858s return await self._connect(addr=addr, timeout=timeout) 5858s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1429, in _connect 5858s comm = await connect( 5858s ^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5858s comm = await wait_for( 5858s ^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 5858s return await fut 5858s ^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5858s stream = await self.client.connect( 5858s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5858s af, addr, stream = await connector.start(connect_timeout=timeout) 5858s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5858s asyncio.exceptions.CancelledError 5858s 5858s The above exception was the direct cause of the following exception: 5858s 5858s Traceback (most recent call last): 5858s File "/usr/lib/python3/dist-packages/distributed/core.py", line 528, in start 5858s await wait_for(self.start_unsafe(), timeout=timeout) 5858s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1913, in wait_for 5858s async with asyncio.timeout(timeout): 5858s ^^^^^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3.12/asyncio/timeouts.py", line 115, in __aexit__ 5858s raise TimeoutError from exc_val 5858s TimeoutError 5858s 5858s The above exception was the direct cause of the following exception: 5858s 5858s Traceback (most recent call last): 5858s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 974, in _cluster_factory 5858s s, ws = await start_cluster( 5858s ^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 791, in start_cluster 5858s await asyncio.gather(*workers) 5858s File "/usr/lib/python3.12/asyncio/tasks.py", line 684, in _wrap_awaitable 5858s return await awaitable 5858s ^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/core.py", line 531, in start 5858s raise asyncio.TimeoutError( 5858s TimeoutError: Nanny start timed out after 0s. 5858s 2025-02-21 01:00:06,565 - distributed.scheduler - INFO - State start 5858s 2025-02-21 01:00:06,573 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:36121 5858s 2025-02-21 01:00:06,577 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:37891/status 5858s 2025-02-21 01:00:06,581 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5858s 2025-02-21 01:00:06,598 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:43947'. Reason: failure-to-start- 5858s 2025-02-21 01:00:06,599 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:43947' closed. 5858s 2025-02-21 01:00:06,599 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:44397'. Reason: failure-to-start- 5858s 2025-02-21 01:00:06,599 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:44397' closed. 5858s 2025-02-21 01:00:06,600 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36121': TLS handshake failed with remote 'tls://127.0.0.1:52112': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1011) 5858s 2025-02-21 01:00:06,600 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36121': TLS handshake failed with remote 'tls://127.0.0.1:52114': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1011) 5858s 2025-02-21 01:00:06,600 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 5858s Traceback (most recent call last): 5858s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 5858s return await fut 5858s ^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 5858s comm = await self.rpc.connect(saddr) 5858s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1485, in connect 5858s return await self._connect(addr=addr, timeout=timeout) 5858s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1429, in _connect 5858s comm = await connect( 5858s ^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5858s comm = await wait_for( 5858s ^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 5858s return await fut 5858s ^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5858s stream = await self.client.connect( 5858s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5858s af, addr, stream = await connector.start(connect_timeout=timeout) 5858s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5858s asyncio.exceptions.CancelledError 5858s 5858s The above exception was the direct cause of the following exception: 5858s 5858s Traceback (most recent call last): 5858s File "/usr/lib/python3/dist-packages/distributed/core.py", line 528, in start 5858s await wait_for(self.start_unsafe(), timeout=timeout) 5858s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1913, in wait_for 5858s async with asyncio.timeout(timeout): 5858s ^^^^^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3.12/asyncio/timeouts.py", line 115, in __aexit__ 5858s raise TimeoutError from exc_val 5858s TimeoutError 5858s 5858s The above exception was the direct cause of the following exception: 5858s 5858s Traceback (most recent call last): 5858s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 974, in _cluster_factory 5858s s, ws = await start_cluster( 5858s ^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 791, in start_cluster 5858s await asyncio.gather(*workers) 5858s File "/usr/lib/python3.12/asyncio/tasks.py", line 684, in _wrap_awaitable 5858s return await awaitable 5858s ^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/core.py", line 531, in start 5858s raise asyncio.TimeoutError( 5858s TimeoutError: Nanny start timed out after 0s. 5858s 2025-02-21 01:00:07,605 - distributed.scheduler - INFO - State start 5858s 2025-02-21 01:00:07,614 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:43419 5858s 2025-02-21 01:00:07,617 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:35605/status 5858s 2025-02-21 01:00:07,619 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5858s 2025-02-21 01:00:07,629 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:45737'. Reason: failure-to-start- 5858s 2025-02-21 01:00:07,629 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:45737' closed. 5858s 2025-02-21 01:00:07,630 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:43121'. Reason: failure-to-start- 5858s 2025-02-21 01:00:07,630 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:43121' closed. 5858s 2025-02-21 01:00:07,630 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43419': TLS handshake failed with remote 'tls://127.0.0.1:48006': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1011) 5858s 2025-02-21 01:00:07,630 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43419': TLS handshake failed with remote 'tls://127.0.0.1:48022': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1011) 5858s 2025-02-21 01:00:07,630 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 5858s Traceback (most recent call last): 5858s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 5858s return await fut 5858s ^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 5858s comm = await self.rpc.connect(saddr) 5858s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1485, in connect 5858s return await self._connect(addr=addr, timeout=timeout) 5858s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1429, in _connect 5858s comm = await connect( 5858s ^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5858s comm = await wait_for( 5858s ^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 5858s return await fut 5858s ^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5858s stream = await self.client.connect( 5858s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5858s af, addr, stream = await connector.start(connect_timeout=timeout) 5858s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5858s asyncio.exceptions.CancelledError 5858s 5858s The above exception was the direct cause of the following exception: 5858s 5858s Traceback (most recent call last): 5858s File "/usr/lib/python3/dist-packages/distributed/core.py", line 528, in start 5858s await wait_for(self.start_unsafe(), timeout=timeout) 5858s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1913, in wait_for 5858s async with asyncio.timeout(timeout): 5858s ^^^^^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3.12/asyncio/timeouts.py", line 115, in __aexit__ 5858s raise TimeoutError from exc_val 5858s TimeoutError 5858s 5858s The above exception was the direct cause of the following exception: 5858s 5858s Traceback (most recent call last): 5858s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 974, in _cluster_factory 5858s s, ws = await start_cluster( 5858s ^^^^^^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 791, in start_cluster 5858s await asyncio.gather(*workers) 5858s File "/usr/lib/python3.12/asyncio/tasks.py", line 684, in _wrap_awaitable 5858s return await awaitable 5858s ^^^^^^^^^^^^^^^ 5858s File "/usr/lib/python3/dist-packages/distributed/core.py", line 531, in start 5858s raise asyncio.TimeoutError( 5858s TimeoutError: Nanny start timed out after 0s. 5858s 2025-02-21 01:00:08,635 - distributed.scheduler - INFO - State start 5858s 2025-02-21 01:00:08,643 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:33839 5858s 2025-02-21 01:00:08,647 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:39631/status 5858s 2025-02-21 01:00:08,650 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5858s ============================= slowest 20 durations ============================= 5858s 60.02s call tests/test_tls_functional.py::test_retire_workers 5858s 60.01s call tests/test_tls_functional.py::test_nanny 5858s 15.38s call tests/test_gc.py::test_gc_diagnosis_cpu_time 5858s 10.38s call tests/test_stress.py::test_cancel_stress 5858s 10.03s call tests/test_utils_test.py::test_popen_timeout 5858s 9.27s call tests/test_nanny.py::test_num_fds 5858s 7.90s call tests/test_failed_workers.py::test_worker_doesnt_await_task_completion 5858s 6.88s call tests/test_utils_test.py::test_bare_cluster 5858s 6.79s call tests/test_stress.py::test_cancel_stress_sync 5858s 5.93s call tests/test_chaos.py::test_KillWorker[segfault] 5858s 5.36s call tests/test_chaos.py::test_KillWorker[sys.exit] 5858s 5.35s call shuffle/tests/test_rechunk.py::test_rechunk_method 5858s 5.33s call diagnostics/tests/test_progress.py::test_group_timing 5858s 5.32s call tests/test_steal.py::test_balance_with_longer_task 5858s 5.18s call tests/test_failed_workers.py::test_restart_sync 5858s 5.00s call tests/test_steal.py::test_restart 5858s 4.96s call tests/test_nanny.py::test_environ_plugin 5858s 4.74s call tests/test_failed_workers.py::test_multiple_clients_restart 5858s 4.70s call shuffle/tests/test_rechunk.py::test_rechunk_with_partially_unknown_dimension[x5-chunks5] 5858s 4.62s call diagnostics/tests/test_progress.py::test_AllProgress 5858s =========================== short test summary info ============================ 5858s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_ssh.py:9: could not import 'paramiko': No module named 'paramiko' 5858s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/comm/tests/test_ucx.py:15: could not import 'ucp': No module named 'ucp' 5858s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/comm/tests/test_ucx_config.py:23: could not import 'ucp': No module named 'ucp' 5858s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/dashboard/tests/test_components.py:5: could not import 'bokeh': No module named 'bokeh' 5858s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/dashboard/tests/test_scheduler_bokeh.py:11: could not import 'bokeh': No module named 'bokeh' 5858s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/dashboard/tests/test_worker_bokeh.py:10: could not import 'bokeh': No module named 'bokeh' 5858s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_old_ssh.py:7: could not import 'paramiko': No module named 'paramiko' 5858s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_ssh.py:5: could not import 'asyncssh': No module named 'asyncssh' 5858s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_cudf_diagnostics.py:20: could not import 'cudf': No module named 'cudf' 5858s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_memray.py:5: could not import 'memray': No module named 'memray' 5858s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_nvml.py:11: could not import 'pynvml': No module named 'pynvml' 5858s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_progress_stream.py:5: could not import 'bokeh': No module named 'bokeh' 5858s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_progress_widgets.py:14: could not import 'ipywidgets': No module named 'ipywidgets' 5858s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_rmm_diagnostics.py:14: could not import 'dask_cuda': No module named 'dask_cuda' 5858s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_arrow.py:5: could not import 'pyarrow': No module named 'pyarrow' 5858s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_cupy.py:11: could not import 'cupy': No module named 'cupy' 5858s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_h5py.py:8: could not import 'h5py': No module named 'h5py' 5858s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_keras.py:5: could not import 'keras': No module named 'keras' 5858s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_netcdf4.py:5: could not import 'netCDF4': No module named 'netCDF4' 5858s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numba.py:11: could not import 'numba.cuda': No module named 'numba' 5858s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_rmm.py:10: could not import 'numba.cuda': No module named 'numba' 5858s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_scipy.py:8: could not import 'scipy': No module named 'scipy' 5858s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_sparse.py:6: could not import 'sparse': No module named 'sparse' 5858s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_torch.py:8: could not import 'torch': No module named 'torch' 5858s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_graph.py:9: could not import 'pyarrow': No module named 'pyarrow' 5858s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_merge.py:71: could not import 'pyarrow': No module named 'pyarrow' 5858s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_merge_column_and_index.py:110: could not import 'pyarrow': No module named 'pyarrow' 5858s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_metrics.py:71: could not import 'pyarrow': No module named 'pyarrow' 5858s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_shuffle.py:195: could not import 'pyarrow': No module named 'pyarrow' 5858s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_parse_stdout.py:14: could not import 'parse_stdout': No module named 'parse_stdout' 5858s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py:85: could not import 'bokeh': No module named 'bokeh' 5858s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py:117: could not import 'bokeh': No module named 'bokeh' 5858s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py:168: could not import 'bokeh': No module named 'bokeh' 5858s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py:325: could not import 'bokeh': No module named 'bokeh' 5858s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py:552: need --runslow option to run 5858s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py:564: need --runslow option to run 5858s SKIPPED [2] ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py:662: need --runslow option to run 5858s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py:169: need --runslow option to run 5858s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py:196: need --runslow option to run 5858s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py:270: need --runslow option to run 5858s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py:308: need --runslow option to run 5858s SKIPPED [2] ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py:329: need --runslow option to run 5858s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py:388: need --runslow option to run 5858s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py:429: need --runslow option to run 5858s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py:436: need --runslow option to run 5858s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py:444: need --runslow option to run 5858s SKIPPED [4] ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py:472: need --runslow option to run 5858s SKIPPED [4] ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py:508: need --runslow option to run 5858s SKIPPED [4] ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py:547: need --runslow option to run 5858s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py:578: need --runslow option to run 5858s SKIPPED [2] ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py:616: need --runslow option to run 5858s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py:627: need --runslow option to run 5858s SKIPPED [2] ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py:637: need --runslow option to run 5858s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py:682: need --runslow option to run 5858s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py:699: need --runslow option to run 5858s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py:719: need --runslow option to run 5858s SKIPPED [2] ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py:733: need --runslow option to run 5858s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py:824: need --runslow option to run 5858s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_subprocess.py:77: need --runslow option to run 5858s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_subprocess.py:92: Windows-specific error testing (distributed#7434) 5858s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_eventstream.py:16: could not import 'bokeh': No module named 'bokeh' 5858s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_install_plugin.py:143: need --runslow option to run 5858s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_install_plugin.py:151: need --runslow option to run 5858s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_install_plugin.py:158: need --runslow option to run 5858s SKIPPED [2] ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_memory_sampler.py:103: could not import 'matplotlib': No module named 'matplotlib' 5858s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_task_stream.py:140: could not import 'bokeh.models': No module named 'bokeh' 5858s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_task_stream.py:151: could not import 'bokeh.models': No module named 'bokeh' 5858s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_missing_bokeh.py:35: could not import 'bokeh': No module named 'bokeh' 5858s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_missing_bokeh.py:59: could not import 'bokeh': No module named 'bokeh' 5858s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py:87: could not import 'bokeh': No module named 'bokeh' 5858s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py:535: could not import 'aiohttp': No module named 'aiohttp' 5858s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py:648: could not import 'bokeh': No module named 'bokeh' 5858s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py:689: could not import 'aiohttp': No module named 'aiohttp' 5858s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py:709: could not import 'aiohttp': No module named 'aiohttp' 5858s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py:732: could not import 'aiohttp': No module named 'aiohttp' 5858s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py:754: could not import 'aiohttp': No module named 'aiohttp' 5858s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py:775: could not import 'aiohttp': No module named 'aiohttp' 5858s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/http/worker/tests/test_worker_http.py:150: could not import 'aiohttp': No module named 'aiohttp' 5858s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/http/worker/tests/test_worker_http.py:163: could not import 'aiohttp': No module named 'aiohttp' 5858s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/http/worker/tests/test_worker_http.py:234: Fails on 32-bit, seems to be large memory request 5858s SKIPPED [4] ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_collection_cuda.py:12: could not import 'cupy': No module named 'cupy' 5858s SKIPPED [4] ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_collection_cuda.py:44: could not import 'cudf': No module named 'cudf' 5858s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py:125: could not import 'lz4': No module named 'lz4' 5858s SKIPPED [2] ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py:132: could not import 'lz4': No module named 'lz4' 5858s SKIPPED [2] ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py:132: could not import 'snappy': No module named 'snappy' 5858s SKIPPED [2] ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py:132: could not import 'zstandard': No module named 'zstandard' 5858s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py:143: could not import 'lz4': No module named 'lz4' 5858s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py:143: could not import 'snappy': No module named 'snappy' 5858s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py:143: could not import 'zstandard': No module named 'zstandard' 5858s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py:151: could not import 'lz4': No module named 'lz4' 5858s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py:151: could not import 'snappy': No module named 'snappy' 5858s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py:151: could not import 'zstandard': No module named 'zstandard' 5858s SKIPPED [10] ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py:168: need --runslow option to run 5858s SKIPPED [5] ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py:188: need --runslow option to run 5858s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py:150: could not import 'numpy.core.test_rational': No module named 'numpy.core.test_rational' 5858s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py:180: need --runslow option to run 5858s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pickle.py:275: need --runslow option to run 5858s SKIPPED [3] ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol.py:219: need --runslow option to run 5858s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py:1326: need --runslow option to run 5858s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py:1304: need --runslow option to run 5858s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py:1317: need --runslow option to run 5858s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py:1339: need --runslow option to run 5858s SKIPPED [2] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py:1360: need --runslow option to run 5858s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_batched.py:158: need --runslow option to run 5858s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_batched.py:228: need --runslow option to run 5858s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py:859: need --runslow option to run 5858s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py:1736: need --runslow option to run 5858s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py:1870: unconditional skip 5858s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py:2088: unconditional skip 5858s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py:2677: Use fast random selection now 5858s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py:3301: unconditional skip 5858s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py:3585: need --runslow option to run 5858s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py:3650: need --runslow option to run 5858s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py:3762: need --runslow option to run 5858s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py:4563: need --runslow option to run 5858s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py:4667: Now prefer first-in-first-out 5858s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py:4697: need --runslow option to run 5858s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py:4804: need --runslow option to run 5858s SKIPPED [2] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py:4849: need --runslow option to run 5858s SKIPPED [2] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py:4869: need --runslow option to run 5858s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py:4896: need --runslow option to run 5858s SKIPPED [2] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py:4909: need --runslow option to run 5858s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py:5097: need --runslow option to run 5858s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py:5118: need --runslow option to run 5858s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py:5417: need --runslow option to run 5858s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py:5643: need --runslow option to run 5858s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py:5844: need --runslow option to run 5858s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py:5961: unconditional skip 5858s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py:6179: could not import 'bokeh.plotting': No module named 'bokeh' 5858s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py:6540: known intermittent failure 5858s SKIPPED [2] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py:6621: need --runslow option to run 5858s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py:6695: need --runslow option to run 5858s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py:7065: could not import 'bokeh': No module named 'bokeh' 5858s SKIPPED [2] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py:7166: need --runslow option to run 5858s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py:7265: numpy >=1.25 can capture ufunc code 5858s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py:7413: need --runslow option to run 5858s SKIPPED [2] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py:8031: need --runslow option to run 5858s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py:8235: need --runslow option to run 5858s SKIPPED [2] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py:8286: need --runslow option to run 5858s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client_executor.py:146: need --runslow option to run 5858s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_config.py:356: could not import 'uvloop': No module named 'uvloop' 5858s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_core.py:450: need --runslow option to run 5858s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_core.py:915: could not import 'crick': No module named 'crick' 5858s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_core.py:924: could not import 'crick': No module named 'crick' 5858s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_core.py:1386: need --runslow option to run 5858s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_counter.py:13: no crick library 5858s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_dask_collections.py:221: could not import 'sparse': No module named 'sparse' 5858s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_diskutils.py:224: need --runslow option to run 5858s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_failed_workers.py:41: need --runslow option to run 5858s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_failed_workers.py:117: need --runslow option to run 5858s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_failed_workers.py:128: need --runslow option to run 5858s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_failed_workers.py:287: need --runslow option to run 5858s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_failed_workers.py:358: need --runslow option to run 5858s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_failed_workers.py:442: need --runslow option to run 5858s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_failed_workers.py:454: need --runslow option to run 5858s SKIPPED [2] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_failed_workers.py:491: need --runslow option to run 5858s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_failed_workers.py:537: need --runslow option to run 5858s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_jupyter.py:48: need --runslow option to run 5858s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_metrics.py:30: WindowsTime doesn't work with high accuracy base timer 5858s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py:93: need --runslow option to run 5858s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py:107: need --runslow option to run 5858s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py:141: need --runslow option to run 5858s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py:291: need --runslow option to run 5858s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py:490: need --runslow option to run 5858s SKIPPED [2] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py:567: could not import 'ucp': No module named 'ucp' 5858s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py:682: need --runslow option to run 5858s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py:690: need --runslow option to run 5858s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py:731: need --runslow option to run 5858s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py:774: need --runslow option to run 5858s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py:75: could not import 'stacktrace': No module named 'stacktrace' 5858s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_queues.py:114: need --runslow option to run 5858s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py:363: Skipped 5858s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py:422: Should protect resource keys from optimization 5858s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py:445: atop fusion seemed to break this 5858s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py:286: Not relevant with queuing on; see https://github.com/dask/distributed/issues/7204 5858s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py:421: need --runslow option to run 5858s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py:1075: need --runslow option to run 5858s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py:1103: need --runslow option to run 5858s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py:1124: need --runslow option to run 5858s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py:1216: need --runslow option to run 5858s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py:1234: need --runslow option to run 5858s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py:1625: need --runslow option to run 5858s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py:1680: need --runslow option to run 5858s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py:1697: need --runslow option to run 5858s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py:1860: need --runslow option to run 5858s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py:1900: need --runslow option to run 5858s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py:2095: need --runslow option to run 5858s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py:2356: need --runslow option to run 5858s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py:2481: need --runslow option to run 5858s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py:2508: need --runslow option to run 5858s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py:2556: need --runslow option to run 5858s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py:2606: need --runslow option to run 5858s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py:2661: could not import 'bokeh': No module named 'bokeh' 5858s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py:3112: need --runslow option to run 5858s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py:3512: need --runslow option to run 5858s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py:3691: need --runslow option to run 5858s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py:3723: need --runslow option to run 5858s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py:3866: need --runslow option to run 5858s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py:3923: need --runslow option to run 5858s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py:3943: need --runslow option to run 5858s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py:106: need --runslow option to run 5858s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py:285: Skipped 5858s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py:1287: executing heartbeats not considered yet 5858s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py:1353: need --runslow option to run 5858s SKIPPED [2] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_stress.py:51: need --runslow option to run 5858s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_stress.py:100: need --runslow option to run 5858s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_stress.py:209: unconditional skip 5858s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_stress.py:240: need --runslow option to run 5858s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_stress.py:269: need --runslow option to run 5858s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_stress.py:310: need --runslow option to run 5858s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_system_monitor.py:111: could not import 'gilknocker': No module named 'gilknocker' 5858s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py:166: could not import 'IPython': No module named 'IPython' 5858s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py:347: could not import 'pyarrow': No module named 'pyarrow' 5858s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py:146: This hangs on travis 5858s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py:721: need --runslow option to run 5858s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_variable.py:205: need --runslow option to run 5858s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py:219: don't yet support uploading pyc files 5858s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py:309: could not import 'crick': No module named 'crick' 5858s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py:345: need --runslow option to run 5858s SKIPPED [8] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py:420: need --runslow option to run 5858s SKIPPED [5] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py:562: need --runslow option to run 5858s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py:1180: need --runslow option to run 5858s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py:1264: need --runslow option to run 5858s SKIPPED [2] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py:1453: could not import 'ucp': No module named 'ucp' 5858s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py:1517: need --runslow option to run 5858s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py:1549: need --runslow option to run 5858s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py:1580: need --runslow option to run 5858s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py:1607: need --runslow option to run 5858s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py:1635: need --runslow option to run 5858s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py:1702: need --runslow option to run 5858s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py:1806: need --runslow option to run 5858s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py:2705: need --runslow option to run 5858s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py:3399: need --runslow option to run 5858s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py:3429: need --runslow option to run 5858s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py:871: need --runslow option to run 5858s SKIPPED [2] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py:883: need --runslow option to run 5858s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py:997: need --runslow option to run 5858s FAILED tests/test_tls_functional.py::test_nanny - TimeoutError 5858s FAILED tests/test_tls_functional.py::test_retire_workers - TimeoutError 5858s = 2 failed, 2937 passed, 300 skipped, 160 deselected, 15 xfailed, 8 xpassed in 1621.91s (0:27:01) = 5868s *** END OF RUN 1: NOT ALL TESTS HAVE YET PASSED/XFAILED *** 5868s *** STARTING RUN 2: python3.12 -m pytest --pyargs distributed --verbose --color=no --timeout-method=signal --timeout=300 -m not avoid_ci -rfE --last-failed --last-failed-no-failures none --ignore=../../../../../usr/lib/python3/dist-packages/distributed/comm/tests/test_comms.py --ignore=../../../../../usr/lib/python3/dist-packages/distributed/comm/tests/test_ws.py --ignore=../../../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_adaptive.py --ignore=../../../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_local.py --ignore=../../../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_slow_adaptive.py --ignore=../../../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_spec_cluster.py --deselect=cli/tests/test_dask_scheduler.py::test_no_dashboard --deselect=deploy/tests/test_local.py::test_localcluster_get_client --deselect=deploy/tests/test_old_ssh.py::test_cluster --deselect=deploy/tests/test_old_ssh.py::test_old_ssh_nprocs_renamed_to_n_workers --deselect=deploy/tests/test_old_ssh.py::test_nprocs_attribute_is_deprecated --deselect=deploy/tests/test_ssh.py::test_nprocs_attribute_is_deprecated --deselect=http/tests/test_core.py::test_prometheus_api_doc --deselect=tests/test_init.py::test_git_revision --deselect=tests/test_jupyter.py::test_jupyter_idle_timeout --deselect=tests/test_jupyter.py::test_jupyter_idle_timeout_returned --deselect=tests/test_jupyter.py::test_jupyter_server --deselect=tests/test_jupyter.py::test_shutsdown_cleanly --deselect=tests/test_profile.py::test_stack_overflow --deselect=tests/test_pubsub.py::test_client_worker --deselect=tests/test_queues.py::test_queue_in_task --deselect=tests/test_spill.py::test_spillbuffer_oserror --deselect=tests/test_steal.py::test_steal_twice --deselect=tests/test_utils_test.py::test_cluster --deselect=tests/test_variable.py::test_variable_in_task --deselect=tests/test_worker.py::test_process_executor_kills_process --deselect=tests/test_worker_memory.py::test_fail_to_pickle_execute_1 --deselect=tests/test_worker_state_machine.py::test_task_state_instance_are_garbage_collected --deselect=protocol/tests/test_protocol.py::test_deeply_nested_structures --deselect=protocol/tests/test_serialize.py::test_deeply_nested_structures --deselect=cli/tests/test_dask_scheduler.py::test_defaults --deselect=cli/tests/test_dask_scheduler.py::test_hostport --deselect=cli/tests/test_dask_spec.py::test_errors --deselect=cli/tests/test_dask_worker.py::test_scheduler_file --deselect=cli/tests/test_dask_worker.py::test_scheduler_file --deselect=cli/tests/test_dask_worker.py::test_scheduler_file --deselect=dashboard/tests/test_scheduler_bokeh.py::test_counters --deselect=dashboard/tests/test_worker_bokeh.py::test_counters --deselect=deploy/tests/test_local.py::test_adapt_then_manual --deselect=deploy/tests/test_local.py::test_async_with --deselect=deploy/tests/test_local.py::test_close_twice --deselect=deploy/tests/test_local.py::test_cluster_info_sync --deselect=deploy/tests/test_local.py::test_local_tls --deselect=deploy/tests/test_local.py::test_no_dangling_asyncio_tasks --deselect=deploy/tests/test_local.py::test_only_local_access --deselect=deploy/tests/test_local.py::test_remote_access --deselect=diagnostics/tests/test_progress_widgets.py::test_serializers --deselect=diagnostics/tests/test_scheduler_plugin.py::test_lifecycle --deselect=http/scheduler/tests/test_missing_bokeh.py::test_missing_bokeh --deselect=http/scheduler/tests/test_scheduler_http.py::test_metrics_when_prometheus_client_not_installed --deselect=protocol/tests/test_serialize.py::test_errors --deselect=tests/test_batched.py::test_BatchedSend --deselect=tests/test_batched.py::test_close_closed --deselect=tests/test_batched.py::test_close_twice --deselect=tests/test_batched.py::test_send_after_stream_start --deselect=tests/test_batched.py::test_send_before_close --deselect=tests/test_batched.py::test_send_before_start --deselect=tests/test_batched.py::test_sending_traffic_jam --deselect=tests/test_batched.py::test_serializers --deselect=tests/test_client.py::TestClientSecurityLoader::test_security_loader --deselect=tests/test_client.py::TestClientSecurityLoader::test_security_loader_ignored_if_explicit_security_provided --deselect=tests/test_client.py::TestClientSecurityLoader::test_security_loader_ignored_if_returns_none --deselect=tests/test_client.py::test_async_with --deselect=tests/test_client.py::test_client_is_quiet_cluster_close --deselect=tests/test_client.py::test_dashboard_link_cluster --deselect=tests/test_client.py::test_dashboard_link_inproc --deselect=tests/test_client.py::test_file_descriptors_dont_leak --deselect=tests/test_client.py::test_mixing_clients_different_scheduler --deselect=tests/test_client.py::test_quiet_client_close --deselect=tests/test_client.py::test_rebalance_sync --deselect=tests/test_client.py::test_repr_localcluster --deselect=tests/test_client.py::test_security_loader --deselect=tests/test_client.py::test_security_loader_ignored_if_explicit_security_provided --deselect=tests/test_client.py::test_security_loader_ignored_if_returns_none --deselect=tests/test_client.py::test_shutdown --deselect=tests/test_client.py::test_shutdown_is_quiet_with_cluster --deselect=tests/test_client.py::test_shutdown_localcluster --deselect=tests/test_client.py::test_shutdown_stops_callbacks --deselect=tests/test_client_loop.py::test_close_loop_sync_start_new_loop --deselect=tests/test_client_loop.py::test_close_loop_sync_use_running_loop --deselect=tests/test_core.py::test_close_fast_without_active_handlers --deselect=tests/test_core.py::test_close_grace_period_for_handlers --deselect=tests/test_core.py::test_close_properly --deselect=tests/test_core.py::test_compression --deselect=tests/test_core.py::test_connection_pool --deselect=tests/test_core.py::test_connection_pool_close_while_connecting --deselect=tests/test_core.py::test_connection_pool_detects_remote_close --deselect=tests/test_core.py::test_connection_pool_outside_cancellation --deselect=tests/test_core.py::test_connection_pool_remove --deselect=tests/test_core.py::test_connection_pool_respects_limit --deselect=tests/test_core.py::test_connection_pool_tls --deselect=tests/test_core.py::test_counters --deselect=tests/test_core.py::test_deserialize_error --deselect=tests/test_core.py::test_errors --deselect=tests/test_core.py::test_identity_inproc --deselect=tests/test_core.py::test_identity_tcp --deselect=tests/test_core.py::test_large_packets_inproc --deselect=tests/test_core.py::test_messages_are_ordered_bsend --deselect=tests/test_core.py::test_messages_are_ordered_raw --deselect=tests/test_core.py::test_ports --deselect=tests/test_core.py::test_rpc_default --deselect=tests/test_core.py::test_rpc_inproc --deselect=tests/test_core.py::test_rpc_message_lifetime_default --deselect=tests/test_core.py::test_rpc_message_lifetime_inproc --deselect=tests/test_core.py::test_rpc_message_lifetime_tcp --deselect=tests/test_core.py::test_rpc_serialization --deselect=tests/test_core.py::test_rpc_tcp --deselect=tests/test_core.py::test_rpc_tls --deselect=tests/test_core.py::test_rpc_with_many_connections_inproc --deselect=tests/test_core.py::test_rpc_with_many_connections_tcp --deselect=tests/test_core.py::test_send_recv_args --deselect=tests/test_core.py::test_send_recv_cancelled --deselect=tests/test_core.py::test_server --deselect=tests/test_core.py::test_server_comms_mark_active_handlers --deselect=tests/test_core.py::test_server_raises_on_blocked_handlers --deselect=tests/test_jupyter.py::test_jupyter_idle_timeout --deselect=tests/test_jupyter.py::test_jupyter_server --deselect=tests/test_locks.py::test_errors --deselect=tests/test_nanny.py::test_scheduler_file --deselect=tests/test_nanny.py::test_scheduler_file --deselect=tests/test_nanny.py::test_scheduler_file --deselect=tests/test_nanny.py::test_worker_uses_same_host_as_nanny --deselect=tests/test_preload.py::test_failure_doesnt_crash_scheduler --deselect=tests/test_preload.py::test_preload_import_time --deselect=tests/test_preload.py::test_preload_manager_sequence --deselect=tests/test_preload.py::test_worker_preload_text --deselect=tests/test_scheduler.py::test_allowed_failures_config --deselect=tests/test_scheduler.py::test_async_context_manager --deselect=tests/test_scheduler.py::test_dashboard_host --deselect=tests/test_scheduler.py::test_file_descriptors_dont_leak --deselect=tests/test_scheduler.py::test_finished --deselect=tests/test_scheduler.py::test_multiple_listeners --deselect=tests/test_scheduler.py::test_no_dangling_asyncio_tasks --deselect=tests/test_scheduler.py::test_scheduler_file --deselect=tests/test_scheduler.py::test_scheduler_file --deselect=tests/test_scheduler.py::test_scheduler_file --deselect=tests/test_security.py::test_require_encryption --deselect=tests/test_security.py::test_tls_listen_connect --deselect=tests/test_security.py::test_tls_temporary_credentials_functional --deselect=tests/test_semaphore.py::test_threadpoolworkers_pick_correct_ioloop --deselect=tests/test_tls_functional.py::test_security_dict_input_no_security --deselect=tests/test_utils_test.py::test_ensure_no_new_clients --deselect=tests/test_utils_test.py::test_freeze_batched_send --deselect=tests/test_utils_test.py::test_locked_comm_drop_in_replacement --deselect=tests/test_utils_test.py::test_locked_comm_intercept_read --deselect=tests/test_utils_test.py::test_locked_comm_intercept_write --deselect=tests/test_worker.py::test_host_uses_scheduler_protocol --deselect=tests/test_worker.py::test_plugin_exception --deselect=tests/test_worker.py::test_plugin_internal_exception --deselect=tests/test_worker.py::test_plugin_multiple_exceptions --deselect=tests/test_worker.py::test_scheduler_file --deselect=tests/test_worker.py::test_scheduler_file --deselect=tests/test_worker.py::test_scheduler_file --deselect=tests/test_worker_client.py::test_dont_override_default_get 5869s ============================= test session starts ============================== 5869s platform linux -- Python 3.12.9, pytest-8.3.4, pluggy-1.5.0 -- /usr/bin/python3.12 5869s cachedir: .pytest_cache 5869s rootdir: /tmp/autopkgtest.4PKwEm/autopkgtest_tmp/build 5869s configfile: pyproject.toml 5869s plugins: timeout-2.3.1, rerunfailures-15.0, anyio-4.7.0, typeguard-4.4.1 5869s timeout: 300.0s 5869s timeout method: signal 5869s timeout func_only: False 5883s collecting ... collected 3392 items / 3390 deselected / 30 skipped / 2 selected 5883s run-last-failure: rerun previous 2 failures 5883s 5885s tests/test_tls_functional.py::test_nanny <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_tls_functional.py PASSED [ 50%] 5946s tests/test_tls_functional.py::test_retire_workers <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_tls_functional.py FAILED [100%] 5946s 5946s =================================== FAILURES =================================== 5946s _____________________________ test_retire_workers ______________________________ 5946s 5946s fut = , timeout = 0 5946s 5946s async def wait_for(fut: Awaitable[T], timeout: float) -> T: 5946s async with asyncio.timeout(timeout): 5946s > return await fut 5946s 5946s /usr/lib/python3/dist-packages/distributed/utils.py:1914: 5946s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 5946s /usr/lib/python3/dist-packages/distributed/nanny.py:358: in start_unsafe 5946s comm = await self.rpc.connect(saddr) 5946s /usr/lib/python3/dist-packages/distributed/core.py:1485: in connect 5946s return await self._connect(addr=addr, timeout=timeout) 5946s /usr/lib/python3/dist-packages/distributed/core.py:1429: in _connect 5946s comm = await connect( 5946s /usr/lib/python3/dist-packages/distributed/comm/core.py:342: in connect 5946s comm = await wait_for( 5946s /usr/lib/python3/dist-packages/distributed/utils.py:1914: in wait_for 5946s return await fut 5946s /usr/lib/python3/dist-packages/distributed/comm/tcp.py:546: in connect 5946s stream = await self.client.connect( 5946s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 5946s 5946s self = 5946s host = '127.0.0.1', port = 42199, af = 5946s ssl_options = 5946s max_buffer_size = 4163037184.0, source_ip = None, source_port = None 5946s timeout = None 5946s 5946s async def connect( 5946s self, 5946s host: str, 5946s port: int, 5946s af: socket.AddressFamily = socket.AF_UNSPEC, 5946s ssl_options: Optional[Union[Dict[str, Any], ssl.SSLContext]] = None, 5946s max_buffer_size: Optional[int] = None, 5946s source_ip: Optional[str] = None, 5946s source_port: Optional[int] = None, 5946s timeout: Optional[Union[float, datetime.timedelta]] = None, 5946s ) -> IOStream: 5946s """Connect to the given host and port. 5946s 5946s Asynchronously returns an `.IOStream` (or `.SSLIOStream` if 5946s ``ssl_options`` is not None). 5946s 5946s Using the ``source_ip`` kwarg, one can specify the source 5946s IP address to use when establishing the connection. 5946s In case the user needs to resolve and 5946s use a specific interface, it has to be handled outside 5946s of Tornado as this depends very much on the platform. 5946s 5946s Raises `TimeoutError` if the input future does not complete before 5946s ``timeout``, which may be specified in any form allowed by 5946s `.IOLoop.add_timeout` (i.e. a `datetime.timedelta` or an absolute time 5946s relative to `.IOLoop.time`) 5946s 5946s Similarly, when the user requires a certain source port, it can 5946s be specified using the ``source_port`` arg. 5946s 5946s .. versionchanged:: 4.5 5946s Added the ``source_ip`` and ``source_port`` arguments. 5946s 5946s .. versionchanged:: 5.0 5946s Added the ``timeout`` argument. 5946s """ 5946s if timeout is not None: 5946s if isinstance(timeout, numbers.Real): 5946s timeout = IOLoop.current().time() + timeout 5946s elif isinstance(timeout, datetime.timedelta): 5946s timeout = IOLoop.current().time() + timeout.total_seconds() 5946s else: 5946s raise TypeError("Unsupported timeout %r" % timeout) 5946s if timeout is not None: 5946s addrinfo = await gen.with_timeout( 5946s timeout, self.resolver.resolve(host, port, af) 5946s ) 5946s else: 5946s addrinfo = await self.resolver.resolve(host, port, af) 5946s connector = _Connector( 5946s addrinfo, 5946s functools.partial( 5946s self._create_stream, 5946s max_buffer_size, 5946s source_ip=source_ip, 5946s source_port=source_port, 5946s ), 5946s ) 5946s > af, addr, stream = await connector.start(connect_timeout=timeout) 5946s E asyncio.exceptions.CancelledError 5946s 5946s /usr/lib/python3/dist-packages/tornado/tcpclient.py:279: CancelledError 5946s 5946s The above exception was the direct cause of the following exception: 5946s 5946s self = 5946s 5946s @final 5946s async def start(self): 5946s async with self._startup_lock: 5946s if self.status == Status.failed: 5946s assert self.__startup_exc is not None 5946s raise self.__startup_exc 5946s elif self.status != Status.init: 5946s return self 5946s timeout = getattr(self, "death_timeout", None) 5946s 5946s async def _close_on_failure(exc: Exception) -> None: 5946s await self.close(reason=f"failure-to-start-{str(type(exc))}") 5946s self.status = Status.failed 5946s self.__startup_exc = exc 5946s 5946s try: 5946s > await wait_for(self.start_unsafe(), timeout=timeout) 5946s 5946s /usr/lib/python3/dist-packages/distributed/core.py:528: 5946s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 5946s /usr/lib/python3/dist-packages/distributed/utils.py:1913: in wait_for 5946s async with asyncio.timeout(timeout): 5946s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 5946s 5946s self = 5946s exc_type = 5946s exc_val = CancelledError(), exc_tb = 5946s 5946s async def __aexit__( 5946s self, 5946s exc_type: Optional[Type[BaseException]], 5946s exc_val: Optional[BaseException], 5946s exc_tb: Optional[TracebackType], 5946s ) -> Optional[bool]: 5946s assert self._state in (_State.ENTERED, _State.EXPIRING) 5946s 5946s if self._timeout_handler is not None: 5946s self._timeout_handler.cancel() 5946s self._timeout_handler = None 5946s 5946s if self._state is _State.EXPIRING: 5946s self._state = _State.EXPIRED 5946s 5946s if self._task.uncancel() <= self._cancelling and exc_type is exceptions.CancelledError: 5946s # Since there are no new cancel requests, we're 5946s # handling this. 5946s > raise TimeoutError from exc_val 5946s E TimeoutError 5946s 5946s /usr/lib/python3.12/asyncio/timeouts.py:115: TimeoutError 5946s 5946s The above exception was the direct cause of the following exception: 5946s 5946s @contextlib.asynccontextmanager 5946s async def _cluster_factory(): 5946s workers = [] 5946s s = None 5946s try: 5946s for _ in range(60): 5946s try: 5946s > s, ws = await start_cluster( 5946s nthreads, 5946s scheduler, 5946s security=security, 5946s Worker=Worker, 5946s scheduler_kwargs=scheduler_kwargs, 5946s worker_kwargs=merge( 5946s {"death_timeout": min(15, int(deadline.remaining))}, 5946s worker_kwargs, 5946s ), 5946s ) 5946s 5946s /usr/lib/python3/dist-packages/distributed/utils_test.py:974: 5946s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 5946s /usr/lib/python3/dist-packages/distributed/utils_test.py:791: in start_cluster 5946s await asyncio.gather(*workers) 5946s /usr/lib/python3.12/asyncio/tasks.py:684: in _wrap_awaitable 5946s return await awaitable 5946s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 5946s 5946s self = 5946s 5946s @final 5946s async def start(self): 5946s async with self._startup_lock: 5946s if self.status == Status.failed: 5946s assert self.__startup_exc is not None 5946s raise self.__startup_exc 5946s elif self.status != Status.init: 5946s return self 5946s timeout = getattr(self, "death_timeout", None) 5946s 5946s async def _close_on_failure(exc: Exception) -> None: 5946s await self.close(reason=f"failure-to-start-{str(type(exc))}") 5946s self.status = Status.failed 5946s self.__startup_exc = exc 5946s 5946s try: 5946s await wait_for(self.start_unsafe(), timeout=timeout) 5946s except asyncio.TimeoutError as exc: 5946s await _close_on_failure(exc) 5946s > raise asyncio.TimeoutError( 5946s f"{type(self).__name__} start timed out after {timeout}s." 5946s ) from exc 5946s E TimeoutError: Nanny start timed out after 0s. 5946s 5946s /usr/lib/python3/dist-packages/distributed/core.py:531: TimeoutError 5946s 5946s During handling of the above exception, another exception occurred: 5946s 5946s fut = ._..test_func..async_fn at 0x78dc1290edc0> 5946s timeout = 60 5946s 5946s async def wait_for(fut: Awaitable[T], timeout: float) -> T: 5946s async with asyncio.timeout(timeout): 5946s > return await fut 5946s 5946s /usr/lib/python3/dist-packages/distributed/utils.py:1914: 5946s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 5946s /usr/lib/python3/dist-packages/distributed/utils_test.py:1007: in async_fn 5946s _cluster_factory() as (s, workers), 5946s /usr/lib/python3.12/contextlib.py:210: in __aenter__ 5946s return await anext(self.gen) 5946s /usr/lib/python3/dist-packages/distributed/utils_test.py:991: in _cluster_factory 5946s await asyncio.sleep(1) 5946s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 5946s 5946s delay = 1, result = None 5946s 5946s async def sleep(delay, result=None): 5946s """Coroutine that completes after a given time (in seconds).""" 5946s if delay <= 0: 5946s await __sleep0() 5946s return result 5946s 5946s loop = events.get_running_loop() 5946s future = loop.create_future() 5946s h = loop.call_later(delay, 5946s futures._set_result_unless_cancelled, 5946s future, result) 5946s try: 5946s > return await future 5946s E asyncio.exceptions.CancelledError 5946s 5946s /usr/lib/python3.12/asyncio/tasks.py:665: CancelledError 5946s 5946s The above exception was the direct cause of the following exception: 5946s 5946s args = (), kwds = {} 5946s 5946s @wraps(func) 5946s def inner(*args, **kwds): 5946s with self._recreate_cm(): 5946s > return func(*args, **kwds) 5946s 5946s /usr/lib/python3.12/contextlib.py:81: 5946s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 5946s /usr/lib/python3.12/contextlib.py:81: in inner 5946s return func(*args, **kwds) 5946s /usr/lib/python3/dist-packages/distributed/utils_test.py:1090: in test_func 5946s return _run_and_close_tornado(async_fn_outer) 5946s /usr/lib/python3/dist-packages/distributed/utils_test.py:380: in _run_and_close_tornado 5946s return asyncio_run(inner_fn(), loop_factory=get_loop_factory()) 5946s /usr/lib/python3.12/asyncio/runners.py:195: in run 5946s return runner.run(main) 5946s /usr/lib/python3.12/asyncio/runners.py:118: in run 5946s return self._loop.run_until_complete(task) 5946s /usr/lib/python3.12/asyncio/base_events.py:691: in run_until_complete 5946s return future.result() 5946s /usr/lib/python3/dist-packages/distributed/utils_test.py:377: in inner_fn 5946s return await async_fn(*args, **kwargs) 5946s /usr/lib/python3/dist-packages/distributed/utils_test.py:1087: in async_fn_outer 5946s return await utils_wait_for(async_fn(), timeout=timeout * 2) 5946s /usr/lib/python3/dist-packages/distributed/utils.py:1913: in wait_for 5946s async with asyncio.timeout(timeout): 5946s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 5946s 5946s self = 5946s exc_type = 5946s exc_val = CancelledError(), exc_tb = 5946s 5946s async def __aexit__( 5946s self, 5946s exc_type: Optional[Type[BaseException]], 5946s exc_val: Optional[BaseException], 5946s exc_tb: Optional[TracebackType], 5946s ) -> Optional[bool]: 5946s assert self._state in (_State.ENTERED, _State.EXPIRING) 5946s 5946s if self._timeout_handler is not None: 5946s self._timeout_handler.cancel() 5946s self._timeout_handler = None 5946s 5946s if self._state is _State.EXPIRING: 5946s self._state = _State.EXPIRED 5946s 5946s if self._task.uncancel() <= self._cancelling and exc_type is exceptions.CancelledError: 5946s # Since there are no new cancel requests, we're 5946s # handling this. 5946s > raise TimeoutError from exc_val 5946s E TimeoutError 5946s 5946s /usr/lib/python3.12/asyncio/timeouts.py:115: TimeoutError 5946s ----------------------------- Captured stderr call ----------------------------- 5946s 2025-02-21 01:04:48,451 - distributed.scheduler - INFO - State start 5946s 2025-02-21 01:04:48,455 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:33195 5946s 2025-02-21 01:04:48,455 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:45019/status 5946s 2025-02-21 01:04:48,455 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5946s 2025-02-21 01:04:48,483 - distributed.nanny - INFO - Start Nanny at: 'tls://127.0.0.1:41715' 5946s 2025-02-21 01:04:48,489 - distributed.nanny - INFO - Start Nanny at: 'tls://127.0.0.1:40419' 5946s 2025-02-21 01:04:49,414 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:41157 5946s 2025-02-21 01:04:49,415 - distributed.worker - INFO - Listening to: tls://127.0.0.1:41157 5946s 2025-02-21 01:04:49,415 - distributed.worker - INFO - Worker name: 1 5946s 2025-02-21 01:04:49,415 - distributed.worker - INFO - dashboard at: 127.0.0.1:45921 5946s 2025-02-21 01:04:49,415 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33195 5946s 2025-02-21 01:04:49,415 - distributed.worker - INFO - ------------------------------------------------- 5946s 2025-02-21 01:04:49,415 - distributed.worker - INFO - Threads: 2 5946s 2025-02-21 01:04:49,415 - distributed.worker - INFO - Memory: 7.75 GiB 5946s 2025-02-21 01:04:49,415 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-wr33q95q 5946s 2025-02-21 01:04:49,415 - distributed.worker - INFO - ------------------------------------------------- 5946s 2025-02-21 01:04:49,469 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:46369 5946s 2025-02-21 01:04:49,469 - distributed.worker - INFO - Listening to: tls://127.0.0.1:46369 5946s 2025-02-21 01:04:49,469 - distributed.worker - INFO - Worker name: 0 5946s 2025-02-21 01:04:49,470 - distributed.worker - INFO - dashboard at: 127.0.0.1:37007 5946s 2025-02-21 01:04:49,470 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:33195 5946s 2025-02-21 01:04:49,470 - distributed.worker - INFO - ------------------------------------------------- 5946s 2025-02-21 01:04:49,470 - distributed.worker - INFO - Threads: 1 5946s 2025-02-21 01:04:49,470 - distributed.worker - INFO - Memory: 7.75 GiB 5946s 2025-02-21 01:04:49,470 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-q5njc51m 5946s 2025-02-21 01:04:49,470 - distributed.worker - INFO - ------------------------------------------------- 5946s 2025-02-21 01:04:49,708 - distributed.scheduler - INFO - Register worker addr: tls://127.0.0.1:41157 name: 1 5946s 2025-02-21 01:04:49,709 - distributed.scheduler - INFO - Starting worker compute stream, tls://127.0.0.1:41157 5946s 2025-02-21 01:04:49,709 - distributed.core - INFO - Starting established connection to tls://127.0.0.1:56928 5946s 2025-02-21 01:04:49,709 - distributed.worker - INFO - Starting Worker plugin shuffle 5946s 2025-02-21 01:04:49,710 - distributed.worker - INFO - Registered to: tls://127.0.0.1:33195 5946s 2025-02-21 01:04:49,710 - distributed.worker - INFO - ------------------------------------------------- 5946s 2025-02-21 01:04:49,711 - distributed.core - INFO - Starting established connection to tls://127.0.0.1:33195 5946s 2025-02-21 01:04:49,771 - distributed.scheduler - INFO - Register worker addr: tls://127.0.0.1:46369 name: 0 5946s 2025-02-21 01:04:49,772 - distributed.scheduler - INFO - Starting worker compute stream, tls://127.0.0.1:46369 5946s 2025-02-21 01:04:49,772 - distributed.core - INFO - Starting established connection to tls://127.0.0.1:56944 5946s 2025-02-21 01:04:49,773 - distributed.core - INFO - Connection to tls://127.0.0.1:56944 has been closed. 5946s 2025-02-21 01:04:49,773 - distributed.scheduler - INFO - Remove worker addr: tls://127.0.0.1:46369 name: 0 (stimulus_id='handle-worker-cleanup-1740099889.7731214') 5946s 2025-02-21 01:04:49,773 - distributed.worker - INFO - Starting Worker plugin shuffle 5946s 2025-02-21 01:04:49,774 - distributed.batched - INFO - Batched Comm Closed Scheduler local=tls://127.0.0.1:56944 remote=tls://127.0.0.1:33195> 5946s Traceback (most recent call last): 5946s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 297, in write 5946s raise StreamClosedError() 5946s tornado.iostream.StreamClosedError: Stream is closed 5946s 5946s The above exception was the direct cause of the following exception: 5946s 5946s Traceback (most recent call last): 5946s File "/usr/lib/python3/dist-packages/distributed/batched.py", line 115, in _background_send 5946s nbytes = yield coro 5946s ^^^^^^^^^^ 5946s File "/usr/lib/python3/dist-packages/tornado/gen.py", line 766, in run 5946s value = future.result() 5946s ^^^^^^^^^^^^^^^ 5946s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 307, in write 5946s convert_stream_closed_error(self, e) 5946s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 142, in convert_stream_closed_error 5946s raise CommClosedError(f"in {obj}: {exc}") from exc 5946s distributed.comm.core.CommClosedError: in Scheduler local=tls://127.0.0.1:56944 remote=tls://127.0.0.1:33195>: Stream is closed 5946s 2025-02-21 01:04:49,775 - distributed.worker - INFO - Registered to: tls://127.0.0.1:33195 5946s 2025-02-21 01:04:49,775 - distributed.worker - INFO - ------------------------------------------------- 5946s 2025-02-21 01:04:49,776 - distributed.core - INFO - Starting established connection to tls://127.0.0.1:33195 5946s 2025-02-21 01:04:49,776 - distributed.core - INFO - Connection to tls://127.0.0.1:33195 has been closed. 5946s 2025-02-21 01:04:49,776 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:46369. Reason: worker-handle-scheduler-connection-broken 5946s 2025-02-21 01:04:49,790 - distributed.nanny - INFO - Closing Nanny gracefully at 'tls://127.0.0.1:41715'. Reason: worker-handle-scheduler-connection-broken 5946s 2025-02-21 01:04:49,791 - distributed.worker - INFO - Removing Worker plugin shuffle 5946s 2025-02-21 01:04:49,793 - distributed.nanny - INFO - Worker closed 5946s 2025-02-21 01:04:51,794 - distributed.nanny - ERROR - Worker process died unexpectedly 5946s 2025-02-21 01:04:52,045 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:41715'. Reason: nanny-close-gracefully 5946s 2025-02-21 01:04:52,048 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:41715' closed. 5946s 2025-02-21 01:05:19,798 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:40419'. Reason: nanny-close 5946s 2025-02-21 01:05:19,798 - distributed.nanny - INFO - Nanny asking worker to close. Reason: nanny-close 5946s 2025-02-21 01:05:19,805 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:41157. Reason: nanny-close 5946s 2025-02-21 01:05:19,806 - distributed.worker - INFO - Removing Worker plugin shuffle 5946s 2025-02-21 01:05:19,808 - distributed.core - INFO - Received 'close-stream' from tls://127.0.0.1:56928; closing. 5946s 2025-02-21 01:05:19,808 - distributed.scheduler - INFO - Remove worker addr: tls://127.0.0.1:41157 name: 1 (stimulus_id='handle-worker-cleanup-1740099919.8087614') 5946s 2025-02-21 01:05:19,808 - distributed.core - INFO - Connection to tls://127.0.0.1:33195 has been closed. 5946s 2025-02-21 01:05:19,808 - distributed.scheduler - INFO - Lost all workers 5946s 2025-02-21 01:05:19,811 - distributed.nanny - INFO - Worker closed 5946s 2025-02-21 01:05:20,146 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:40419' closed. 5946s 2025-02-21 01:05:20,146 - distributed.scheduler - INFO - Closing scheduler. Reason: unknown 5946s 2025-02-21 01:05:20,146 - distributed.scheduler - INFO - Scheduler closing all comms 5946s 2025-02-21 01:05:20,147 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Cluster creation timeout; retrying 5946s Traceback (most recent call last): 5946s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 974, in _cluster_factory 5946s s, ws = await start_cluster( 5946s ^^^^^^^^^^^^^^^^^^^^ 5946s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 806, in start_cluster 5946s raise TimeoutError("Cluster creation timeout") 5946s TimeoutError: Cluster creation timeout 5946s 2025-02-21 01:05:21,151 - distributed.scheduler - INFO - State start 5946s 2025-02-21 01:05:21,155 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:45641 5946s 2025-02-21 01:05:21,156 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:43067/status 5946s 2025-02-21 01:05:21,156 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5946s 2025-02-21 01:05:21,168 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:42663'. Reason: failure-to-start- 5946s 2025-02-21 01:05:21,169 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:42663' closed. 5946s 2025-02-21 01:05:21,169 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:42577'. Reason: failure-to-start- 5946s 2025-02-21 01:05:21,169 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:42577' closed. 5946s 2025-02-21 01:05:21,170 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45641': TLS handshake failed with remote 'tls://127.0.0.1:48242': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1011) 5946s 2025-02-21 01:05:21,170 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45641': TLS handshake failed with remote 'tls://127.0.0.1:48256': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1011) 5946s 2025-02-21 01:05:21,170 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 5946s Traceback (most recent call last): 5946s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 5946s return await fut 5946s ^^^^^^^^^ 5946s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 5946s comm = await self.rpc.connect(saddr) 5946s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5946s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1485, in connect 5946s return await self._connect(addr=addr, timeout=timeout) 5946s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5946s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1429, in _connect 5946s comm = await connect( 5946s ^^^^^^^^^^^^^^ 5946s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5946s comm = await wait_for( 5946s ^^^^^^^^^^^^^^^ 5946s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 5946s return await fut 5946s ^^^^^^^^^ 5946s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5946s stream = await self.client.connect( 5946s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5946s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5946s af, addr, stream = await connector.start(connect_timeout=timeout) 5946s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5946s asyncio.exceptions.CancelledError 5946s 5946s The above exception was the direct cause of the following exception: 5946s 5946s Traceback (most recent call last): 5946s File "/usr/lib/python3/dist-packages/distributed/core.py", line 528, in start 5946s await wait_for(self.start_unsafe(), timeout=timeout) 5946s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1913, in wait_for 5946s async with asyncio.timeout(timeout): 5946s ^^^^^^^^^^^^^^^^^^^^^^^^ 5946s File "/usr/lib/python3.12/asyncio/timeouts.py", line 115, in __aexit__ 5946s raise TimeoutError from exc_val 5946s TimeoutError 5946s 5946s The above exception was the direct cause of the following exception: 5946s 5946s Traceback (most recent call last): 5946s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 974, in _cluster_factory 5946s s, ws = await start_cluster( 5946s ^^^^^^^^^^^^^^^^^^^^ 5946s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 791, in start_cluster 5946s await asyncio.gather(*workers) 5946s File "/usr/lib/python3.12/asyncio/tasks.py", line 684, in _wrap_awaitable 5946s return await awaitable 5946s ^^^^^^^^^^^^^^^ 5946s File "/usr/lib/python3/dist-packages/distributed/core.py", line 531, in start 5946s raise asyncio.TimeoutError( 5946s TimeoutError: Nanny start timed out after 0s. 5946s 2025-02-21 01:05:22,176 - distributed.scheduler - INFO - State start 5946s 2025-02-21 01:05:22,184 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:38637 5946s 2025-02-21 01:05:22,185 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:46347/status 5946s 2025-02-21 01:05:22,185 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5946s 2025-02-21 01:05:22,194 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:39331'. Reason: failure-to-start- 5946s 2025-02-21 01:05:22,194 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:39331' closed. 5946s 2025-02-21 01:05:22,194 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:39085'. Reason: failure-to-start- 5946s 2025-02-21 01:05:22,194 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:39085' closed. 5946s 2025-02-21 01:05:22,195 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38637': TLS handshake failed with remote 'tls://127.0.0.1:42810': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1011) 5946s 2025-02-21 01:05:22,195 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38637': TLS handshake failed with remote 'tls://127.0.0.1:42822': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1011) 5946s 2025-02-21 01:05:22,195 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 5946s Traceback (most recent call last): 5946s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 5946s return await fut 5946s ^^^^^^^^^ 5946s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 5946s comm = await self.rpc.connect(saddr) 5946s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5946s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1485, in connect 5946s return await self._connect(addr=addr, timeout=timeout) 5946s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5946s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1429, in _connect 5946s comm = await connect( 5946s ^^^^^^^^^^^^^^ 5946s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5946s comm = await wait_for( 5946s ^^^^^^^^^^^^^^^ 5946s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 5946s return await fut 5946s ^^^^^^^^^ 5946s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5946s stream = await self.client.connect( 5946s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5946s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5946s af, addr, stream = await connector.start(connect_timeout=timeout) 5946s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5946s asyncio.exceptions.CancelledError 5946s 5946s The above exception was the direct cause of the following exception: 5946s 5946s Traceback (most recent call last): 5946s File "/usr/lib/python3/dist-packages/distributed/core.py", line 528, in start 5946s await wait_for(self.start_unsafe(), timeout=timeout) 5946s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1913, in wait_for 5946s async with asyncio.timeout(timeout): 5946s ^^^^^^^^^^^^^^^^^^^^^^^^ 5946s File "/usr/lib/python3.12/asyncio/timeouts.py", line 115, in __aexit__ 5946s raise TimeoutError from exc_val 5946s TimeoutError 5946s 5946s The above exception was the direct cause of the following exception: 5946s 5946s Traceback (most recent call last): 5946s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 974, in _cluster_factory 5946s s, ws = await start_cluster( 5946s ^^^^^^^^^^^^^^^^^^^^ 5946s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 791, in start_cluster 5946s await asyncio.gather(*workers) 5946s File "/usr/lib/python3.12/asyncio/tasks.py", line 684, in _wrap_awaitable 5946s return await awaitable 5946s ^^^^^^^^^^^^^^^ 5946s File "/usr/lib/python3/dist-packages/distributed/core.py", line 531, in start 5946s raise asyncio.TimeoutError( 5946s TimeoutError: Nanny start timed out after 0s. 5946s 2025-02-21 01:05:23,201 - distributed.scheduler - INFO - State start 5946s 2025-02-21 01:05:23,208 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:39799 5946s 2025-02-21 01:05:23,209 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:43109/status 5946s 2025-02-21 01:05:23,209 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5946s 2025-02-21 01:05:23,217 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:41565'. Reason: failure-to-start- 5946s 2025-02-21 01:05:23,217 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:41565' closed. 5946s 2025-02-21 01:05:23,217 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:46663'. Reason: failure-to-start- 5946s 2025-02-21 01:05:23,217 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:46663' closed. 5946s 2025-02-21 01:05:23,217 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39799': TLS handshake failed with remote 'tls://127.0.0.1:38372': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1011) 5946s 2025-02-21 01:05:23,218 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39799': TLS handshake failed with remote 'tls://127.0.0.1:38380': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1011) 5946s 2025-02-21 01:05:23,218 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 5946s Traceback (most recent call last): 5946s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 5946s return await fut 5946s ^^^^^^^^^ 5946s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 5946s comm = await self.rpc.connect(saddr) 5946s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5946s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1485, in connect 5946s return await self._connect(addr=addr, timeout=timeout) 5946s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5946s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1429, in _connect 5946s comm = await connect( 5946s ^^^^^^^^^^^^^^ 5946s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5946s comm = await wait_for( 5946s ^^^^^^^^^^^^^^^ 5946s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 5946s return await fut 5946s ^^^^^^^^^ 5946s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5946s stream = await self.client.connect( 5946s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5946s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5946s af, addr, stream = await connector.start(connect_timeout=timeout) 5946s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5946s asyncio.exceptions.CancelledError 5946s 5946s The above exception was the direct cause of the following exception: 5946s 5946s Traceback (most recent call last): 5946s File "/usr/lib/python3/dist-packages/distributed/core.py", line 528, in start 5946s await wait_for(self.start_unsafe(), timeout=timeout) 5946s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1913, in wait_for 5946s async with asyncio.timeout(timeout): 5946s ^^^^^^^^^^^^^^^^^^^^^^^^ 5946s File "/usr/lib/python3.12/asyncio/timeouts.py", line 115, in __aexit__ 5946s raise TimeoutError from exc_val 5946s TimeoutError 5946s 5946s The above exception was the direct cause of the following exception: 5946s 5946s Traceback (most recent call last): 5946s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 974, in _cluster_factory 5946s s, ws = await start_cluster( 5946s ^^^^^^^^^^^^^^^^^^^^ 5946s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 791, in start_cluster 5946s await asyncio.gather(*workers) 5946s File "/usr/lib/python3.12/asyncio/tasks.py", line 684, in _wrap_awaitable 5946s return await awaitable 5946s ^^^^^^^^^^^^^^^ 5946s File "/usr/lib/python3/dist-packages/distributed/core.py", line 531, in start 5946s raise asyncio.TimeoutError( 5946s TimeoutError: Nanny start timed out after 0s. 5946s 2025-02-21 01:05:24,222 - distributed.scheduler - INFO - State start 5946s 2025-02-21 01:05:24,226 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:39145 5946s 2025-02-21 01:05:24,227 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:46385/status 5946s 2025-02-21 01:05:24,227 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5946s 2025-02-21 01:05:24,234 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:45571'. Reason: failure-to-start- 5946s 2025-02-21 01:05:24,235 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:45571' closed. 5946s 2025-02-21 01:05:24,235 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:44467'. Reason: failure-to-start- 5946s 2025-02-21 01:05:24,235 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:44467' closed. 5946s 2025-02-21 01:05:24,235 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39145': TLS handshake failed with remote 'tls://127.0.0.1:48144': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1011) 5946s 2025-02-21 01:05:24,235 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39145': TLS handshake failed with remote 'tls://127.0.0.1:48160': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1011) 5946s 2025-02-21 01:05:24,236 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 5946s Traceback (most recent call last): 5946s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 5946s return await fut 5946s ^^^^^^^^^ 5946s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 5946s comm = await self.rpc.connect(saddr) 5946s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5946s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1485, in connect 5946s return await self._connect(addr=addr, timeout=timeout) 5946s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5946s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1429, in _connect 5946s comm = await connect( 5946s ^^^^^^^^^^^^^^ 5946s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5946s comm = await wait_for( 5946s ^^^^^^^^^^^^^^^ 5946s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 5946s return await fut 5946s ^^^^^^^^^ 5946s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5946s stream = await self.client.connect( 5946s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5946s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5946s af, addr, stream = await connector.start(connect_timeout=timeout) 5946s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5946s asyncio.exceptions.CancelledError 5946s 5946s The above exception was the direct cause of the following exception: 5946s 5946s Traceback (most recent call last): 5946s File "/usr/lib/python3/dist-packages/distributed/core.py", line 528, in start 5946s await wait_for(self.start_unsafe(), timeout=timeout) 5946s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1913, in wait_for 5946s async with asyncio.timeout(timeout): 5946s ^^^^^^^^^^^^^^^^^^^^^^^^ 5946s File "/usr/lib/python3.12/asyncio/timeouts.py", line 115, in __aexit__ 5946s raise TimeoutError from exc_val 5946s TimeoutError 5946s 5946s The above exception was the direct cause of the following exception: 5946s 5946s Traceback (most recent call last): 5946s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 974, in _cluster_factory 5946s s, ws = await start_cluster( 5946s ^^^^^^^^^^^^^^^^^^^^ 5946s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 791, in start_cluster 5946s await asyncio.gather(*workers) 5946s File "/usr/lib/python3.12/asyncio/tasks.py", line 684, in _wrap_awaitable 5946s return await awaitable 5946s ^^^^^^^^^^^^^^^ 5946s File "/usr/lib/python3/dist-packages/distributed/core.py", line 531, in start 5946s raise asyncio.TimeoutError( 5946s TimeoutError: Nanny start timed out after 0s. 5946s 2025-02-21 01:05:25,239 - distributed.scheduler - INFO - State start 5946s 2025-02-21 01:05:25,251 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:35459 5946s 2025-02-21 01:05:25,251 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:42487/status 5946s 2025-02-21 01:05:25,251 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5946s 2025-02-21 01:05:25,258 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:36749'. Reason: failure-to-start- 5946s 2025-02-21 01:05:25,258 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:36749' closed. 5946s 2025-02-21 01:05:25,258 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:40335'. Reason: failure-to-start- 5946s 2025-02-21 01:05:25,258 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:40335' closed. 5946s 2025-02-21 01:05:25,262 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35459': TLS handshake failed with remote 'tls://127.0.0.1:36890': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1011) 5946s 2025-02-21 01:05:25,262 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35459': TLS handshake failed with remote 'tls://127.0.0.1:36896': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1011) 5946s 2025-02-21 01:05:25,262 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 5946s Traceback (most recent call last): 5946s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 5946s return await fut 5946s ^^^^^^^^^ 5946s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 5946s comm = await self.rpc.connect(saddr) 5946s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5946s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1485, in connect 5946s return await self._connect(addr=addr, timeout=timeout) 5946s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5946s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1429, in _connect 5946s comm = await connect( 5946s ^^^^^^^^^^^^^^ 5946s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5946s comm = await wait_for( 5946s ^^^^^^^^^^^^^^^ 5946s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 5946s return await fut 5946s ^^^^^^^^^ 5946s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5946s stream = await self.client.connect( 5946s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5946s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5946s af, addr, stream = await connector.start(connect_timeout=timeout) 5946s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5946s asyncio.exceptions.CancelledError 5946s 5946s The above exception was the direct cause of the following exception: 5946s 5946s Traceback (most recent call last): 5946s File "/usr/lib/python3/dist-packages/distributed/core.py", line 528, in start 5946s await wait_for(self.start_unsafe(), timeout=timeout) 5946s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1913, in wait_for 5946s async with asyncio.timeout(timeout): 5946s ^^^^^^^^^^^^^^^^^^^^^^^^ 5946s File "/usr/lib/python3.12/asyncio/timeouts.py", line 115, in __aexit__ 5946s raise TimeoutError from exc_val 5946s TimeoutError 5946s 5946s The above exception was the direct cause of the following exception: 5946s 5946s Traceback (most recent call last): 5946s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 974, in _cluster_factory 5946s s, ws = await start_cluster( 5946s ^^^^^^^^^^^^^^^^^^^^ 5946s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 791, in start_cluster 5946s await asyncio.gather(*workers) 5946s File "/usr/lib/python3.12/asyncio/tasks.py", line 684, in _wrap_awaitable 5946s return await awaitable 5946s ^^^^^^^^^^^^^^^ 5946s File "/usr/lib/python3/dist-packages/distributed/core.py", line 531, in start 5946s raise asyncio.TimeoutError( 5946s TimeoutError: Nanny start timed out after 0s. 5946s 2025-02-21 01:05:26,274 - distributed.scheduler - INFO - State start 5946s 2025-02-21 01:05:26,277 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:40095 5946s 2025-02-21 01:05:26,278 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:42795/status 5946s 2025-02-21 01:05:26,278 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5946s 2025-02-21 01:05:26,294 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:32943'. Reason: failure-to-start- 5946s 2025-02-21 01:05:26,295 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:32943' closed. 5946s 2025-02-21 01:05:26,295 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:44059'. Reason: failure-to-start- 5946s 2025-02-21 01:05:26,295 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:44059' closed. 5946s 2025-02-21 01:05:26,296 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40095': TLS handshake failed with remote 'tls://127.0.0.1:38838': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1011) 5946s 2025-02-21 01:05:26,296 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40095': TLS handshake failed with remote 'tls://127.0.0.1:38850': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1011) 5946s 2025-02-21 01:05:26,296 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 5946s Traceback (most recent call last): 5946s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 5946s return await fut 5946s ^^^^^^^^^ 5946s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 5946s comm = await self.rpc.connect(saddr) 5946s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5946s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1485, in connect 5946s return await self._connect(addr=addr, timeout=timeout) 5946s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5946s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1429, in _connect 5946s comm = await connect( 5946s ^^^^^^^^^^^^^^ 5946s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5946s comm = await wait_for( 5946s ^^^^^^^^^^^^^^^ 5946s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 5946s return await fut 5946s ^^^^^^^^^ 5946s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5946s stream = await self.client.connect( 5946s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5946s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5946s af, addr, stream = await connector.start(connect_timeout=timeout) 5946s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5946s asyncio.exceptions.CancelledError 5946s 5946s The above exception was the direct cause of the following exception: 5946s 5946s Traceback (most recent call last): 5946s File "/usr/lib/python3/dist-packages/distributed/core.py", line 528, in start 5946s await wait_for(self.start_unsafe(), timeout=timeout) 5946s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1913, in wait_for 5946s async with asyncio.timeout(timeout): 5946s ^^^^^^^^^^^^^^^^^^^^^^^^ 5946s File "/usr/lib/python3.12/asyncio/timeouts.py", line 115, in __aexit__ 5946s raise TimeoutError from exc_val 5946s TimeoutError 5946s 5946s The above exception was the direct cause of the following exception: 5946s 5946s Traceback (most recent call last): 5946s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 974, in _cluster_factory 5946s s, ws = await start_cluster( 5946s ^^^^^^^^^^^^^^^^^^^^ 5946s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 791, in start_cluster 5946s await asyncio.gather(*workers) 5946s File "/usr/lib/python3.12/asyncio/tasks.py", line 684, in _wrap_awaitable 5946s return await awaitable 5946s ^^^^^^^^^^^^^^^ 5946s File "/usr/lib/python3/dist-packages/distributed/core.py", line 531, in start 5946s raise asyncio.TimeoutError( 5946s TimeoutError: Nanny start timed out after 0s. 5946s 2025-02-21 01:05:27,301 - distributed.scheduler - INFO - State start 5946s 2025-02-21 01:05:27,306 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:35489 5946s 2025-02-21 01:05:27,306 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:39267/status 5946s 2025-02-21 01:05:27,307 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5946s 2025-02-21 01:05:27,317 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:36025'. Reason: failure-to-start- 5946s 2025-02-21 01:05:27,317 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:36025' closed. 5946s 2025-02-21 01:05:27,317 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:35579'. Reason: failure-to-start- 5946s 2025-02-21 01:05:27,317 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:35579' closed. 5946s 2025-02-21 01:05:27,318 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35489': TLS handshake failed with remote 'tls://127.0.0.1:37760': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1011) 5946s 2025-02-21 01:05:27,318 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35489': TLS handshake failed with remote 'tls://127.0.0.1:37766': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1011) 5946s 2025-02-21 01:05:27,318 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 5946s Traceback (most recent call last): 5946s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 5946s return await fut 5946s ^^^^^^^^^ 5946s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 5946s comm = await self.rpc.connect(saddr) 5946s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5946s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1485, in connect 5946s return await self._connect(addr=addr, timeout=timeout) 5946s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5946s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1429, in _connect 5946s comm = await connect( 5946s ^^^^^^^^^^^^^^ 5946s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5946s comm = await wait_for( 5946s ^^^^^^^^^^^^^^^ 5946s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 5946s return await fut 5946s ^^^^^^^^^ 5946s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5946s stream = await self.client.connect( 5946s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5946s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5946s af, addr, stream = await connector.start(connect_timeout=timeout) 5946s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5946s asyncio.exceptions.CancelledError 5946s 5946s The above exception was the direct cause of the following exception: 5946s 5946s Traceback (most recent call last): 5946s File "/usr/lib/python3/dist-packages/distributed/core.py", line 528, in start 5946s await wait_for(self.start_unsafe(), timeout=timeout) 5946s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1913, in wait_for 5946s async with asyncio.timeout(timeout): 5946s ^^^^^^^^^^^^^^^^^^^^^^^^ 5946s File "/usr/lib/python3.12/asyncio/timeouts.py", line 115, in __aexit__ 5946s raise TimeoutError from exc_val 5946s TimeoutError 5946s 5946s The above exception was the direct cause of the following exception: 5946s 5946s Traceback (most recent call last): 5946s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 974, in _cluster_factory 5946s s, ws = await start_cluster( 5946s ^^^^^^^^^^^^^^^^^^^^ 5946s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 791, in start_cluster 5946s await asyncio.gather(*workers) 5946s File "/usr/lib/python3.12/asyncio/tasks.py", line 684, in _wrap_awaitable 5946s return await awaitable 5946s ^^^^^^^^^^^^^^^ 5946s File "/usr/lib/python3/dist-packages/distributed/core.py", line 531, in start 5946s raise asyncio.TimeoutError( 5946s TimeoutError: Nanny start timed out after 0s. 5946s 2025-02-21 01:05:28,322 - distributed.scheduler - INFO - State start 5946s 2025-02-21 01:05:28,326 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:33905 5946s 2025-02-21 01:05:28,326 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:40635/status 5946s 2025-02-21 01:05:28,326 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5946s 2025-02-21 01:05:28,333 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:37113'. Reason: failure-to-start- 5946s 2025-02-21 01:05:28,333 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:37113' closed. 5946s 2025-02-21 01:05:28,333 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:38701'. Reason: failure-to-start- 5946s 2025-02-21 01:05:28,333 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:38701' closed. 5946s 2025-02-21 01:05:28,334 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33905': TLS handshake failed with remote 'tls://127.0.0.1:41790': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1011) 5946s 2025-02-21 01:05:28,334 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33905': TLS handshake failed with remote 'tls://127.0.0.1:41806': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1011) 5946s 2025-02-21 01:05:28,334 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 5946s Traceback (most recent call last): 5946s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 5946s return await fut 5946s ^^^^^^^^^ 5946s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 5946s comm = await self.rpc.connect(saddr) 5946s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5946s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1485, in connect 5946s return await self._connect(addr=addr, timeout=timeout) 5946s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5946s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1429, in _connect 5946s comm = await connect( 5946s ^^^^^^^^^^^^^^ 5946s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5946s comm = await wait_for( 5946s ^^^^^^^^^^^^^^^ 5946s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 5946s return await fut 5946s ^^^^^^^^^ 5946s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5946s stream = await self.client.connect( 5946s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5946s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5946s af, addr, stream = await connector.start(connect_timeout=timeout) 5946s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5946s asyncio.exceptions.CancelledError 5946s 5946s The above exception was the direct cause of the following exception: 5946s 5946s Traceback (most recent call last): 5946s File "/usr/lib/python3/dist-packages/distributed/core.py", line 528, in start 5946s await wait_for(self.start_unsafe(), timeout=timeout) 5946s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1913, in wait_for 5946s async with asyncio.timeout(timeout): 5946s ^^^^^^^^^^^^^^^^^^^^^^^^ 5946s File "/usr/lib/python3.12/asyncio/timeouts.py", line 115, in __aexit__ 5946s raise TimeoutError from exc_val 5946s TimeoutError 5946s 5946s The above exception was the direct cause of the following exception: 5946s 5946s Traceback (most recent call last): 5946s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 974, in _cluster_factory 5946s s, ws = await start_cluster( 5946s ^^^^^^^^^^^^^^^^^^^^ 5946s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 791, in start_cluster 5946s await asyncio.gather(*workers) 5946s File "/usr/lib/python3.12/asyncio/tasks.py", line 684, in _wrap_awaitable 5946s return await awaitable 5946s ^^^^^^^^^^^^^^^ 5946s File "/usr/lib/python3/dist-packages/distributed/core.py", line 531, in start 5946s raise asyncio.TimeoutError( 5946s TimeoutError: Nanny start timed out after 0s. 5946s 2025-02-21 01:05:29,338 - distributed.scheduler - INFO - State start 5946s 2025-02-21 01:05:29,342 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:38501 5946s 2025-02-21 01:05:29,342 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:39637/status 5946s 2025-02-21 01:05:29,342 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5946s 2025-02-21 01:05:29,355 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:46279'. Reason: failure-to-start- 5946s 2025-02-21 01:05:29,355 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:46279' closed. 5946s 2025-02-21 01:05:29,355 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:34723'. Reason: failure-to-start- 5946s 2025-02-21 01:05:29,355 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:34723' closed. 5946s 2025-02-21 01:05:29,356 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38501': TLS handshake failed with remote 'tls://127.0.0.1:57222': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1011) 5946s 2025-02-21 01:05:29,356 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38501': TLS handshake failed with remote 'tls://127.0.0.1:57236': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1011) 5946s 2025-02-21 01:05:29,356 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 5946s Traceback (most recent call last): 5946s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 5946s return await fut 5946s ^^^^^^^^^ 5946s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 5946s comm = await self.rpc.connect(saddr) 5946s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5946s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1485, in connect 5946s return await self._connect(addr=addr, timeout=timeout) 5946s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5946s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1429, in _connect 5946s comm = await connect( 5946s ^^^^^^^^^^^^^^ 5946s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5946s comm = await wait_for( 5946s ^^^^^^^^^^^^^^^ 5946s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 5946s return await fut 5946s ^^^^^^^^^ 5946s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5946s stream = await self.client.connect( 5946s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5946s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5946s af, addr, stream = await connector.start(connect_timeout=timeout) 5946s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5946s asyncio.exceptions.CancelledError 5946s 5946s The above exception was the direct cause of the following exception: 5946s 5946s Traceback (most recent call last): 5946s File "/usr/lib/python3/dist-packages/distributed/core.py", line 528, in start 5946s await wait_for(self.start_unsafe(), timeout=timeout) 5946s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1913, in wait_for 5946s async with asyncio.timeout(timeout): 5946s ^^^^^^^^^^^^^^^^^^^^^^^^ 5946s File "/usr/lib/python3.12/asyncio/timeouts.py", line 115, in __aexit__ 5946s raise TimeoutError from exc_val 5946s TimeoutError 5946s 5946s The above exception was the direct cause of the following exception: 5946s 5946s Traceback (most recent call last): 5946s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 974, in _cluster_factory 5946s s, ws = await start_cluster( 5946s ^^^^^^^^^^^^^^^^^^^^ 5946s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 791, in start_cluster 5946s await asyncio.gather(*workers) 5946s File "/usr/lib/python3.12/asyncio/tasks.py", line 684, in _wrap_awaitable 5946s return await awaitable 5946s ^^^^^^^^^^^^^^^ 5946s File "/usr/lib/python3/dist-packages/distributed/core.py", line 531, in start 5946s raise asyncio.TimeoutError( 5946s TimeoutError: Nanny start timed out after 0s. 5946s 2025-02-21 01:05:30,361 - distributed.scheduler - INFO - State start 5946s 2025-02-21 01:05:30,367 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:34359 5946s 2025-02-21 01:05:30,367 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:46757/status 5946s 2025-02-21 01:05:30,368 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5946s 2025-02-21 01:05:30,377 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:43333'. Reason: failure-to-start- 5946s 2025-02-21 01:05:30,378 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:43333' closed. 5946s 2025-02-21 01:05:30,378 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:37037'. Reason: failure-to-start- 5946s 2025-02-21 01:05:30,378 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:37037' closed. 5946s 2025-02-21 01:05:30,379 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34359': TLS handshake failed with remote 'tls://127.0.0.1:37094': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1011) 5946s 2025-02-21 01:05:30,379 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34359': TLS handshake failed with remote 'tls://127.0.0.1:37108': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1011) 5946s 2025-02-21 01:05:30,379 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 5946s Traceback (most recent call last): 5946s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 5946s return await fut 5946s ^^^^^^^^^ 5946s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 5946s comm = await self.rpc.connect(saddr) 5946s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5946s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1485, in connect 5946s return await self._connect(addr=addr, timeout=timeout) 5946s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5946s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1429, in _connect 5946s comm = await connect( 5946s ^^^^^^^^^^^^^^ 5946s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5946s comm = await wait_for( 5946s ^^^^^^^^^^^^^^^ 5946s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 5946s return await fut 5946s ^^^^^^^^^ 5946s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5946s stream = await self.client.connect( 5946s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5946s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5946s af, addr, stream = await connector.start(connect_timeout=timeout) 5946s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5946s asyncio.exceptions.CancelledError 5946s 5946s The above exception was the direct cause of the following exception: 5946s 5946s Traceback (most recent call last): 5946s File "/usr/lib/python3/dist-packages/distributed/core.py", line 528, in start 5946s await wait_for(self.start_unsafe(), timeout=timeout) 5946s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1913, in wait_for 5946s async with asyncio.timeout(timeout): 5946s ^^^^^^^^^^^^^^^^^^^^^^^^ 5946s File "/usr/lib/python3.12/asyncio/timeouts.py", line 115, in __aexit__ 5946s raise TimeoutError from exc_val 5946s TimeoutError 5946s 5946s The above exception was the direct cause of the following exception: 5946s 5946s Traceback (most recent call last): 5946s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 974, in _cluster_factory 5946s s, ws = await start_cluster( 5946s ^^^^^^^^^^^^^^^^^^^^ 5946s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 791, in start_cluster 5946s await asyncio.gather(*workers) 5946s File "/usr/lib/python3.12/asyncio/tasks.py", line 684, in _wrap_awaitable 5946s return await awaitable 5946s ^^^^^^^^^^^^^^^ 5946s File "/usr/lib/python3/dist-packages/distributed/core.py", line 531, in start 5946s raise asyncio.TimeoutError( 5946s TimeoutError: Nanny start timed out after 0s. 5946s 2025-02-21 01:05:31,383 - distributed.scheduler - INFO - State start 5946s 2025-02-21 01:05:31,387 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:39319 5946s 2025-02-21 01:05:31,388 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:36019/status 5946s 2025-02-21 01:05:31,388 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5946s 2025-02-21 01:05:31,400 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:44451'. Reason: failure-to-start- 5946s 2025-02-21 01:05:31,401 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:44451' closed. 5946s 2025-02-21 01:05:31,401 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:45951'. Reason: failure-to-start- 5946s 2025-02-21 01:05:31,401 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:45951' closed. 5946s 2025-02-21 01:05:31,401 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39319': TLS handshake failed with remote 'tls://127.0.0.1:48880': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1011) 5946s 2025-02-21 01:05:31,401 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39319': TLS handshake failed with remote 'tls://127.0.0.1:48888': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1011) 5946s 2025-02-21 01:05:31,401 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 5946s Traceback (most recent call last): 5946s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 5946s return await fut 5946s ^^^^^^^^^ 5946s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 5946s comm = await self.rpc.connect(saddr) 5946s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5946s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1485, in connect 5946s return await self._connect(addr=addr, timeout=timeout) 5946s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5946s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1429, in _connect 5946s comm = await connect( 5946s ^^^^^^^^^^^^^^ 5946s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5946s comm = await wait_for( 5946s ^^^^^^^^^^^^^^^ 5946s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 5946s return await fut 5946s ^^^^^^^^^ 5946s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5946s stream = await self.client.connect( 5946s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5946s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5946s af, addr, stream = await connector.start(connect_timeout=timeout) 5946s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5946s asyncio.exceptions.CancelledError 5946s 5946s The above exception was the direct cause of the following exception: 5946s 5946s Traceback (most recent call last): 5946s File "/usr/lib/python3/dist-packages/distributed/core.py", line 528, in start 5946s await wait_for(self.start_unsafe(), timeout=timeout) 5946s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1913, in wait_for 5946s async with asyncio.timeout(timeout): 5946s ^^^^^^^^^^^^^^^^^^^^^^^^ 5946s File "/usr/lib/python3.12/asyncio/timeouts.py", line 115, in __aexit__ 5946s raise TimeoutError from exc_val 5946s TimeoutError 5946s 5946s The above exception was the direct cause of the following exception: 5946s 5946s Traceback (most recent call last): 5946s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 974, in _cluster_factory 5946s s, ws = await start_cluster( 5946s ^^^^^^^^^^^^^^^^^^^^ 5946s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 791, in start_cluster 5946s await asyncio.gather(*workers) 5946s File "/usr/lib/python3.12/asyncio/tasks.py", line 684, in _wrap_awaitable 5946s return await awaitable 5946s ^^^^^^^^^^^^^^^ 5946s File "/usr/lib/python3/dist-packages/distributed/core.py", line 531, in start 5946s raise asyncio.TimeoutError( 5946s TimeoutError: Nanny start timed out after 0s. 5946s 2025-02-21 01:05:32,406 - distributed.scheduler - INFO - State start 5946s 2025-02-21 01:05:32,420 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:32793 5946s 2025-02-21 01:05:32,421 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:43777/status 5946s 2025-02-21 01:05:32,421 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5946s 2025-02-21 01:05:32,441 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:32921'. Reason: failure-to-start- 5946s 2025-02-21 01:05:32,441 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:32921' closed. 5946s 2025-02-21 01:05:32,442 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:36143'. Reason: failure-to-start- 5946s 2025-02-21 01:05:32,442 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:36143' closed. 5946s 2025-02-21 01:05:32,442 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:32793': TLS handshake failed with remote 'tls://127.0.0.1:46508': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1011) 5946s 2025-02-21 01:05:32,442 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:32793': TLS handshake failed with remote 'tls://127.0.0.1:46520': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1011) 5946s 2025-02-21 01:05:32,442 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 5946s Traceback (most recent call last): 5946s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 5946s return await fut 5946s ^^^^^^^^^ 5946s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 5946s comm = await self.rpc.connect(saddr) 5946s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5946s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1485, in connect 5946s return await self._connect(addr=addr, timeout=timeout) 5946s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5946s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1429, in _connect 5946s comm = await connect( 5946s ^^^^^^^^^^^^^^ 5946s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5946s comm = await wait_for( 5946s ^^^^^^^^^^^^^^^ 5946s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 5946s return await fut 5946s ^^^^^^^^^ 5946s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5946s stream = await self.client.connect( 5946s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5946s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5946s af, addr, stream = await connector.start(connect_timeout=timeout) 5946s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5946s asyncio.exceptions.CancelledError 5946s 5946s The above exception was the direct cause of the following exception: 5946s 5946s Traceback (most recent call last): 5946s File "/usr/lib/python3/dist-packages/distributed/core.py", line 528, in start 5946s await wait_for(self.start_unsafe(), timeout=timeout) 5946s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1913, in wait_for 5946s async with asyncio.timeout(timeout): 5946s ^^^^^^^^^^^^^^^^^^^^^^^^ 5946s File "/usr/lib/python3.12/asyncio/timeouts.py", line 115, in __aexit__ 5946s raise TimeoutError from exc_val 5946s TimeoutError 5946s 5946s The above exception was the direct cause of the following exception: 5946s 5946s Traceback (most recent call last): 5946s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 974, in _cluster_factory 5946s s, ws = await start_cluster( 5946s ^^^^^^^^^^^^^^^^^^^^ 5946s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 791, in start_cluster 5946s await asyncio.gather(*workers) 5946s File "/usr/lib/python3.12/asyncio/tasks.py", line 684, in _wrap_awaitable 5946s return await awaitable 5946s ^^^^^^^^^^^^^^^ 5946s File "/usr/lib/python3/dist-packages/distributed/core.py", line 531, in start 5946s raise asyncio.TimeoutError( 5946s TimeoutError: Nanny start timed out after 0s. 5946s 2025-02-21 01:05:33,446 - distributed.scheduler - INFO - State start 5946s 2025-02-21 01:05:33,453 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:41147 5946s 2025-02-21 01:05:33,453 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:44349/status 5946s 2025-02-21 01:05:33,453 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5946s 2025-02-21 01:05:33,460 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:41955'. Reason: failure-to-start- 5946s 2025-02-21 01:05:33,461 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:41955' closed. 5946s 2025-02-21 01:05:33,461 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:45287'. Reason: failure-to-start- 5946s 2025-02-21 01:05:33,461 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:45287' closed. 5946s 2025-02-21 01:05:33,461 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41147': TLS handshake failed with remote 'tls://127.0.0.1:49524': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1011) 5946s 2025-02-21 01:05:33,462 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41147': TLS handshake failed with remote 'tls://127.0.0.1:49526': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1011) 5946s 2025-02-21 01:05:33,462 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 5946s Traceback (most recent call last): 5946s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 5946s return await fut 5946s ^^^^^^^^^ 5946s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 5946s comm = await self.rpc.connect(saddr) 5946s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5946s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1485, in connect 5946s return await self._connect(addr=addr, timeout=timeout) 5946s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5946s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1429, in _connect 5946s comm = await connect( 5946s ^^^^^^^^^^^^^^ 5946s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5946s comm = await wait_for( 5946s ^^^^^^^^^^^^^^^ 5946s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 5946s return await fut 5946s ^^^^^^^^^ 5946s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5946s stream = await self.client.connect( 5946s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5946s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5946s af, addr, stream = await connector.start(connect_timeout=timeout) 5946s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5946s asyncio.exceptions.CancelledError 5946s 5946s The above exception was the direct cause of the following exception: 5946s 5946s Traceback (most recent call last): 5946s File "/usr/lib/python3/dist-packages/distributed/core.py", line 528, in start 5946s await wait_for(self.start_unsafe(), timeout=timeout) 5946s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1913, in wait_for 5946s async with asyncio.timeout(timeout): 5946s ^^^^^^^^^^^^^^^^^^^^^^^^ 5946s File "/usr/lib/python3.12/asyncio/timeouts.py", line 115, in __aexit__ 5946s raise TimeoutError from exc_val 5946s TimeoutError 5946s 5946s The above exception was the direct cause of the following exception: 5946s 5946s Traceback (most recent call last): 5946s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 974, in _cluster_factory 5946s s, ws = await start_cluster( 5946s ^^^^^^^^^^^^^^^^^^^^ 5946s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 791, in start_cluster 5946s await asyncio.gather(*workers) 5946s File "/usr/lib/python3.12/asyncio/tasks.py", line 684, in _wrap_awaitable 5946s return await awaitable 5946s ^^^^^^^^^^^^^^^ 5946s File "/usr/lib/python3/dist-packages/distributed/core.py", line 531, in start 5946s raise asyncio.TimeoutError( 5946s TimeoutError: Nanny start timed out after 0s. 5946s 2025-02-21 01:05:34,465 - distributed.scheduler - INFO - State start 5946s 2025-02-21 01:05:34,469 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:34507 5946s 2025-02-21 01:05:34,469 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:38319/status 5946s 2025-02-21 01:05:34,469 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5946s 2025-02-21 01:05:34,477 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:37291'. Reason: failure-to-start- 5946s 2025-02-21 01:05:34,477 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:37291' closed. 5946s 2025-02-21 01:05:34,477 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:34211'. Reason: failure-to-start- 5946s 2025-02-21 01:05:34,477 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:34211' closed. 5946s 2025-02-21 01:05:34,477 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34507': TLS handshake failed with remote 'tls://127.0.0.1:52116': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1011) 5946s 2025-02-21 01:05:34,478 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34507': TLS handshake failed with remote 'tls://127.0.0.1:52132': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1011) 5946s 2025-02-21 01:05:34,478 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 5946s Traceback (most recent call last): 5946s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 5946s return await fut 5946s ^^^^^^^^^ 5946s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 5946s comm = await self.rpc.connect(saddr) 5946s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5946s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1485, in connect 5946s return await self._connect(addr=addr, timeout=timeout) 5946s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5946s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1429, in _connect 5946s comm = await connect( 5946s ^^^^^^^^^^^^^^ 5946s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5946s comm = await wait_for( 5946s ^^^^^^^^^^^^^^^ 5946s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 5946s return await fut 5946s ^^^^^^^^^ 5946s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5946s stream = await self.client.connect( 5946s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5946s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5946s af, addr, stream = await connector.start(connect_timeout=timeout) 5946s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5946s asyncio.exceptions.CancelledError 5946s 5946s The above exception was the direct cause of the following exception: 5946s 5946s Traceback (most recent call last): 5946s File "/usr/lib/python3/dist-packages/distributed/core.py", line 528, in start 5946s await wait_for(self.start_unsafe(), timeout=timeout) 5946s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1913, in wait_for 5946s async with asyncio.timeout(timeout): 5946s ^^^^^^^^^^^^^^^^^^^^^^^^ 5946s File "/usr/lib/python3.12/asyncio/timeouts.py", line 115, in __aexit__ 5946s raise TimeoutError from exc_val 5946s TimeoutError 5946s 5946s The above exception was the direct cause of the following exception: 5946s 5946s Traceback (most recent call last): 5946s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 974, in _cluster_factory 5946s s, ws = await start_cluster( 5946s ^^^^^^^^^^^^^^^^^^^^ 5946s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 791, in start_cluster 5946s await asyncio.gather(*workers) 5946s File "/usr/lib/python3.12/asyncio/tasks.py", line 684, in _wrap_awaitable 5946s return await awaitable 5946s ^^^^^^^^^^^^^^^ 5946s File "/usr/lib/python3/dist-packages/distributed/core.py", line 531, in start 5946s raise asyncio.TimeoutError( 5946s TimeoutError: Nanny start timed out after 0s. 5946s 2025-02-21 01:05:35,481 - distributed.scheduler - INFO - State start 5946s 2025-02-21 01:05:35,486 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:33439 5946s 2025-02-21 01:05:35,486 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:44505/status 5946s 2025-02-21 01:05:35,486 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5946s 2025-02-21 01:05:35,494 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:42697'. Reason: failure-to-start- 5946s 2025-02-21 01:05:35,494 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:42697' closed. 5946s 2025-02-21 01:05:35,495 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:35743'. Reason: failure-to-start- 5946s 2025-02-21 01:05:35,495 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:35743' closed. 5946s 2025-02-21 01:05:35,495 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33439': TLS handshake failed with remote 'tls://127.0.0.1:48248': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1011) 5946s 2025-02-21 01:05:35,495 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33439': TLS handshake failed with remote 'tls://127.0.0.1:48262': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1011) 5946s 2025-02-21 01:05:35,495 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 5946s Traceback (most recent call last): 5946s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 5946s return await fut 5946s ^^^^^^^^^ 5946s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 5946s comm = await self.rpc.connect(saddr) 5946s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5946s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1485, in connect 5946s return await self._connect(addr=addr, timeout=timeout) 5946s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5946s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1429, in _connect 5946s comm = await connect( 5946s ^^^^^^^^^^^^^^ 5946s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5946s comm = await wait_for( 5946s ^^^^^^^^^^^^^^^ 5946s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 5946s return await fut 5946s ^^^^^^^^^ 5946s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5946s stream = await self.client.connect( 5946s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5946s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5946s af, addr, stream = await connector.start(connect_timeout=timeout) 5946s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5946s asyncio.exceptions.CancelledError 5946s 5946s The above exception was the direct cause of the following exception: 5946s 5946s Traceback (most recent call last): 5946s File "/usr/lib/python3/dist-packages/distributed/core.py", line 528, in start 5946s await wait_for(self.start_unsafe(), timeout=timeout) 5946s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1913, in wait_for 5946s async with asyncio.timeout(timeout): 5946s ^^^^^^^^^^^^^^^^^^^^^^^^ 5946s File "/usr/lib/python3.12/asyncio/timeouts.py", line 115, in __aexit__ 5946s raise TimeoutError from exc_val 5946s TimeoutError 5946s 5946s The above exception was the direct cause of the following exception: 5946s 5946s Traceback (most recent call last): 5946s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 974, in _cluster_factory 5946s s, ws = await start_cluster( 5946s ^^^^^^^^^^^^^^^^^^^^ 5946s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 791, in start_cluster 5946s await asyncio.gather(*workers) 5946s File "/usr/lib/python3.12/asyncio/tasks.py", line 684, in _wrap_awaitable 5946s return await awaitable 5946s ^^^^^^^^^^^^^^^ 5946s File "/usr/lib/python3/dist-packages/distributed/core.py", line 531, in start 5946s raise asyncio.TimeoutError( 5946s TimeoutError: Nanny start timed out after 0s. 5946s 2025-02-21 01:05:36,500 - distributed.scheduler - INFO - State start 5946s 2025-02-21 01:05:36,505 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37345 5946s 2025-02-21 01:05:36,505 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:36853/status 5946s 2025-02-21 01:05:36,505 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5946s 2025-02-21 01:05:36,516 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:34341'. Reason: failure-to-start- 5946s 2025-02-21 01:05:36,516 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:34341' closed. 5946s 2025-02-21 01:05:36,516 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:46727'. Reason: failure-to-start- 5946s 2025-02-21 01:05:36,516 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:46727' closed. 5946s 2025-02-21 01:05:36,517 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37345': TLS handshake failed with remote 'tls://127.0.0.1:38002': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1011) 5946s 2025-02-21 01:05:36,517 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37345': TLS handshake failed with remote 'tls://127.0.0.1:38010': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1011) 5946s 2025-02-21 01:05:36,517 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 5946s Traceback (most recent call last): 5946s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 5946s return await fut 5946s ^^^^^^^^^ 5946s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 5946s comm = await self.rpc.connect(saddr) 5946s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5946s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1485, in connect 5946s return await self._connect(addr=addr, timeout=timeout) 5946s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5946s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1429, in _connect 5946s comm = await connect( 5946s ^^^^^^^^^^^^^^ 5946s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5946s comm = await wait_for( 5946s ^^^^^^^^^^^^^^^ 5946s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 5946s return await fut 5946s ^^^^^^^^^ 5946s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5946s stream = await self.client.connect( 5946s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5946s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5946s af, addr, stream = await connector.start(connect_timeout=timeout) 5946s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5946s asyncio.exceptions.CancelledError 5946s 5946s The above exception was the direct cause of the following exception: 5946s 5946s Traceback (most recent call last): 5946s File "/usr/lib/python3/dist-packages/distributed/core.py", line 528, in start 5946s await wait_for(self.start_unsafe(), timeout=timeout) 5946s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1913, in wait_for 5946s async with asyncio.timeout(timeout): 5946s ^^^^^^^^^^^^^^^^^^^^^^^^ 5946s File "/usr/lib/python3.12/asyncio/timeouts.py", line 115, in __aexit__ 5946s raise TimeoutError from exc_val 5946s TimeoutError 5946s 5946s The above exception was the direct cause of the following exception: 5946s 5946s Traceback (most recent call last): 5946s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 974, in _cluster_factory 5946s s, ws = await start_cluster( 5946s ^^^^^^^^^^^^^^^^^^^^ 5946s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 791, in start_cluster 5946s await asyncio.gather(*workers) 5946s File "/usr/lib/python3.12/asyncio/tasks.py", line 684, in _wrap_awaitable 5946s return await awaitable 5946s ^^^^^^^^^^^^^^^ 5946s File "/usr/lib/python3/dist-packages/distributed/core.py", line 531, in start 5946s raise asyncio.TimeoutError( 5946s TimeoutError: Nanny start timed out after 0s. 5946s 2025-02-21 01:05:37,523 - distributed.scheduler - INFO - State start 5946s 2025-02-21 01:05:37,528 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:42921 5946s 2025-02-21 01:05:37,529 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:40823/status 5946s 2025-02-21 01:05:37,529 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5946s 2025-02-21 01:05:37,540 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:41329'. Reason: failure-to-start- 5946s 2025-02-21 01:05:37,541 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:41329' closed. 5946s 2025-02-21 01:05:37,541 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:35429'. Reason: failure-to-start- 5946s 2025-02-21 01:05:37,541 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:35429' closed. 5946s 2025-02-21 01:05:37,541 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42921': TLS handshake failed with remote 'tls://127.0.0.1:39484': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1011) 5946s 2025-02-21 01:05:37,541 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42921': TLS handshake failed with remote 'tls://127.0.0.1:39494': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1011) 5946s 2025-02-21 01:05:37,541 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 5946s Traceback (most recent call last): 5946s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 5946s return await fut 5946s ^^^^^^^^^ 5946s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 5946s comm = await self.rpc.connect(saddr) 5946s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5946s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1485, in connect 5946s return await self._connect(addr=addr, timeout=timeout) 5946s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5946s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1429, in _connect 5946s comm = await connect( 5946s ^^^^^^^^^^^^^^ 5946s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5946s comm = await wait_for( 5946s ^^^^^^^^^^^^^^^ 5946s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 5946s return await fut 5946s ^^^^^^^^^ 5946s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5946s stream = await self.client.connect( 5946s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5946s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5946s af, addr, stream = await connector.start(connect_timeout=timeout) 5946s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5946s asyncio.exceptions.CancelledError 5946s 5946s The above exception was the direct cause of the following exception: 5946s 5946s Traceback (most recent call last): 5946s File "/usr/lib/python3/dist-packages/distributed/core.py", line 528, in start 5946s await wait_for(self.start_unsafe(), timeout=timeout) 5946s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1913, in wait_for 5946s async with asyncio.timeout(timeout): 5946s ^^^^^^^^^^^^^^^^^^^^^^^^ 5946s File "/usr/lib/python3.12/asyncio/timeouts.py", line 115, in __aexit__ 5946s raise TimeoutError from exc_val 5946s TimeoutError 5946s 5946s The above exception was the direct cause of the following exception: 5946s 5946s Traceback (most recent call last): 5946s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 974, in _cluster_factory 5946s s, ws = await start_cluster( 5946s ^^^^^^^^^^^^^^^^^^^^ 5946s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 791, in start_cluster 5946s await asyncio.gather(*workers) 5946s File "/usr/lib/python3.12/asyncio/tasks.py", line 684, in _wrap_awaitable 5946s return await awaitable 5946s ^^^^^^^^^^^^^^^ 5946s File "/usr/lib/python3/dist-packages/distributed/core.py", line 531, in start 5946s raise asyncio.TimeoutError( 5946s TimeoutError: Nanny start timed out after 0s. 5946s 2025-02-21 01:05:38,545 - distributed.scheduler - INFO - State start 5946s 2025-02-21 01:05:38,550 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:40545 5946s 2025-02-21 01:05:38,550 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:43717/status 5946s 2025-02-21 01:05:38,550 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5946s 2025-02-21 01:05:38,561 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:37101'. Reason: failure-to-start- 5946s 2025-02-21 01:05:38,561 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:37101' closed. 5946s 2025-02-21 01:05:38,561 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:43099'. Reason: failure-to-start- 5946s 2025-02-21 01:05:38,561 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:43099' closed. 5946s 2025-02-21 01:05:38,562 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40545': TLS handshake failed with remote 'tls://127.0.0.1:57952': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1011) 5946s 2025-02-21 01:05:38,562 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40545': TLS handshake failed with remote 'tls://127.0.0.1:57964': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1011) 5946s 2025-02-21 01:05:38,562 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 5946s Traceback (most recent call last): 5946s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 5946s return await fut 5946s ^^^^^^^^^ 5946s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 5946s comm = await self.rpc.connect(saddr) 5946s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5946s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1485, in connect 5946s return await self._connect(addr=addr, timeout=timeout) 5946s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5946s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1429, in _connect 5946s comm = await connect( 5946s ^^^^^^^^^^^^^^ 5946s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5946s comm = await wait_for( 5946s ^^^^^^^^^^^^^^^ 5946s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 5946s return await fut 5946s ^^^^^^^^^ 5946s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5946s stream = await self.client.connect( 5946s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5946s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5946s af, addr, stream = await connector.start(connect_timeout=timeout) 5946s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5946s asyncio.exceptions.CancelledError 5946s 5946s The above exception was the direct cause of the following exception: 5946s 5946s Traceback (most recent call last): 5946s File "/usr/lib/python3/dist-packages/distributed/core.py", line 528, in start 5946s await wait_for(self.start_unsafe(), timeout=timeout) 5946s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1913, in wait_for 5946s async with asyncio.timeout(timeout): 5946s ^^^^^^^^^^^^^^^^^^^^^^^^ 5946s File "/usr/lib/python3.12/asyncio/timeouts.py", line 115, in __aexit__ 5946s raise TimeoutError from exc_val 5946s TimeoutError 5946s 5946s The above exception was the direct cause of the following exception: 5946s 5946s Traceback (most recent call last): 5946s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 974, in _cluster_factory 5946s s, ws = await start_cluster( 5946s ^^^^^^^^^^^^^^^^^^^^ 5946s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 791, in start_cluster 5946s await asyncio.gather(*workers) 5946s File "/usr/lib/python3.12/asyncio/tasks.py", line 684, in _wrap_awaitable 5946s return await awaitable 5946s ^^^^^^^^^^^^^^^ 5946s File "/usr/lib/python3/dist-packages/distributed/core.py", line 531, in start 5946s raise asyncio.TimeoutError( 5946s TimeoutError: Nanny start timed out after 0s. 5946s 2025-02-21 01:05:39,567 - distributed.scheduler - INFO - State start 5946s 2025-02-21 01:05:39,571 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:46349 5946s 2025-02-21 01:05:39,572 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:32811/status 5946s 2025-02-21 01:05:39,572 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5946s 2025-02-21 01:05:39,584 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:44493'. Reason: failure-to-start- 5946s 2025-02-21 01:05:39,584 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:44493' closed. 5946s 2025-02-21 01:05:39,584 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:36953'. Reason: failure-to-start- 5946s 2025-02-21 01:05:39,584 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:36953' closed. 5946s 2025-02-21 01:05:39,585 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46349': TLS handshake failed with remote 'tls://127.0.0.1:34294': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1011) 5946s 2025-02-21 01:05:39,585 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46349': TLS handshake failed with remote 'tls://127.0.0.1:34306': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1011) 5946s 2025-02-21 01:05:39,585 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 5946s Traceback (most recent call last): 5946s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 5946s return await fut 5946s ^^^^^^^^^ 5946s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 5946s comm = await self.rpc.connect(saddr) 5946s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5946s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1485, in connect 5946s return await self._connect(addr=addr, timeout=timeout) 5946s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5946s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1429, in _connect 5946s comm = await connect( 5946s ^^^^^^^^^^^^^^ 5946s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5946s comm = await wait_for( 5946s ^^^^^^^^^^^^^^^ 5946s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 5946s return await fut 5946s ^^^^^^^^^ 5946s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5946s stream = await self.client.connect( 5946s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5946s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5946s af, addr, stream = await connector.start(connect_timeout=timeout) 5946s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5946s asyncio.exceptions.CancelledError 5946s 5946s The above exception was the direct cause of the following exception: 5946s 5946s Traceback (most recent call last): 5946s File "/usr/lib/python3/dist-packages/distributed/core.py", line 528, in start 5946s await wait_for(self.start_unsafe(), timeout=timeout) 5946s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1913, in wait_for 5946s async with asyncio.timeout(timeout): 5946s ^^^^^^^^^^^^^^^^^^^^^^^^ 5946s File "/usr/lib/python3.12/asyncio/timeouts.py", line 115, in __aexit__ 5946s raise TimeoutError from exc_val 5946s TimeoutError 5946s 5946s The above exception was the direct cause of the following exception: 5946s 5946s Traceback (most recent call last): 5946s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 974, in _cluster_factory 5946s s, ws = await start_cluster( 5946s ^^^^^^^^^^^^^^^^^^^^ 5946s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 791, in start_cluster 5946s await asyncio.gather(*workers) 5946s File "/usr/lib/python3.12/asyncio/tasks.py", line 684, in _wrap_awaitable 5946s return await awaitable 5946s ^^^^^^^^^^^^^^^ 5946s File "/usr/lib/python3/dist-packages/distributed/core.py", line 531, in start 5946s raise asyncio.TimeoutError( 5946s TimeoutError: Nanny start timed out after 0s. 5946s 2025-02-21 01:05:40,590 - distributed.scheduler - INFO - State start 5946s 2025-02-21 01:05:40,597 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37465 5946s 2025-02-21 01:05:40,597 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:40231/status 5946s 2025-02-21 01:05:40,597 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5946s 2025-02-21 01:05:40,609 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:37887'. Reason: failure-to-start- 5946s 2025-02-21 01:05:40,609 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:37887' closed. 5946s 2025-02-21 01:05:40,609 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:42843'. Reason: failure-to-start- 5946s 2025-02-21 01:05:40,610 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:42843' closed. 5946s 2025-02-21 01:05:40,610 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37465': TLS handshake failed with remote 'tls://127.0.0.1:45826': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1011) 5946s 2025-02-21 01:05:40,610 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37465': TLS handshake failed with remote 'tls://127.0.0.1:45834': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1011) 5946s 2025-02-21 01:05:40,610 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 5946s Traceback (most recent call last): 5946s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 5946s return await fut 5946s ^^^^^^^^^ 5946s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 5946s comm = await self.rpc.connect(saddr) 5946s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5946s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1485, in connect 5946s return await self._connect(addr=addr, timeout=timeout) 5946s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5946s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1429, in _connect 5946s comm = await connect( 5946s ^^^^^^^^^^^^^^ 5946s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5946s comm = await wait_for( 5946s ^^^^^^^^^^^^^^^ 5946s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 5946s return await fut 5946s ^^^^^^^^^ 5946s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5946s stream = await self.client.connect( 5946s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5946s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5946s af, addr, stream = await connector.start(connect_timeout=timeout) 5946s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5946s asyncio.exceptions.CancelledError 5946s 5946s The above exception was the direct cause of the following exception: 5946s 5946s Traceback (most recent call last): 5946s File "/usr/lib/python3/dist-packages/distributed/core.py", line 528, in start 5946s await wait_for(self.start_unsafe(), timeout=timeout) 5946s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1913, in wait_for 5946s async with asyncio.timeout(timeout): 5946s ^^^^^^^^^^^^^^^^^^^^^^^^ 5946s File "/usr/lib/python3.12/asyncio/timeouts.py", line 115, in __aexit__ 5946s raise TimeoutError from exc_val 5946s TimeoutError 5946s 5946s The above exception was the direct cause of the following exception: 5946s 5946s Traceback (most recent call last): 5946s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 974, in _cluster_factory 5946s s, ws = await start_cluster( 5946s ^^^^^^^^^^^^^^^^^^^^ 5946s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 791, in start_cluster 5946s await asyncio.gather(*workers) 5946s File "/usr/lib/python3.12/asyncio/tasks.py", line 684, in _wrap_awaitable 5946s return await awaitable 5946s ^^^^^^^^^^^^^^^ 5946s File "/usr/lib/python3/dist-packages/distributed/core.py", line 531, in start 5946s raise asyncio.TimeoutError( 5946s TimeoutError: Nanny start timed out after 0s. 5946s 2025-02-21 01:05:41,616 - distributed.scheduler - INFO - State start 5946s 2025-02-21 01:05:41,623 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:38227 5946s 2025-02-21 01:05:41,624 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:43431/status 5946s 2025-02-21 01:05:41,624 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5946s 2025-02-21 01:05:41,638 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:36575'. Reason: failure-to-start- 5946s 2025-02-21 01:05:41,638 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:36575' closed. 5946s 2025-02-21 01:05:41,639 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:43049'. Reason: failure-to-start- 5946s 2025-02-21 01:05:41,639 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:43049' closed. 5946s 2025-02-21 01:05:41,639 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38227': TLS handshake failed with remote 'tls://127.0.0.1:58896': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1011) 5946s 2025-02-21 01:05:41,639 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38227': TLS handshake failed with remote 'tls://127.0.0.1:58906': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1011) 5946s 2025-02-21 01:05:41,639 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 5946s Traceback (most recent call last): 5946s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 5946s return await fut 5946s ^^^^^^^^^ 5946s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 5946s comm = await self.rpc.connect(saddr) 5946s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5946s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1485, in connect 5946s return await self._connect(addr=addr, timeout=timeout) 5946s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5946s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1429, in _connect 5946s comm = await connect( 5946s ^^^^^^^^^^^^^^ 5946s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5946s comm = await wait_for( 5946s ^^^^^^^^^^^^^^^ 5946s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 5946s return await fut 5946s ^^^^^^^^^ 5946s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5946s stream = await self.client.connect( 5946s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5946s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5946s af, addr, stream = await connector.start(connect_timeout=timeout) 5946s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5946s asyncio.exceptions.CancelledError 5946s 5946s The above exception was the direct cause of the following exception: 5946s 5946s Traceback (most recent call last): 5946s File "/usr/lib/python3/dist-packages/distributed/core.py", line 528, in start 5946s await wait_for(self.start_unsafe(), timeout=timeout) 5946s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1913, in wait_for 5946s async with asyncio.timeout(timeout): 5946s ^^^^^^^^^^^^^^^^^^^^^^^^ 5946s File "/usr/lib/python3.12/asyncio/timeouts.py", line 115, in __aexit__ 5946s raise TimeoutError from exc_val 5946s TimeoutError 5946s 5946s The above exception was the direct cause of the following exception: 5946s 5946s Traceback (most recent call last): 5946s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 974, in _cluster_factory 5946s s, ws = await start_cluster( 5946s ^^^^^^^^^^^^^^^^^^^^ 5946s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 791, in start_cluster 5946s await asyncio.gather(*workers) 5946s File "/usr/lib/python3.12/asyncio/tasks.py", line 684, in _wrap_awaitable 5946s return await awaitable 5946s ^^^^^^^^^^^^^^^ 5946s File "/usr/lib/python3/dist-packages/distributed/core.py", line 531, in start 5946s raise asyncio.TimeoutError( 5946s TimeoutError: Nanny start timed out after 0s. 5946s 2025-02-21 01:05:42,644 - distributed.scheduler - INFO - State start 5946s 2025-02-21 01:05:42,649 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:46801 5946s 2025-02-21 01:05:42,649 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:35157/status 5946s 2025-02-21 01:05:42,649 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5946s 2025-02-21 01:05:42,658 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:43135'. Reason: failure-to-start- 5946s 2025-02-21 01:05:42,658 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:43135' closed. 5946s 2025-02-21 01:05:42,658 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:33659'. Reason: failure-to-start- 5946s 2025-02-21 01:05:42,658 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:33659' closed. 5946s 2025-02-21 01:05:42,659 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46801': TLS handshake failed with remote 'tls://127.0.0.1:38276': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1011) 5946s 2025-02-21 01:05:42,660 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46801': TLS handshake failed with remote 'tls://127.0.0.1:38286': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1011) 5946s 2025-02-21 01:05:42,660 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 5946s Traceback (most recent call last): 5946s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 5946s return await fut 5946s ^^^^^^^^^ 5946s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 5946s comm = await self.rpc.connect(saddr) 5946s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5946s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1485, in connect 5946s return await self._connect(addr=addr, timeout=timeout) 5946s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5946s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1429, in _connect 5946s comm = await connect( 5946s ^^^^^^^^^^^^^^ 5946s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5946s comm = await wait_for( 5946s ^^^^^^^^^^^^^^^ 5946s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 5946s return await fut 5946s ^^^^^^^^^ 5946s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5946s stream = await self.client.connect( 5946s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5946s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5946s af, addr, stream = await connector.start(connect_timeout=timeout) 5946s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5946s asyncio.exceptions.CancelledError 5946s 5946s The above exception was the direct cause of the following exception: 5946s 5946s Traceback (most recent call last): 5946s File "/usr/lib/python3/dist-packages/distributed/core.py", line 528, in start 5946s await wait_for(self.start_unsafe(), timeout=timeout) 5946s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1913, in wait_for 5946s async with asyncio.timeout(timeout): 5946s ^^^^^^^^^^^^^^^^^^^^^^^^ 5946s File "/usr/lib/python3.12/asyncio/timeouts.py", line 115, in __aexit__ 5946s raise TimeoutError from exc_val 5946s TimeoutError 5946s 5946s The above exception was the direct cause of the following exception: 5946s 5946s Traceback (most recent call last): 5946s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 974, in _cluster_factory 5946s s, ws = await start_cluster( 5946s ^^^^^^^^^^^^^^^^^^^^ 5946s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 791, in start_cluster 5946s await asyncio.gather(*workers) 5946s File "/usr/lib/python3.12/asyncio/tasks.py", line 684, in _wrap_awaitable 5946s return await awaitable 5946s ^^^^^^^^^^^^^^^ 5946s File "/usr/lib/python3/dist-packages/distributed/core.py", line 531, in start 5946s raise asyncio.TimeoutError( 5946s TimeoutError: Nanny start timed out after 0s. 5946s 2025-02-21 01:05:43,666 - distributed.scheduler - INFO - State start 5946s 2025-02-21 01:05:43,674 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:38207 5946s 2025-02-21 01:05:43,674 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:45193/status 5946s 2025-02-21 01:05:43,674 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5946s 2025-02-21 01:05:43,694 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:46847'. Reason: failure-to-start- 5946s 2025-02-21 01:05:43,695 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:46847' closed. 5946s 2025-02-21 01:05:43,695 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:33957'. Reason: failure-to-start- 5946s 2025-02-21 01:05:43,696 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:33957' closed. 5946s 2025-02-21 01:05:43,696 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38207': TLS handshake failed with remote 'tls://127.0.0.1:49268': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1011) 5946s 2025-02-21 01:05:43,696 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38207': TLS handshake failed with remote 'tls://127.0.0.1:49282': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1011) 5946s 2025-02-21 01:05:43,696 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 5946s Traceback (most recent call last): 5946s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 5946s return await fut 5946s ^^^^^^^^^ 5946s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 5946s comm = await self.rpc.connect(saddr) 5946s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5946s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1485, in connect 5946s return await self._connect(addr=addr, timeout=timeout) 5946s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5946s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1429, in _connect 5946s comm = await connect( 5946s ^^^^^^^^^^^^^^ 5946s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5946s comm = await wait_for( 5946s ^^^^^^^^^^^^^^^ 5946s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 5946s return await fut 5946s ^^^^^^^^^ 5946s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5946s stream = await self.client.connect( 5946s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5946s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5946s af, addr, stream = await connector.start(connect_timeout=timeout) 5946s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5946s asyncio.exceptions.CancelledError 5946s 5946s The above exception was the direct cause of the following exception: 5946s 5946s Traceback (most recent call last): 5946s File "/usr/lib/python3/dist-packages/distributed/core.py", line 528, in start 5946s await wait_for(self.start_unsafe(), timeout=timeout) 5946s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1913, in wait_for 5946s async with asyncio.timeout(timeout): 5946s ^^^^^^^^^^^^^^^^^^^^^^^^ 5946s File "/usr/lib/python3.12/asyncio/timeouts.py", line 115, in __aexit__ 5946s raise TimeoutError from exc_val 5946s TimeoutError 5946s 5946s The above exception was the direct cause of the following exception: 5946s 5946s Traceback (most recent call last): 5946s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 974, in _cluster_factory 5946s s, ws = await start_cluster( 5946s ^^^^^^^^^^^^^^^^^^^^ 5946s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 791, in start_cluster 5946s await asyncio.gather(*workers) 5946s File "/usr/lib/python3.12/asyncio/tasks.py", line 684, in _wrap_awaitable 5946s return await awaitable 5946s ^^^^^^^^^^^^^^^ 5946s File "/usr/lib/python3/dist-packages/distributed/core.py", line 531, in start 5946s raise asyncio.TimeoutError( 5946s TimeoutError: Nanny start timed out after 0s. 5946s 2025-02-21 01:05:44,701 - distributed.scheduler - INFO - State start 5946s 2025-02-21 01:05:44,705 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37775 5946s 2025-02-21 01:05:44,705 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:46045/status 5946s 2025-02-21 01:05:44,706 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5946s 2025-02-21 01:05:44,716 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:33489'. Reason: failure-to-start- 5946s 2025-02-21 01:05:44,716 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:33489' closed. 5946s 2025-02-21 01:05:44,716 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:37307'. Reason: failure-to-start- 5946s 2025-02-21 01:05:44,716 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:37307' closed. 5946s 2025-02-21 01:05:44,717 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37775': TLS handshake failed with remote 'tls://127.0.0.1:44510': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1011) 5946s 2025-02-21 01:05:44,717 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37775': TLS handshake failed with remote 'tls://127.0.0.1:44524': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1011) 5946s 2025-02-21 01:05:44,717 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 5946s Traceback (most recent call last): 5946s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 5946s return await fut 5946s ^^^^^^^^^ 5946s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 5946s comm = await self.rpc.connect(saddr) 5946s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5946s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1485, in connect 5946s return await self._connect(addr=addr, timeout=timeout) 5946s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5946s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1429, in _connect 5946s comm = await connect( 5946s ^^^^^^^^^^^^^^ 5946s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5946s comm = await wait_for( 5946s ^^^^^^^^^^^^^^^ 5946s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 5946s return await fut 5946s ^^^^^^^^^ 5946s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5946s stream = await self.client.connect( 5946s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5946s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5946s af, addr, stream = await connector.start(connect_timeout=timeout) 5946s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5946s asyncio.exceptions.CancelledError 5946s 5946s The above exception was the direct cause of the following exception: 5946s 5946s Traceback (most recent call last): 5946s File "/usr/lib/python3/dist-packages/distributed/core.py", line 528, in start 5946s await wait_for(self.start_unsafe(), timeout=timeout) 5946s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1913, in wait_for 5946s async with asyncio.timeout(timeout): 5946s ^^^^^^^^^^^^^^^^^^^^^^^^ 5946s File "/usr/lib/python3.12/asyncio/timeouts.py", line 115, in __aexit__ 5946s raise TimeoutError from exc_val 5946s TimeoutError 5946s 5946s The above exception was the direct cause of the following exception: 5946s 5946s Traceback (most recent call last): 5946s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 974, in _cluster_factory 5946s s, ws = await start_cluster( 5946s ^^^^^^^^^^^^^^^^^^^^ 5946s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 791, in start_cluster 5946s await asyncio.gather(*workers) 5946s File "/usr/lib/python3.12/asyncio/tasks.py", line 684, in _wrap_awaitable 5946s return await awaitable 5946s ^^^^^^^^^^^^^^^ 5946s File "/usr/lib/python3/dist-packages/distributed/core.py", line 531, in start 5946s raise asyncio.TimeoutError( 5946s TimeoutError: Nanny start timed out after 0s. 5946s 2025-02-21 01:05:45,723 - distributed.scheduler - INFO - State start 5946s 2025-02-21 01:05:45,727 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:41345 5946s 2025-02-21 01:05:45,727 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:36845/status 5946s 2025-02-21 01:05:45,727 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5946s 2025-02-21 01:05:45,741 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:35345'. Reason: failure-to-start- 5946s 2025-02-21 01:05:45,741 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:35345' closed. 5946s 2025-02-21 01:05:45,741 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:43071'. Reason: failure-to-start- 5946s 2025-02-21 01:05:45,742 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:43071' closed. 5946s 2025-02-21 01:05:45,742 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41345': TLS handshake failed with remote 'tls://127.0.0.1:40964': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1011) 5946s 2025-02-21 01:05:45,742 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41345': TLS handshake failed with remote 'tls://127.0.0.1:40968': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1011) 5946s 2025-02-21 01:05:45,742 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 5946s Traceback (most recent call last): 5946s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 5946s return await fut 5946s ^^^^^^^^^ 5946s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 5946s comm = await self.rpc.connect(saddr) 5946s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5946s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1485, in connect 5946s return await self._connect(addr=addr, timeout=timeout) 5946s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5946s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1429, in _connect 5946s comm = await connect( 5946s ^^^^^^^^^^^^^^ 5946s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5946s comm = await wait_for( 5946s ^^^^^^^^^^^^^^^ 5946s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 5946s return await fut 5946s ^^^^^^^^^ 5946s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5946s stream = await self.client.connect( 5946s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5946s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5946s af, addr, stream = await connector.start(connect_timeout=timeout) 5946s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5946s asyncio.exceptions.CancelledError 5946s 5946s The above exception was the direct cause of the following exception: 5946s 5946s Traceback (most recent call last): 5946s File "/usr/lib/python3/dist-packages/distributed/core.py", line 528, in start 5946s await wait_for(self.start_unsafe(), timeout=timeout) 5946s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1913, in wait_for 5946s async with asyncio.timeout(timeout): 5946s ^^^^^^^^^^^^^^^^^^^^^^^^ 5946s File "/usr/lib/python3.12/asyncio/timeouts.py", line 115, in __aexit__ 5946s raise TimeoutError from exc_val 5946s TimeoutError 5946s 5946s The above exception was the direct cause of the following exception: 5946s 5946s Traceback (most recent call last): 5946s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 974, in _cluster_factory 5946s s, ws = await start_cluster( 5946s ^^^^^^^^^^^^^^^^^^^^ 5946s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 791, in start_cluster 5946s await asyncio.gather(*workers) 5946s File "/usr/lib/python3.12/asyncio/tasks.py", line 684, in _wrap_awaitable 5946s return await awaitable 5946s ^^^^^^^^^^^^^^^ 5946s File "/usr/lib/python3/dist-packages/distributed/core.py", line 531, in start 5946s raise asyncio.TimeoutError( 5946s TimeoutError: Nanny start timed out after 0s. 5946s 2025-02-21 01:05:46,747 - distributed.scheduler - INFO - State start 5946s 2025-02-21 01:05:46,751 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:35147 5946s 2025-02-21 01:05:46,751 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:38887/status 5946s 2025-02-21 01:05:46,751 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5946s 2025-02-21 01:05:46,761 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:34613'. Reason: failure-to-start- 5946s 2025-02-21 01:05:46,761 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:34613' closed. 5946s 2025-02-21 01:05:46,761 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:43883'. Reason: failure-to-start- 5946s 2025-02-21 01:05:46,761 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:43883' closed. 5946s 2025-02-21 01:05:46,761 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35147': TLS handshake failed with remote 'tls://127.0.0.1:36546': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1011) 5946s 2025-02-21 01:05:46,762 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35147': TLS handshake failed with remote 'tls://127.0.0.1:36552': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1011) 5946s 2025-02-21 01:05:46,762 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 5946s Traceback (most recent call last): 5946s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 5946s return await fut 5946s ^^^^^^^^^ 5946s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 5946s comm = await self.rpc.connect(saddr) 5946s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5946s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1485, in connect 5946s return await self._connect(addr=addr, timeout=timeout) 5946s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5946s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1429, in _connect 5946s comm = await connect( 5946s ^^^^^^^^^^^^^^ 5946s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5946s comm = await wait_for( 5946s ^^^^^^^^^^^^^^^ 5946s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 5946s return await fut 5946s ^^^^^^^^^ 5946s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5946s stream = await self.client.connect( 5946s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5946s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5946s af, addr, stream = await connector.start(connect_timeout=timeout) 5946s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5946s asyncio.exceptions.CancelledError 5946s 5946s The above exception was the direct cause of the following exception: 5946s 5946s Traceback (most recent call last): 5946s File "/usr/lib/python3/dist-packages/distributed/core.py", line 528, in start 5946s await wait_for(self.start_unsafe(), timeout=timeout) 5946s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1913, in wait_for 5946s async with asyncio.timeout(timeout): 5946s ^^^^^^^^^^^^^^^^^^^^^^^^ 5946s File "/usr/lib/python3.12/asyncio/timeouts.py", line 115, in __aexit__ 5946s raise TimeoutError from exc_val 5946s TimeoutError 5946s 5946s The above exception was the direct cause of the following exception: 5946s 5946s Traceback (most recent call last): 5946s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 974, in _cluster_factory 5946s s, ws = await start_cluster( 5946s ^^^^^^^^^^^^^^^^^^^^ 5946s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 791, in start_cluster 5946s await asyncio.gather(*workers) 5946s File "/usr/lib/python3.12/asyncio/tasks.py", line 684, in _wrap_awaitable 5946s return await awaitable 5946s ^^^^^^^^^^^^^^^ 5946s File "/usr/lib/python3/dist-packages/distributed/core.py", line 531, in start 5946s raise asyncio.TimeoutError( 5946s TimeoutError: Nanny start timed out after 0s. 5946s 2025-02-21 01:05:47,766 - distributed.scheduler - INFO - State start 5946s 2025-02-21 01:05:47,771 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:42199 5946s 2025-02-21 01:05:47,771 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:38433/status 5946s 2025-02-21 01:05:47,772 - distributed.scheduler - INFO - Registering Worker plugin shuffle 5946s 2025-02-21 01:05:47,787 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:35371'. Reason: failure-to-start- 5946s 2025-02-21 01:05:47,788 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:35371' closed. 5946s 2025-02-21 01:05:47,788 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:42411'. Reason: failure-to-start- 5946s 2025-02-21 01:05:47,788 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:42411' closed. 5946s 2025-02-21 01:05:47,790 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42199': TLS handshake failed with remote 'tls://127.0.0.1:44608': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1011) 5946s 2025-02-21 01:05:47,790 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42199': TLS handshake failed with remote 'tls://127.0.0.1:44616': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1011) 5946s 2025-02-21 01:05:47,790 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 5946s Traceback (most recent call last): 5946s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 5946s return await fut 5946s ^^^^^^^^^ 5946s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 5946s comm = await self.rpc.connect(saddr) 5946s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5946s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1485, in connect 5946s return await self._connect(addr=addr, timeout=timeout) 5946s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5946s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1429, in _connect 5946s comm = await connect( 5946s ^^^^^^^^^^^^^^ 5946s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 5946s comm = await wait_for( 5946s ^^^^^^^^^^^^^^^ 5946s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 5946s return await fut 5946s ^^^^^^^^^ 5946s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 5946s stream = await self.client.connect( 5946s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 5946s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 5946s af, addr, stream = await connector.start(connect_timeout=timeout) 5946s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 5946s asyncio.exceptions.CancelledError 5946s 5946s The above exception was the direct cause of the following exception: 5946s 5946s Traceback (most recent call last): 5946s File "/usr/lib/python3/dist-packages/distributed/core.py", line 528, in start 5946s await wait_for(self.start_unsafe(), timeout=timeout) 5946s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1913, in wait_for 5946s async with asyncio.timeout(timeout): 5946s ^^^^^^^^^^^^^^^^^^^^^^^^ 5946s File "/usr/lib/python3.12/asyncio/timeouts.py", line 115, in __aexit__ 5946s raise TimeoutError from exc_val 5946s TimeoutError 5946s 5946s The above exception was the direct cause of the following exception: 5946s 5946s Traceback (most recent call last): 5946s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 974, in _cluster_factory 5946s s, ws = await start_cluster( 5946s ^^^^^^^^^^^^^^^^^^^^ 5946s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 791, in start_cluster 5946s await asyncio.gather(*workers) 5946s File "/usr/lib/python3.12/asyncio/tasks.py", line 684, in _wrap_awaitable 5946s return await awaitable 5946s ^^^^^^^^^^^^^^^ 5946s File "/usr/lib/python3/dist-packages/distributed/core.py", line 531, in start 5946s raise asyncio.TimeoutError( 5946s TimeoutError: Nanny start timed out after 0s. 5946s ============================= slowest 20 durations ============================= 5946s 60.00s call tests/test_tls_functional.py::test_retire_workers 5946s 2.07s call tests/test_tls_functional.py::test_nanny 5946s 0.00s setup tests/test_tls_functional.py::test_nanny 5946s 0.00s teardown tests/test_tls_functional.py::test_nanny 5946s 0.00s teardown tests/test_tls_functional.py::test_retire_workers 5946s 0.00s setup tests/test_tls_functional.py::test_retire_workers 5946s =========================== short test summary info ============================ 5946s FAILED tests/test_tls_functional.py::test_retire_workers - TimeoutError 5946s ===== 1 failed, 1 passed, 30 skipped, 3390 deselected in 76.34s (0:01:16) ====== 5946s *** END OF RUN 2: NOT ALL TESTS HAVE YET PASSED/XFAILED *** 5946s *** STARTING RUN 3: python3.12 -m pytest --pyargs distributed --verbose --color=no --timeout-method=signal --timeout=300 -m not avoid_ci -rfE --last-failed --last-failed-no-failures none --ignore=../../../../../usr/lib/python3/dist-packages/distributed/comm/tests/test_comms.py --ignore=../../../../../usr/lib/python3/dist-packages/distributed/comm/tests/test_ws.py --ignore=../../../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_adaptive.py --ignore=../../../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_local.py --ignore=../../../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_slow_adaptive.py --ignore=../../../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_spec_cluster.py --deselect=cli/tests/test_dask_scheduler.py::test_no_dashboard --deselect=deploy/tests/test_local.py::test_localcluster_get_client --deselect=deploy/tests/test_old_ssh.py::test_cluster --deselect=deploy/tests/test_old_ssh.py::test_old_ssh_nprocs_renamed_to_n_workers --deselect=deploy/tests/test_old_ssh.py::test_nprocs_attribute_is_deprecated --deselect=deploy/tests/test_ssh.py::test_nprocs_attribute_is_deprecated --deselect=http/tests/test_core.py::test_prometheus_api_doc --deselect=tests/test_init.py::test_git_revision --deselect=tests/test_jupyter.py::test_jupyter_idle_timeout --deselect=tests/test_jupyter.py::test_jupyter_idle_timeout_returned --deselect=tests/test_jupyter.py::test_jupyter_server --deselect=tests/test_jupyter.py::test_shutsdown_cleanly --deselect=tests/test_profile.py::test_stack_overflow --deselect=tests/test_pubsub.py::test_client_worker --deselect=tests/test_queues.py::test_queue_in_task --deselect=tests/test_spill.py::test_spillbuffer_oserror --deselect=tests/test_steal.py::test_steal_twice --deselect=tests/test_utils_test.py::test_cluster --deselect=tests/test_variable.py::test_variable_in_task --deselect=tests/test_worker.py::test_process_executor_kills_process --deselect=tests/test_worker_memory.py::test_fail_to_pickle_execute_1 --deselect=tests/test_worker_state_machine.py::test_task_state_instance_are_garbage_collected --deselect=protocol/tests/test_protocol.py::test_deeply_nested_structures --deselect=protocol/tests/test_serialize.py::test_deeply_nested_structures --deselect=cli/tests/test_dask_scheduler.py::test_defaults --deselect=cli/tests/test_dask_scheduler.py::test_hostport --deselect=cli/tests/test_dask_spec.py::test_errors --deselect=cli/tests/test_dask_worker.py::test_scheduler_file --deselect=cli/tests/test_dask_worker.py::test_scheduler_file --deselect=cli/tests/test_dask_worker.py::test_scheduler_file --deselect=dashboard/tests/test_scheduler_bokeh.py::test_counters --deselect=dashboard/tests/test_worker_bokeh.py::test_counters --deselect=deploy/tests/test_local.py::test_adapt_then_manual --deselect=deploy/tests/test_local.py::test_async_with --deselect=deploy/tests/test_local.py::test_close_twice --deselect=deploy/tests/test_local.py::test_cluster_info_sync --deselect=deploy/tests/test_local.py::test_local_tls --deselect=deploy/tests/test_local.py::test_no_dangling_asyncio_tasks --deselect=deploy/tests/test_local.py::test_only_local_access --deselect=deploy/tests/test_local.py::test_remote_access --deselect=diagnostics/tests/test_progress_widgets.py::test_serializers --deselect=diagnostics/tests/test_scheduler_plugin.py::test_lifecycle --deselect=http/scheduler/tests/test_missing_bokeh.py::test_missing_bokeh --deselect=http/scheduler/tests/test_scheduler_http.py::test_metrics_when_prometheus_client_not_installed --deselect=protocol/tests/test_serialize.py::test_errors --deselect=tests/test_batched.py::test_BatchedSend --deselect=tests/test_batched.py::test_close_closed --deselect=tests/test_batched.py::test_close_twice --deselect=tests/test_batched.py::test_send_after_stream_start --deselect=tests/test_batched.py::test_send_before_close --deselect=tests/test_batched.py::test_send_before_start --deselect=tests/test_batched.py::test_sending_traffic_jam --deselect=tests/test_batched.py::test_serializers --deselect=tests/test_client.py::TestClientSecurityLoader::test_security_loader --deselect=tests/test_client.py::TestClientSecurityLoader::test_security_loader_ignored_if_explicit_security_provided --deselect=tests/test_client.py::TestClientSecurityLoader::test_security_loader_ignored_if_returns_none --deselect=tests/test_client.py::test_async_with --deselect=tests/test_client.py::test_client_is_quiet_cluster_close --deselect=tests/test_client.py::test_dashboard_link_cluster --deselect=tests/test_client.py::test_dashboard_link_inproc --deselect=tests/test_client.py::test_file_descriptors_dont_leak --deselect=tests/test_client.py::test_mixing_clients_different_scheduler --deselect=tests/test_client.py::test_quiet_client_close --deselect=tests/test_client.py::test_rebalance_sync --deselect=tests/test_client.py::test_repr_localcluster --deselect=tests/test_client.py::test_security_loader --deselect=tests/test_client.py::test_security_loader_ignored_if_explicit_security_provided --deselect=tests/test_client.py::test_security_loader_ignored_if_returns_none --deselect=tests/test_client.py::test_shutdown --deselect=tests/test_client.py::test_shutdown_is_quiet_with_cluster --deselect=tests/test_client.py::test_shutdown_localcluster --deselect=tests/test_client.py::test_shutdown_stops_callbacks --deselect=tests/test_client_loop.py::test_close_loop_sync_start_new_loop --deselect=tests/test_client_loop.py::test_close_loop_sync_use_running_loop --deselect=tests/test_core.py::test_close_fast_without_active_handlers --deselect=tests/test_core.py::test_close_grace_period_for_handlers --deselect=tests/test_core.py::test_close_properly --deselect=tests/test_core.py::test_compression --deselect=tests/test_core.py::test_connection_pool --deselect=tests/test_core.py::test_connection_pool_close_while_connecting --deselect=tests/test_core.py::test_connection_pool_detects_remote_close --deselect=tests/test_core.py::test_connection_pool_outside_cancellation --deselect=tests/test_core.py::test_connection_pool_remove --deselect=tests/test_core.py::test_connection_pool_respects_limit --deselect=tests/test_core.py::test_connection_pool_tls --deselect=tests/test_core.py::test_counters --deselect=tests/test_core.py::test_deserialize_error --deselect=tests/test_core.py::test_errors --deselect=tests/test_core.py::test_identity_inproc --deselect=tests/test_core.py::test_identity_tcp --deselect=tests/test_core.py::test_large_packets_inproc --deselect=tests/test_core.py::test_messages_are_ordered_bsend --deselect=tests/test_core.py::test_messages_are_ordered_raw --deselect=tests/test_core.py::test_ports --deselect=tests/test_core.py::test_rpc_default --deselect=tests/test_core.py::test_rpc_inproc --deselect=tests/test_core.py::test_rpc_message_lifetime_default --deselect=tests/test_core.py::test_rpc_message_lifetime_inproc --deselect=tests/test_core.py::test_rpc_message_lifetime_tcp --deselect=tests/test_core.py::test_rpc_serialization --deselect=tests/test_core.py::test_rpc_tcp --deselect=tests/test_core.py::test_rpc_tls --deselect=tests/test_core.py::test_rpc_with_many_connections_inproc --deselect=tests/test_core.py::test_rpc_with_many_connections_tcp --deselect=tests/test_core.py::test_send_recv_args --deselect=tests/test_core.py::test_send_recv_cancelled --deselect=tests/test_core.py::test_server --deselect=tests/test_core.py::test_server_comms_mark_active_handlers --deselect=tests/test_core.py::test_server_raises_on_blocked_handlers --deselect=tests/test_jupyter.py::test_jupyter_idle_timeout --deselect=tests/test_jupyter.py::test_jupyter_server --deselect=tests/test_locks.py::test_errors --deselect=tests/test_nanny.py::test_scheduler_file --deselect=tests/test_nanny.py::test_scheduler_file --deselect=tests/test_nanny.py::test_scheduler_file --deselect=tests/test_nanny.py::test_worker_uses_same_host_as_nanny --deselect=tests/test_preload.py::test_failure_doesnt_crash_scheduler --deselect=tests/test_preload.py::test_preload_import_time --deselect=tests/test_preload.py::test_preload_manager_sequence --deselect=tests/test_preload.py::test_worker_preload_text --deselect=tests/test_scheduler.py::test_allowed_failures_config --deselect=tests/test_scheduler.py::test_async_context_manager --deselect=tests/test_scheduler.py::test_dashboard_host --deselect=tests/test_scheduler.py::test_file_descriptors_dont_leak --deselect=tests/test_scheduler.py::test_finished --deselect=tests/test_scheduler.py::test_multiple_listeners --deselect=tests/test_scheduler.py::test_no_dangling_asyncio_tasks --deselect=tests/test_scheduler.py::test_scheduler_file --deselect=tests/test_scheduler.py::test_scheduler_file --deselect=tests/test_scheduler.py::test_scheduler_file --deselect=tests/test_security.py::test_require_encryption --deselect=tests/test_security.py::test_tls_listen_connect --deselect=tests/test_security.py::test_tls_temporary_credentials_functional --deselect=tests/test_semaphore.py::test_threadpoolworkers_pick_correct_ioloop --deselect=tests/test_tls_functional.py::test_security_dict_input_no_security --deselect=tests/test_utils_test.py::test_ensure_no_new_clients --deselect=tests/test_utils_test.py::test_freeze_batched_send --deselect=tests/test_utils_test.py::test_locked_comm_drop_in_replacement --deselect=tests/test_utils_test.py::test_locked_comm_intercept_read --deselect=tests/test_utils_test.py::test_locked_comm_intercept_write --deselect=tests/test_worker.py::test_host_uses_scheduler_protocol --deselect=tests/test_worker.py::test_plugin_exception --deselect=tests/test_worker.py::test_plugin_internal_exception --deselect=tests/test_worker.py::test_plugin_multiple_exceptions --deselect=tests/test_worker.py::test_scheduler_file --deselect=tests/test_worker.py::test_scheduler_file --deselect=tests/test_worker.py::test_scheduler_file --deselect=tests/test_worker_client.py::test_dont_override_default_get 5948s ============================= test session starts ============================== 5948s platform linux -- Python 3.12.9, pytest-8.3.4, pluggy-1.5.0 -- /usr/bin/python3.12 5948s cachedir: .pytest_cache 5948s rootdir: /tmp/autopkgtest.4PKwEm/autopkgtest_tmp/build 5948s configfile: pyproject.toml 5948s plugins: timeout-2.3.1, rerunfailures-15.0, anyio-4.7.0, typeguard-4.4.1 5948s timeout: 300.0s 5948s timeout method: signal 5948s timeout func_only: False 5963s collecting ... collected 3392 items / 3391 deselected / 30 skipped / 1 selected 5963s run-last-failure: rerun previous 1 failure 5963s 5967s tests/test_tls_functional.py::test_retire_workers <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_tls_functional.py PASSED [100%] 5967s 5967s ============================= slowest 20 durations ============================= 5967s 4.12s call tests/test_tls_functional.py::test_retire_workers 5967s 0.00s setup tests/test_tls_functional.py::test_retire_workers 5967s 0.00s teardown tests/test_tls_functional.py::test_retire_workers 5967s =============== 1 passed, 30 skipped, 3391 deselected in 19.35s ================ 5968s *** END OF RUN 3: ALL TESTS RUN HAVE NOW PASSED/XFAILED *** 5968s I: pybuild pybuild:308: mkdir -pv /tmp/autopkgtest.4PKwEm/autopkgtest_tmp/.config && printf '\173 "dataframe": \173 "query-planning": False \175 \175\n' > /tmp/autopkgtest.4PKwEm/autopkgtest_tmp/.config/dask 5968s I: pybuild base:311: cd /tmp/autopkgtest.4PKwEm/autopkgtest_tmp/build; cd /tmp/autopkgtest.4PKwEm/autopkgtest_tmp/build; /tmp/autopkgtest.4PKwEm/build.HSC/src/debian/run-tests /tmp/autopkgtest.4PKwEm/build.HSC/src/debian/get-test-exclusions rules python3.13 -m pytest --pyargs distributed --verbose --color=no --timeout-method=signal --timeout=300 -m "not avoid_ci" 5968s *** STARTING RUN 1: python3.13 -m pytest --pyargs distributed --verbose --color=no --timeout-method=signal --timeout=300 -m not avoid_ci -rsfE --ignore=../../../../../usr/lib/python3/dist-packages/distributed/comm/tests/test_comms.py --ignore=../../../../../usr/lib/python3/dist-packages/distributed/comm/tests/test_ws.py --ignore=../../../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_adaptive.py --ignore=../../../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_local.py --ignore=../../../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_slow_adaptive.py --ignore=../../../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_spec_cluster.py --deselect=cli/tests/test_dask_scheduler.py::test_no_dashboard --deselect=deploy/tests/test_local.py::test_localcluster_get_client --deselect=deploy/tests/test_old_ssh.py::test_cluster --deselect=deploy/tests/test_old_ssh.py::test_old_ssh_nprocs_renamed_to_n_workers --deselect=deploy/tests/test_old_ssh.py::test_nprocs_attribute_is_deprecated --deselect=deploy/tests/test_ssh.py::test_nprocs_attribute_is_deprecated --deselect=http/tests/test_core.py::test_prometheus_api_doc --deselect=tests/test_init.py::test_git_revision --deselect=tests/test_jupyter.py::test_jupyter_idle_timeout --deselect=tests/test_jupyter.py::test_jupyter_idle_timeout_returned --deselect=tests/test_jupyter.py::test_jupyter_server --deselect=tests/test_jupyter.py::test_shutsdown_cleanly --deselect=tests/test_profile.py::test_stack_overflow --deselect=tests/test_pubsub.py::test_client_worker --deselect=tests/test_queues.py::test_queue_in_task --deselect=tests/test_spill.py::test_spillbuffer_oserror --deselect=tests/test_steal.py::test_steal_twice --deselect=tests/test_utils_test.py::test_cluster --deselect=tests/test_variable.py::test_variable_in_task --deselect=tests/test_worker.py::test_process_executor_kills_process --deselect=tests/test_worker_memory.py::test_fail_to_pickle_execute_1 --deselect=tests/test_worker_state_machine.py::test_task_state_instance_are_garbage_collected --deselect=protocol/tests/test_protocol.py::test_deeply_nested_structures --deselect=protocol/tests/test_serialize.py::test_deeply_nested_structures --deselect=cli/tests/test_dask_scheduler.py::test_defaults --deselect=cli/tests/test_dask_scheduler.py::test_hostport --deselect=cli/tests/test_dask_spec.py::test_errors --deselect=cli/tests/test_dask_worker.py::test_scheduler_file --deselect=cli/tests/test_dask_worker.py::test_scheduler_file --deselect=cli/tests/test_dask_worker.py::test_scheduler_file --deselect=dashboard/tests/test_scheduler_bokeh.py::test_counters --deselect=dashboard/tests/test_worker_bokeh.py::test_counters --deselect=deploy/tests/test_local.py::test_adapt_then_manual --deselect=deploy/tests/test_local.py::test_async_with --deselect=deploy/tests/test_local.py::test_close_twice --deselect=deploy/tests/test_local.py::test_cluster_info_sync --deselect=deploy/tests/test_local.py::test_local_tls --deselect=deploy/tests/test_local.py::test_no_dangling_asyncio_tasks --deselect=deploy/tests/test_local.py::test_only_local_access --deselect=deploy/tests/test_local.py::test_remote_access --deselect=diagnostics/tests/test_progress_widgets.py::test_serializers --deselect=diagnostics/tests/test_scheduler_plugin.py::test_lifecycle --deselect=http/scheduler/tests/test_missing_bokeh.py::test_missing_bokeh --deselect=http/scheduler/tests/test_scheduler_http.py::test_metrics_when_prometheus_client_not_installed --deselect=protocol/tests/test_serialize.py::test_errors --deselect=tests/test_batched.py::test_BatchedSend --deselect=tests/test_batched.py::test_close_closed --deselect=tests/test_batched.py::test_close_twice --deselect=tests/test_batched.py::test_send_after_stream_start --deselect=tests/test_batched.py::test_send_before_close --deselect=tests/test_batched.py::test_send_before_start --deselect=tests/test_batched.py::test_sending_traffic_jam --deselect=tests/test_batched.py::test_serializers --deselect=tests/test_client.py::TestClientSecurityLoader::test_security_loader --deselect=tests/test_client.py::TestClientSecurityLoader::test_security_loader_ignored_if_explicit_security_provided --deselect=tests/test_client.py::TestClientSecurityLoader::test_security_loader_ignored_if_returns_none --deselect=tests/test_client.py::test_async_with --deselect=tests/test_client.py::test_client_is_quiet_cluster_close --deselect=tests/test_client.py::test_dashboard_link_cluster --deselect=tests/test_client.py::test_dashboard_link_inproc --deselect=tests/test_client.py::test_file_descriptors_dont_leak --deselect=tests/test_client.py::test_mixing_clients_different_scheduler --deselect=tests/test_client.py::test_quiet_client_close --deselect=tests/test_client.py::test_rebalance_sync --deselect=tests/test_client.py::test_repr_localcluster --deselect=tests/test_client.py::test_security_loader --deselect=tests/test_client.py::test_security_loader_ignored_if_explicit_security_provided --deselect=tests/test_client.py::test_security_loader_ignored_if_returns_none --deselect=tests/test_client.py::test_shutdown --deselect=tests/test_client.py::test_shutdown_is_quiet_with_cluster --deselect=tests/test_client.py::test_shutdown_localcluster --deselect=tests/test_client.py::test_shutdown_stops_callbacks --deselect=tests/test_client_loop.py::test_close_loop_sync_start_new_loop --deselect=tests/test_client_loop.py::test_close_loop_sync_use_running_loop --deselect=tests/test_core.py::test_close_fast_without_active_handlers --deselect=tests/test_core.py::test_close_grace_period_for_handlers --deselect=tests/test_core.py::test_close_properly --deselect=tests/test_core.py::test_compression --deselect=tests/test_core.py::test_connection_pool --deselect=tests/test_core.py::test_connection_pool_close_while_connecting --deselect=tests/test_core.py::test_connection_pool_detects_remote_close --deselect=tests/test_core.py::test_connection_pool_outside_cancellation --deselect=tests/test_core.py::test_connection_pool_remove --deselect=tests/test_core.py::test_connection_pool_respects_limit --deselect=tests/test_core.py::test_connection_pool_tls --deselect=tests/test_core.py::test_counters --deselect=tests/test_core.py::test_deserialize_error --deselect=tests/test_core.py::test_errors --deselect=tests/test_core.py::test_identity_inproc --deselect=tests/test_core.py::test_identity_tcp --deselect=tests/test_core.py::test_large_packets_inproc --deselect=tests/test_core.py::test_messages_are_ordered_bsend --deselect=tests/test_core.py::test_messages_are_ordered_raw --deselect=tests/test_core.py::test_ports --deselect=tests/test_core.py::test_rpc_default --deselect=tests/test_core.py::test_rpc_inproc --deselect=tests/test_core.py::test_rpc_message_lifetime_default --deselect=tests/test_core.py::test_rpc_message_lifetime_inproc --deselect=tests/test_core.py::test_rpc_message_lifetime_tcp --deselect=tests/test_core.py::test_rpc_serialization --deselect=tests/test_core.py::test_rpc_tcp --deselect=tests/test_core.py::test_rpc_tls --deselect=tests/test_core.py::test_rpc_with_many_connections_inproc --deselect=tests/test_core.py::test_rpc_with_many_connections_tcp --deselect=tests/test_core.py::test_send_recv_args --deselect=tests/test_core.py::test_send_recv_cancelled --deselect=tests/test_core.py::test_server --deselect=tests/test_core.py::test_server_comms_mark_active_handlers --deselect=tests/test_core.py::test_server_raises_on_blocked_handlers --deselect=tests/test_jupyter.py::test_jupyter_idle_timeout --deselect=tests/test_jupyter.py::test_jupyter_server --deselect=tests/test_locks.py::test_errors --deselect=tests/test_nanny.py::test_scheduler_file --deselect=tests/test_nanny.py::test_scheduler_file --deselect=tests/test_nanny.py::test_scheduler_file --deselect=tests/test_nanny.py::test_worker_uses_same_host_as_nanny --deselect=tests/test_preload.py::test_failure_doesnt_crash_scheduler --deselect=tests/test_preload.py::test_preload_import_time --deselect=tests/test_preload.py::test_preload_manager_sequence --deselect=tests/test_preload.py::test_worker_preload_text --deselect=tests/test_scheduler.py::test_allowed_failures_config --deselect=tests/test_scheduler.py::test_async_context_manager --deselect=tests/test_scheduler.py::test_dashboard_host --deselect=tests/test_scheduler.py::test_file_descriptors_dont_leak --deselect=tests/test_scheduler.py::test_finished --deselect=tests/test_scheduler.py::test_multiple_listeners --deselect=tests/test_scheduler.py::test_no_dangling_asyncio_tasks --deselect=tests/test_scheduler.py::test_scheduler_file --deselect=tests/test_scheduler.py::test_scheduler_file --deselect=tests/test_scheduler.py::test_scheduler_file --deselect=tests/test_security.py::test_require_encryption --deselect=tests/test_security.py::test_tls_listen_connect --deselect=tests/test_security.py::test_tls_temporary_credentials_functional --deselect=tests/test_semaphore.py::test_threadpoolworkers_pick_correct_ioloop --deselect=tests/test_tls_functional.py::test_security_dict_input_no_security --deselect=tests/test_utils_test.py::test_ensure_no_new_clients --deselect=tests/test_utils_test.py::test_freeze_batched_send --deselect=tests/test_utils_test.py::test_locked_comm_drop_in_replacement --deselect=tests/test_utils_test.py::test_locked_comm_intercept_read --deselect=tests/test_utils_test.py::test_locked_comm_intercept_write --deselect=tests/test_worker.py::test_host_uses_scheduler_protocol --deselect=tests/test_worker.py::test_plugin_exception --deselect=tests/test_worker.py::test_plugin_internal_exception --deselect=tests/test_worker.py::test_plugin_multiple_exceptions --deselect=tests/test_worker.py::test_scheduler_file --deselect=tests/test_worker.py::test_scheduler_file --deselect=tests/test_worker.py::test_scheduler_file --deselect=tests/test_worker_client.py::test_dont_override_default_get 5970s ============================= test session starts ============================== 5970s platform linux -- Python 3.13.2, pytest-8.3.4, pluggy-1.5.0 -- /usr/bin/python3.13 5970s cachedir: .pytest_cache 5970s rootdir: /tmp/autopkgtest.4PKwEm/autopkgtest_tmp/build 5970s configfile: pyproject.toml 5970s plugins: timeout-2.3.1, rerunfailures-15.0, anyio-4.7.0, typeguard-4.4.1 5970s timeout: 300.0s 5970s timeout method: signal 5970s timeout func_only: False 5981s collecting ... collected 3392 items / 160 deselected / 30 skipped / 3232 selected 5981s 5981s cli/tests/test_dask_scheduler.py::test_dashboard <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py SKIPPED [ 0%] 5981s cli/tests/test_dask_scheduler.py::test_dashboard_non_standard_ports <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py SKIPPED [ 0%] 5982s cli/tests/test_dask_scheduler.py::test_multiple_protocols <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py PASSED [ 0%] 5982s cli/tests/test_dask_scheduler.py::test_dashboard_allowlist <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py SKIPPED [ 0%] 5985s cli/tests/test_dask_scheduler.py::test_interface <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py PASSED [ 0%] 5987s cli/tests/test_dask_scheduler.py::test_pid_file <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py PASSED [ 0%] 5988s cli/tests/test_dask_scheduler.py::test_scheduler_port_zero <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py PASSED [ 0%] 5988s cli/tests/test_dask_scheduler.py::test_dashboard_port_zero <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py SKIPPED [ 0%] 5990s cli/tests/test_dask_scheduler.py::test_preload_file <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py PASSED [ 0%] 5991s cli/tests/test_dask_scheduler.py::test_preload_module <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py PASSED [ 0%] 5993s cli/tests/test_dask_scheduler.py::test_preload_remote_module <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py PASSED [ 0%] 5994s cli/tests/test_dask_scheduler.py::test_preload_config <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py PASSED [ 0%] 5996s cli/tests/test_dask_scheduler.py::test_preload_command <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py PASSED [ 0%] 5997s cli/tests/test_dask_scheduler.py::test_preload_command_default <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py PASSED [ 0%] 5997s cli/tests/test_dask_scheduler.py::test_version_option <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py PASSED [ 0%] 5997s cli/tests/test_dask_scheduler.py::test_idle_timeout <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py SKIPPED [ 0%] 5997s cli/tests/test_dask_scheduler.py::test_restores_signal_handler <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py SKIPPED [ 0%] 6000s cli/tests/test_dask_scheduler.py::test_multiple_workers_2 <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py PASSED [ 0%] 6003s cli/tests/test_dask_scheduler.py::test_multiple_workers <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py PASSED [ 0%] 6003s cli/tests/test_dask_scheduler.py::test_signal_handling[2] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py SKIPPED [ 0%] 6003s cli/tests/test_dask_scheduler.py::test_signal_handling[15] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py SKIPPED [ 0%] 6005s cli/tests/test_dask_scheduler.py::test_single_executable_deprecated <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py PASSED [ 0%] 6007s cli/tests/test_dask_spec.py::test_text <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_spec.py PASSED [ 0%] 6009s cli/tests/test_dask_spec.py::test_file <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_spec.py PASSED [ 0%] 6011s cli/tests/test_dask_spec.py::test_signal_handling_worker[2-Nanny] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_spec.py PASSED [ 0%] 6012s cli/tests/test_dask_spec.py::test_signal_handling_worker[2-Worker] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_spec.py PASSED [ 0%] 6014s cli/tests/test_dask_spec.py::test_signal_handling_worker[15-Nanny] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_spec.py PASSED [ 0%] 6015s cli/tests/test_dask_spec.py::test_signal_handling_worker[15-Worker] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_spec.py PASSED [ 0%] 6018s cli/tests/test_dask_spec.py::test_signal_handling_scheduler[2] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_spec.py PASSED [ 0%] 6020s cli/tests/test_dask_spec.py::test_signal_handling_scheduler[15] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_spec.py PASSED [ 0%] 6020s cli/tests/test_dask_worker.py::test_apportion_ports[args0-expect0] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 0%] 6020s cli/tests/test_dask_worker.py::test_apportion_ports[args1-expect1] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 0%] 6020s cli/tests/test_dask_worker.py::test_apportion_ports[args2-expect2] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 1%] 6020s cli/tests/test_dask_worker.py::test_apportion_ports[args3-expect3] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 1%] 6020s cli/tests/test_dask_worker.py::test_apportion_ports[args4-expect4] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 1%] 6020s cli/tests/test_dask_worker.py::test_apportion_ports[args5-expect5] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 1%] 6020s cli/tests/test_dask_worker.py::test_apportion_ports[args6-expect6] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 1%] 6020s cli/tests/test_dask_worker.py::test_apportion_ports[args7-expect7] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 1%] 6020s cli/tests/test_dask_worker.py::test_apportion_ports[args8-expect8] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 1%] 6020s cli/tests/test_dask_worker.py::test_apportion_ports[args9-expect9] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 1%] 6020s cli/tests/test_dask_worker.py::test_apportion_ports[args10-expect10] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 1%] 6020s cli/tests/test_dask_worker.py::test_apportion_ports[args11-expect11] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 1%] 6020s cli/tests/test_dask_worker.py::test_apportion_ports[args12-expect12] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 1%] 6020s cli/tests/test_dask_worker.py::test_apportion_ports[args13-expect13] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 1%] 6020s cli/tests/test_dask_worker.py::test_apportion_ports[args14-expect14] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 1%] 6020s cli/tests/test_dask_worker.py::test_apportion_ports[args15-expect15] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 1%] 6020s cli/tests/test_dask_worker.py::test_apportion_ports[args16-expect16] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 1%] 6020s cli/tests/test_dask_worker.py::test_apportion_ports[args17-expect17] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 1%] 6020s cli/tests/test_dask_worker.py::test_apportion_ports_bad <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 1%] 6020s cli/tests/test_dask_worker.py::test_nanny_worker_ports <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py SKIPPED [ 1%] 6020s cli/tests/test_dask_worker.py::test_nanny_worker_port_range <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py SKIPPED [ 1%] 6021s cli/tests/test_dask_worker.py::test_nanny_worker_port_range_too_many_workers_raises <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 1%] 6021s cli/tests/test_dask_worker.py::test_memory_limit <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py SKIPPED [ 1%] 6022s cli/tests/test_dask_worker.py::test_no_nanny <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 1%] 6022s cli/tests/test_dask_worker.py::test_resources <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py SKIPPED [ 1%] 6022s cli/tests/test_dask_worker.py::test_local_directory[--nanny] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py SKIPPED [ 1%] 6022s cli/tests/test_dask_worker.py::test_local_directory[--no-nanny] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py SKIPPED [ 1%] 6022s cli/tests/test_dask_worker.py::test_scheduler_address_env <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py SKIPPED [ 1%] 6023s cli/tests/test_dask_worker.py::test_nworkers_requires_nanny <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 1%] 6023s cli/tests/test_dask_worker.py::test_nworkers_negative <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py SKIPPED [ 1%] 6023s cli/tests/test_dask_worker.py::test_nworkers_auto <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py SKIPPED [ 1%] 6023s cli/tests/test_dask_worker.py::test_nworkers_expands_name <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py SKIPPED [ 1%] 6023s cli/tests/test_dask_worker.py::test_contact_listen_address[tcp://0.0.0.0:---nanny] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py SKIPPED [ 1%] 6023s cli/tests/test_dask_worker.py::test_contact_listen_address[tcp://0.0.0.0:---no-nanny] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py SKIPPED [ 1%] 6023s cli/tests/test_dask_worker.py::test_contact_listen_address[tcp://127.0.0.2:---nanny] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py SKIPPED [ 2%] 6023s cli/tests/test_dask_worker.py::test_contact_listen_address[tcp://127.0.0.2:---no-nanny] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py SKIPPED [ 2%] 6023s cli/tests/test_dask_worker.py::test_listen_address_ipv6[tcp://:---nanny] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py SKIPPED [ 2%] 6023s cli/tests/test_dask_worker.py::test_listen_address_ipv6[tcp://:---no-nanny] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py SKIPPED [ 2%] 6023s cli/tests/test_dask_worker.py::test_listen_address_ipv6[tcp://[::1]:---nanny] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py SKIPPED [ 2%] 6023s cli/tests/test_dask_worker.py::test_listen_address_ipv6[tcp://[::1]:---no-nanny] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py SKIPPED [ 2%] 6023s cli/tests/test_dask_worker.py::test_respect_host_listen_address[127.0.0.2---nanny] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py SKIPPED [ 2%] 6023s cli/tests/test_dask_worker.py::test_respect_host_listen_address[127.0.0.2---no-nanny] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py SKIPPED [ 2%] 6023s cli/tests/test_dask_worker.py::test_respect_host_listen_address[0.0.0.0---nanny] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py SKIPPED [ 2%] 6023s cli/tests/test_dask_worker.py::test_respect_host_listen_address[0.0.0.0---no-nanny] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py SKIPPED [ 2%] 6023s cli/tests/test_dask_worker.py::test_dashboard_non_standard_ports <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py SKIPPED [ 2%] 6023s cli/tests/test_dask_worker.py::test_version_option <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 2%] 6023s cli/tests/test_dask_worker.py::test_worker_timeout[True] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py SKIPPED [ 2%] 6023s cli/tests/test_dask_worker.py::test_worker_timeout[False] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py SKIPPED [ 2%] 6023s cli/tests/test_dask_worker.py::test_integer_names <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py SKIPPED [ 2%] 6023s cli/tests/test_dask_worker.py::test_worker_class[--nanny] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py SKIPPED [ 2%] 6023s cli/tests/test_dask_worker.py::test_worker_class[--no-nanny] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py SKIPPED [ 2%] 6023s cli/tests/test_dask_worker.py::test_preload_config <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py SKIPPED [ 2%] 6023s cli/tests/test_dask_worker.py::test_set_lifetime_stagger_via_env_var <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py SKIPPED [ 2%] 6023s cli/tests/test_dask_worker.py::test_set_lifetime_restart_via_env_var <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py SKIPPED [ 2%] 6023s cli/tests/test_dask_worker.py::test_timeout[--nanny] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py SKIPPED [ 2%] 6023s cli/tests/test_dask_worker.py::test_timeout[--no-nanny] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py SKIPPED [ 2%] 6025s cli/tests/test_dask_worker.py::test_signal_handling[2---nanny] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 2%] 6026s cli/tests/test_dask_worker.py::test_signal_handling[2---no-nanny] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 2%] 6028s cli/tests/test_dask_worker.py::test_signal_handling[15---nanny] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 2%] 6029s cli/tests/test_dask_worker.py::test_signal_handling[15---no-nanny] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 2%] 6032s cli/tests/test_dask_worker.py::test_error_during_startup[--nanny] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 2%] 6035s cli/tests/test_dask_worker.py::test_error_during_startup[--no-nanny] <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 2%] 6037s cli/tests/test_dask_worker.py::test_single_executable_deprecated <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py PASSED [ 2%] 6037s cli/tests/test_dask_worker.py::test_single_executable_works <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py SKIPPED [ 2%] 6040s cli/tests/test_tls_cli.py::test_basic <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_tls_cli.py PASSED [ 2%] 6042s cli/tests/test_tls_cli.py::test_sni <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_tls_cli.py PASSED [ 2%] 6044s cli/tests/test_tls_cli.py::test_nanny <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_tls_cli.py PASSED [ 3%] 6047s cli/tests/test_tls_cli.py::test_separate_key_cert <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_tls_cli.py PASSED [ 3%] 6050s cli/tests/test_tls_cli.py::test_use_config_file <- ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_tls_cli.py PASSED [ 3%] 6050s comm/tests/test_tcp.py::test_getaddrinfo_invalid_af <- ../../../../usr/lib/python3/dist-packages/distributed/comm/tests/test_tcp.py PASSED [ 3%] 6050s dashboard/tests/test_bokeh.py::test_old_import <- ../../../../usr/lib/python3/dist-packages/distributed/dashboard/tests/test_bokeh.py PASSED [ 3%] 6050s deploy/tests/test_adaptive_core.py::test_safe_target <- ../../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_adaptive_core.py PASSED [ 3%] 6050s deploy/tests/test_adaptive_core.py::test_scale_up <- ../../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_adaptive_core.py PASSED [ 3%] 6050s deploy/tests/test_adaptive_core.py::test_scale_down <- ../../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_adaptive_core.py PASSED [ 3%] 6050s deploy/tests/test_cluster.py::test_eq <- ../../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_cluster.py PASSED [ 3%] 6050s deploy/tests/test_cluster.py::test_repr <- ../../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_cluster.py PASSED [ 3%] 6053s deploy/tests/test_cluster.py::test_cluster_wait_for_worker <- ../../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_cluster.py PASSED [ 3%] 6053s deploy/tests/test_cluster.py::test_deprecated_loop_properties <- ../../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_cluster.py PASSED [ 3%] 6053s deploy/tests/test_cluster.py::test_exponential_backoff <- ../../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_cluster.py PASSED [ 3%] 6053s deploy/tests/test_cluster.py::test_sync_context_manager_used_with_async_cluster <- ../../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_cluster.py PASSED [ 3%] 6053s deploy/tests/test_deploy_utils.py::test_default_process_thread_breakdown <- ../../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_deploy_utils.py PASSED [ 3%] 6056s deploy/tests/test_subprocess.py::test_basic <- ../../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_subprocess.py PASSED [ 3%] 6059s deploy/tests/test_subprocess.py::test_n_workers <- ../../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_subprocess.py PASSED [ 3%] 6062s deploy/tests/test_subprocess.py::test_scale_up_and_down <- ../../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_subprocess.py PASSED [ 3%] 6063s deploy/tests/test_subprocess.py::test_raise_if_scheduler_fails_to_start <- ../../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_subprocess.py PASSED [ 3%] 6063s deploy/tests/test_subprocess.py::test_subprocess_cluster_does_not_depend_on_logging <- ../../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_subprocess.py SKIPPED [ 3%] 6063s deploy/tests/test_subprocess.py::test_raise_on_windows <- ../../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_subprocess.py SKIPPED [ 3%] 6065s diagnostics/tests/test_cluster_dump_plugin.py::test_cluster_dump_plugin <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_cluster_dump_plugin.py PASSED [ 3%] 6065s diagnostics/tests/test_eventstream.py::test_eventstream <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_eventstream.py SKIPPED [ 3%] 6065s diagnostics/tests/test_eventstream.py::test_eventstream_remote <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_eventstream.py PASSED [ 3%] 6065s diagnostics/tests/test_graph_layout.py::test_basic <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_graph_layout.py PASSED [ 3%] 6065s diagnostics/tests/test_graph_layout.py::test_construct_after_call <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_graph_layout.py PASSED [ 3%] 6065s diagnostics/tests/test_graph_layout.py::test_states <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_graph_layout.py PASSED [ 3%] 6066s diagnostics/tests/test_graph_layout.py::test_release_tasks <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_graph_layout.py PASSED [ 3%] 6066s diagnostics/tests/test_graph_layout.py::test_forget <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_graph_layout.py PASSED [ 3%] 6066s diagnostics/tests/test_graph_layout.py::test_unique_positions <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_graph_layout.py PASSED [ 3%] 6066s diagnostics/tests/test_graph_layout.py::test_layout_scatter <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_graph_layout.py PASSED [ 3%] 6066s diagnostics/tests/test_install_plugin.py::test_pip_install <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_install_plugin.py PASSED [ 3%] 6066s diagnostics/tests/test_install_plugin.py::test_conda_install <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_install_plugin.py PASSED [ 3%] 6066s diagnostics/tests/test_install_plugin.py::test_pip_install_fails <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_install_plugin.py PASSED [ 4%] 6066s diagnostics/tests/test_install_plugin.py::test_conda_install_fails_when_conda_not_found <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_install_plugin.py PASSED [ 4%] 6066s diagnostics/tests/test_install_plugin.py::test_conda_install_fails_when_conda_raises <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_install_plugin.py PASSED [ 4%] 6066s diagnostics/tests/test_install_plugin.py::test_conda_install_fails_on_returncode <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_install_plugin.py PASSED [ 4%] 6066s diagnostics/tests/test_install_plugin.py::test_package_install_on_worker <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_install_plugin.py SKIPPED [ 4%] 6066s diagnostics/tests/test_install_plugin.py::test_package_install_on_nanny <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_install_plugin.py SKIPPED [ 4%] 6066s diagnostics/tests/test_install_plugin.py::test_package_install_restarts_on_nanny <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_install_plugin.py SKIPPED [ 4%] 6068s diagnostics/tests/test_install_plugin.py::test_package_install_failing_does_not_restart_on_nanny <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_install_plugin.py PASSED [ 4%] 6069s diagnostics/tests/test_memory_sampler.py::test_sync <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_memory_sampler.py PASSED [ 4%] 6069s diagnostics/tests/test_memory_sampler.py::test_at_least_one_sample <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_memory_sampler.py PASSED [ 4%] 6069s diagnostics/tests/test_memory_sampler.py::test_multi_sample <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_memory_sampler.py PASSED [ 4%] 6070s diagnostics/tests/test_memory_sampler.py::test_pandas[False] <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_memory_sampler.py SKIPPED [ 4%] 6070s diagnostics/tests/test_memory_sampler.py::test_pandas[True] <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_memory_sampler.py SKIPPED [ 4%] 6070s diagnostics/tests/test_memory_sampler.py::test_pandas_multiseries[False] <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_memory_sampler.py PASSED [ 4%] 6070s diagnostics/tests/test_memory_sampler.py::test_pandas_multiseries[True] <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_memory_sampler.py PASSED [ 4%] 6072s diagnostics/tests/test_nanny_plugin.py::test_register_worker_plugin_is_deprecated <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_nanny_plugin.py PASSED [ 4%] 6073s diagnostics/tests/test_nanny_plugin.py::test_register_worker_plugin_typing_over_nanny_keyword <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_nanny_plugin.py PASSED [ 4%] 6074s diagnostics/tests/test_nanny_plugin.py::test_duck_typed_register_nanny_plugin_is_deprecated <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_nanny_plugin.py PASSED [ 4%] 6076s diagnostics/tests/test_nanny_plugin.py::test_register_idempotent_plugin <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_nanny_plugin.py PASSED [ 4%] 6077s diagnostics/tests/test_nanny_plugin.py::test_register_non_idempotent_plugin <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_nanny_plugin.py PASSED [ 4%] 6078s diagnostics/tests/test_nanny_plugin.py::test_register_plugin_with_idempotent_keyword_is_deprecated <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_nanny_plugin.py PASSED [ 4%] 6080s diagnostics/tests/test_nanny_plugin.py::test_register_plugin_with_broken_setup_to_existing_nannies_raises <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_nanny_plugin.py PASSED [ 4%] 6081s diagnostics/tests/test_nanny_plugin.py::test_plugin_with_broken_setup_on_new_nanny_logs <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_nanny_plugin.py PASSED [ 4%] 6082s diagnostics/tests/test_nanny_plugin.py::test_unregister_nanny_plugin_with_broken_teardown_raises <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_nanny_plugin.py PASSED [ 4%] 6084s diagnostics/tests/test_nanny_plugin.py::test_nanny_plugin_with_broken_teardown_logs_on_close <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_nanny_plugin.py PASSED [ 4%] 6084s diagnostics/tests/test_progress.py::test_many_Progress <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_progress.py PASSED [ 4%] 6084s diagnostics/tests/test_progress.py::test_multiprogress <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_progress.py PASSED [ 4%] 6084s diagnostics/tests/test_progress.py::test_multiprogress_cancel <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_progress.py PASSED [ 4%] 6084s diagnostics/tests/test_progress.py::test_multiprogress_with_spans <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_progress.py PASSED [ 4%] 6085s diagnostics/tests/test_progress.py::test_multiprogress_with_prefix <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_progress.py PASSED [ 4%] 6085s diagnostics/tests/test_progress.py::test_multiprogress_warns <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_progress.py PASSED [ 4%] 6085s diagnostics/tests/test_progress.py::test_robust_to_bad_plugin <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_progress.py PASSED [ 4%] 6089s diagnostics/tests/test_progress.py::test_AllProgress <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_progress.py PASSED [ 5%] 6092s diagnostics/tests/test_progress.py::test_AllProgress_lost_key <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_progress.py PASSED [ 5%] 6097s diagnostics/tests/test_progress.py::test_group_timing <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_progress.py PASSED [ 5%] 6099s diagnostics/tests/test_progressbar.py::test_text_progressbar <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_progressbar.py PASSED [ 5%] 6099s diagnostics/tests/test_progressbar.py::test_TextProgressBar_error <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_progressbar.py PASSED [ 5%] 6099s diagnostics/tests/test_progressbar.py::test_TextProgressBar_empty <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_progressbar.py PASSED [ 5%] 6101s diagnostics/tests/test_progressbar.py::test_progress_function <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_progressbar.py PASSED [ 5%] 6102s diagnostics/tests/test_progressbar.py::test_progress_function_w_kwargs <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_progressbar.py PASSED [ 5%] 6104s diagnostics/tests/test_progressbar.py::test_progress_function_warns <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_progressbar.py PASSED [ 5%] 6104s diagnostics/tests/test_progressbar.py::test_progress_function_raises <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_progressbar.py PASSED [ 5%] 6104s diagnostics/tests/test_progressbar.py::test_deprecated_loop_properties <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_progressbar.py PASSED [ 5%] 6104s diagnostics/tests/test_scheduler_plugin.py::test_simple <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_scheduler_plugin.py PASSED [ 5%] 6104s diagnostics/tests/test_scheduler_plugin.py::test_add_remove_worker <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_scheduler_plugin.py PASSED [ 5%] 6104s diagnostics/tests/test_scheduler_plugin.py::test_remove_worker_renamed_kwargs_allowed <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_scheduler_plugin.py PASSED [ 5%] 6104s diagnostics/tests/test_scheduler_plugin.py::test_remove_worker_without_kwargs_deprecated <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_scheduler_plugin.py PASSED [ 5%] 6104s diagnostics/tests/test_scheduler_plugin.py::test_async_add_remove_worker <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_scheduler_plugin.py PASSED [ 5%] 6104s diagnostics/tests/test_scheduler_plugin.py::test_async_and_sync_add_remove_worker <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_scheduler_plugin.py PASSED [ 5%] 6104s diagnostics/tests/test_scheduler_plugin.py::test_failing_async_add_remove_worker <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_scheduler_plugin.py PASSED [ 5%] 6104s diagnostics/tests/test_scheduler_plugin.py::test_failing_sync_add_remove_worker <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_scheduler_plugin.py PASSED [ 5%] 6104s diagnostics/tests/test_scheduler_plugin.py::test_register_plugin <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_scheduler_plugin.py PASSED [ 5%] 6105s diagnostics/tests/test_scheduler_plugin.py::test_register_scheduler_plugin_deprecated <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_scheduler_plugin.py PASSED [ 5%] 6105s diagnostics/tests/test_scheduler_plugin.py::test_unregister_scheduler_plugin <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_scheduler_plugin.py PASSED [ 5%] 6105s diagnostics/tests/test_scheduler_plugin.py::test_unregister_scheduler_plugin_from_client <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_scheduler_plugin.py PASSED [ 5%] 6105s diagnostics/tests/test_scheduler_plugin.py::test_register_plugin_on_scheduler <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_scheduler_plugin.py PASSED [ 5%] 6107s diagnostics/tests/test_scheduler_plugin.py::test_closing_errors_ok <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_scheduler_plugin.py PASSED [ 5%] 6107s diagnostics/tests/test_scheduler_plugin.py::test_update_graph_hook_simple <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_scheduler_plugin.py PASSED [ 5%] 6107s diagnostics/tests/test_scheduler_plugin.py::test_update_graph_hook_complex <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_scheduler_plugin.py PASSED [ 5%] 6107s diagnostics/tests/test_scheduler_plugin.py::test_scheduler_plugin_in_register_worker_plugin_overrides <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_scheduler_plugin.py PASSED [ 5%] 6108s diagnostics/tests/test_scheduler_plugin.py::test_scheduler_plugin_in_register_worker_plugin_overrides_nanny <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_scheduler_plugin.py PASSED [ 5%] 6108s diagnostics/tests/test_scheduler_plugin.py::test_register_idempotent_plugin <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_scheduler_plugin.py PASSED [ 5%] 6108s diagnostics/tests/test_scheduler_plugin.py::test_register_non_idempotent_plugin <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_scheduler_plugin.py PASSED [ 5%] 6108s diagnostics/tests/test_scheduler_plugin.py::test_register_plugin_with_idempotent_keyword_is_deprecated <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_scheduler_plugin.py PASSED [ 5%] 6108s diagnostics/tests/test_scheduler_plugin.py::test_register_idempotent_plugins_directly <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_scheduler_plugin.py PASSED [ 6%] 6108s diagnostics/tests/test_scheduler_plugin.py::test_register_non_idempotent_plugins_directly <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_scheduler_plugin.py PASSED [ 6%] 6109s diagnostics/tests/test_task_stream.py::test_TaskStreamPlugin <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_task_stream.py PASSED [ 6%] 6109s diagnostics/tests/test_task_stream.py::test_maxlen <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_task_stream.py PASSED [ 6%] 6109s diagnostics/tests/test_task_stream.py::test_collect <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_task_stream.py PASSED [ 6%] 6109s diagnostics/tests/test_task_stream.py::test_no_startstops <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_task_stream.py PASSED [ 6%] 6110s diagnostics/tests/test_task_stream.py::test_client <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_task_stream.py PASSED [ 6%] 6112s diagnostics/tests/test_task_stream.py::test_client_sync <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_task_stream.py PASSED [ 6%] 6112s diagnostics/tests/test_task_stream.py::test_get_task_stream_plot <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_task_stream.py SKIPPED [ 6%] 6113s diagnostics/tests/test_task_stream.py::test_get_task_stream_save <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_task_stream.py SKIPPED [ 6%] 6113s diagnostics/tests/test_worker_plugin.py::test_create_with_client <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_worker_plugin.py PASSED [ 6%] 6113s diagnostics/tests/test_worker_plugin.py::test_remove_with_client <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_worker_plugin.py PASSED [ 6%] 6113s diagnostics/tests/test_worker_plugin.py::test_remove_with_client_raises <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_worker_plugin.py PASSED [ 6%] 6113s diagnostics/tests/test_worker_plugin.py::test_create_on_construction <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_worker_plugin.py PASSED [ 6%] 6114s diagnostics/tests/test_worker_plugin.py::test_normal_task_transitions_called <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_worker_plugin.py PASSED [ 6%] 6114s diagnostics/tests/test_worker_plugin.py::test_failing_task_transitions_called <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_worker_plugin.py PASSED [ 6%] 6114s diagnostics/tests/test_worker_plugin.py::test_superseding_task_transitions_called <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_worker_plugin.py PASSED [ 6%] 6114s diagnostics/tests/test_worker_plugin.py::test_dependent_tasks <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_worker_plugin.py PASSED [ 6%] 6114s diagnostics/tests/test_worker_plugin.py::test_empty_plugin <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_worker_plugin.py PASSED [ 6%] 6114s diagnostics/tests/test_worker_plugin.py::test_default_name <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_worker_plugin.py PASSED [ 6%] 6114s diagnostics/tests/test_worker_plugin.py::test_assert_no_warning_no_overload <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_worker_plugin.py PASSED [ 6%] 6114s diagnostics/tests/test_worker_plugin.py::test_WorkerPlugin_overwrite <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_worker_plugin.py PASSED [ 6%] 6114s diagnostics/tests/test_worker_plugin.py::test_register_worker_plugin_is_deprecated <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_worker_plugin.py PASSED [ 6%] 6114s diagnostics/tests/test_worker_plugin.py::test_register_worker_plugin_typing_over_nanny_keyword <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_worker_plugin.py PASSED [ 6%] 6114s diagnostics/tests/test_worker_plugin.py::test_duck_typed_register_worker_plugin_is_deprecated <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_worker_plugin.py PASSED [ 6%] 6114s diagnostics/tests/test_worker_plugin.py::test_register_idempotent_plugin <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_worker_plugin.py PASSED [ 6%] 6114s diagnostics/tests/test_worker_plugin.py::test_register_non_idempotent_plugin <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_worker_plugin.py PASSED [ 6%] 6114s diagnostics/tests/test_worker_plugin.py::test_register_plugin_with_idempotent_keyword_is_deprecated <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_worker_plugin.py PASSED [ 6%] 6114s diagnostics/tests/test_worker_plugin.py::test_register_plugin_with_broken_setup_to_existing_workers_raises <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_worker_plugin.py PASSED [ 6%] 6114s diagnostics/tests/test_worker_plugin.py::test_plugin_with_broken_setup_on_new_worker_logs <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_worker_plugin.py PASSED [ 6%] 6115s diagnostics/tests/test_worker_plugin.py::test_unregister_worker_plugin_with_broken_teardown_raises <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_worker_plugin.py PASSED [ 6%] 6115s diagnostics/tests/test_worker_plugin.py::test_plugin_with_broken_teardown_logs_on_close <- ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_worker_plugin.py PASSED [ 6%] 6115s http/scheduler/tests/test_missing_bokeh.py::test_bokeh_version_too_low <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_missing_bokeh.py SKIPPED [ 6%] 6115s http/scheduler/tests/test_missing_bokeh.py::test_bokeh_version_too_high <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_missing_bokeh.py SKIPPED [ 7%] 6115s http/scheduler/tests/test_scheduler_http.py::test_connect <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 7%] 6115s http/scheduler/tests/test_scheduler_http.py::test_worker_404 <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 7%] 6115s http/scheduler/tests/test_scheduler_http.py::test_prefix <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py SKIPPED [ 7%] 6115s http/scheduler/tests/test_scheduler_http.py::test_prometheus <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 7%] 6115s http/scheduler/tests/test_scheduler_http.py::test_prometheus_collect_client_connections_totals <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 7%] 6116s http/scheduler/tests/test_scheduler_http.py::test_prometheus_collect_task_states <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 7%] 6116s http/scheduler/tests/test_scheduler_http.py::test_prometheus_collect_task_groups <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 7%] 6116s http/scheduler/tests/test_scheduler_http.py::test_prometheus_collect_task_prefix_counts <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 7%] 6116s http/scheduler/tests/test_scheduler_http.py::test_prometheus_collect_worker_totals <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 7%] 6116s http/scheduler/tests/test_scheduler_http.py::test_prometheus_collect_worker_states <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 7%] 6116s http/scheduler/tests/test_scheduler_http.py::test_health <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py SKIPPED [ 7%] 6116s http/scheduler/tests/test_scheduler_http.py::test_sitemap <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 7%] 6116s http/scheduler/tests/test_scheduler_http.py::test_task_page[1_0] <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 7%] 6116s http/scheduler/tests/test_scheduler_http.py::test_task_page[1_1] <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 7%] 6117s http/scheduler/tests/test_scheduler_http.py::test_task_page[x] <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 7%] 6117s http/scheduler/tests/test_scheduler_http.py::test_task_page[a+b] <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 7%] 6117s http/scheduler/tests/test_scheduler_http.py::test_task_page[a b] <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 7%] 6117s http/scheduler/tests/test_scheduler_http.py::test_task_page[key5] <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 7%] 6117s http/scheduler/tests/test_scheduler_http.py::test_task_page[key6] <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 7%] 6117s http/scheduler/tests/test_scheduler_http.py::test_task_page[key7] <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 7%] 6117s http/scheduler/tests/test_scheduler_http.py::test_task_page[key8] <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 7%] 6117s http/scheduler/tests/test_scheduler_http.py::test_task_page[(] <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 7%] 6117s http/scheduler/tests/test_scheduler_http.py::test_task_page[[] <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 7%] 6117s http/scheduler/tests/test_scheduler_http.py::test_task_page['] <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 7%] 6118s http/scheduler/tests/test_scheduler_http.py::test_task_page["] <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 7%] 6118s http/scheduler/tests/test_scheduler_http.py::test_task_page[123] <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 7%] 6118s http/scheduler/tests/test_scheduler_http.py::test_task_page[key14] <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 7%] 6118s http/scheduler/tests/test_scheduler_http.py::test_task_page[key15] <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 7%] 6118s http/scheduler/tests/test_scheduler_http.py::test_task_page[key16] <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 7%] 6118s http/scheduler/tests/test_scheduler_http.py::test_task_page[key17] <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 7%] 6118s http/scheduler/tests/test_scheduler_http.py::test_task_page[key18] <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 7%] 6118s http/scheduler/tests/test_scheduler_http.py::test_call_stack_page[1_0] <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 8%] 6118s http/scheduler/tests/test_scheduler_http.py::test_call_stack_page[1_1] <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 8%] 6118s http/scheduler/tests/test_scheduler_http.py::test_call_stack_page[x] <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 8%] 6118s http/scheduler/tests/test_scheduler_http.py::test_call_stack_page[a+b] <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 8%] 6118s http/scheduler/tests/test_scheduler_http.py::test_call_stack_page[a b] <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 8%] 6119s http/scheduler/tests/test_scheduler_http.py::test_call_stack_page[key5] <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 8%] 6119s http/scheduler/tests/test_scheduler_http.py::test_call_stack_page[key6] <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 8%] 6119s http/scheduler/tests/test_scheduler_http.py::test_call_stack_page[key7] <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 8%] 6119s http/scheduler/tests/test_scheduler_http.py::test_call_stack_page[key8] <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 8%] 6119s http/scheduler/tests/test_scheduler_http.py::test_call_stack_page[(] <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 8%] 6119s http/scheduler/tests/test_scheduler_http.py::test_call_stack_page[[] <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 8%] 6119s http/scheduler/tests/test_scheduler_http.py::test_call_stack_page['] <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 8%] 6119s http/scheduler/tests/test_scheduler_http.py::test_call_stack_page["] <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 8%] 6119s http/scheduler/tests/test_scheduler_http.py::test_call_stack_page[123] <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 8%] 6120s http/scheduler/tests/test_scheduler_http.py::test_call_stack_page[key14] <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 8%] 6120s http/scheduler/tests/test_scheduler_http.py::test_call_stack_page[key15] <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 8%] 6120s http/scheduler/tests/test_scheduler_http.py::test_call_stack_page[key16] <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 8%] 6120s http/scheduler/tests/test_scheduler_http.py::test_call_stack_page[key17] <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 8%] 6120s http/scheduler/tests/test_scheduler_http.py::test_call_stack_page[key18] <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 8%] 6120s http/scheduler/tests/test_scheduler_http.py::test_allow_websocket_origin <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py SKIPPED [ 8%] 6120s http/scheduler/tests/test_scheduler_http.py::test_eventstream <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 8%] 6120s http/scheduler/tests/test_scheduler_http.py::test_api_disabled_by_default <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py PASSED [ 8%] 6120s http/scheduler/tests/test_scheduler_http.py::test_api <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py SKIPPED [ 8%] 6120s http/scheduler/tests/test_scheduler_http.py::test_retire_workers <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py SKIPPED [ 8%] 6120s http/scheduler/tests/test_scheduler_http.py::test_get_workers <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py SKIPPED [ 8%] 6120s http/scheduler/tests/test_scheduler_http.py::test_adaptive_target <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py SKIPPED [ 8%] 6120s http/scheduler/tests/test_scheduler_http.py::test_check_idle <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py SKIPPED [ 8%] 6121s http/scheduler/tests/test_semaphore_http.py::test_prometheus <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_semaphore_http.py PASSED [ 8%] 6121s http/scheduler/tests/test_semaphore_http.py::test_prometheus_without_semaphore_extension <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_semaphore_http.py PASSED [ 8%] 6121s http/scheduler/tests/test_stealing_http.py::test_prometheus <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_stealing_http.py PASSED [ 8%] 6121s http/scheduler/tests/test_stealing_http.py::test_prometheus_collect_count_total_by_cost_multipliers <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_stealing_http.py PASSED [ 8%] 6122s http/scheduler/tests/test_stealing_http.py::test_prometheus_collect_cost_total_by_cost_multipliers <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_stealing_http.py PASSED [ 8%] 6122s http/scheduler/tests/test_stealing_http.py::test_prometheus_without_stealing_extension <- ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_stealing_http.py PASSED [ 9%] 6122s http/tests/test_core.py::test_scheduler <- ../../../../usr/lib/python3/dist-packages/distributed/http/tests/test_core.py PASSED [ 9%] 6122s http/tests/test_routing.py::test_basic <- ../../../../usr/lib/python3/dist-packages/distributed/http/tests/test_routing.py PASSED [ 9%] 6122s http/worker/tests/test_worker_http.py::test_prometheus <- ../../../../usr/lib/python3/dist-packages/distributed/http/worker/tests/test_worker_http.py PASSED [ 9%] 6122s http/worker/tests/test_worker_http.py::test_metrics_when_prometheus_client_not_installed <- ../../../../usr/lib/python3/dist-packages/distributed/http/worker/tests/test_worker_http.py PASSED [ 9%] 6122s http/worker/tests/test_worker_http.py::test_prometheus_collect_task_states <- ../../../../usr/lib/python3/dist-packages/distributed/http/worker/tests/test_worker_http.py PASSED [ 9%] 6123s http/worker/tests/test_worker_http.py::test_health <- ../../../../usr/lib/python3/dist-packages/distributed/http/worker/tests/test_worker_http.py SKIPPED [ 9%] 6123s http/worker/tests/test_worker_http.py::test_sitemap <- ../../../../usr/lib/python3/dist-packages/distributed/http/worker/tests/test_worker_http.py SKIPPED [ 9%] 6123s http/worker/tests/test_worker_http.py::test_prometheus_collect_memory_metrics <- ../../../../usr/lib/python3/dist-packages/distributed/http/worker/tests/test_worker_http.py PASSED [ 9%] 6123s http/worker/tests/test_worker_http.py::test_prometheus_collect_memory_metrics_spill_disabled <- ../../../../usr/lib/python3/dist-packages/distributed/http/worker/tests/test_worker_http.py PASSED [ 9%] 6123s http/worker/tests/test_worker_http.py::test_prometheus_collect_memory_metrics_bogus_sizeof <- ../../../../usr/lib/python3/dist-packages/distributed/http/worker/tests/test_worker_http.py SKIPPED [ 9%] 6123s protocol/tests/test_collection.py::test_serialize_collection[y0-dask-tuple] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_collection.py PASSED [ 9%] 6123s protocol/tests/test_collection.py::test_serialize_collection[y0-dask-dict] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_collection.py PASSED [ 9%] 6123s protocol/tests/test_collection.py::test_serialize_collection[y0-dask-list] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_collection.py PASSED [ 9%] 6123s protocol/tests/test_collection.py::test_serialize_collection[y1-pickle-tuple] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_collection.py PASSED [ 9%] 6123s protocol/tests/test_collection.py::test_serialize_collection[y1-pickle-dict] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_collection.py PASSED [ 9%] 6123s protocol/tests/test_collection.py::test_serialize_collection[y1-pickle-list] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_collection.py PASSED [ 9%] 6123s protocol/tests/test_collection.py::test_serialize_collection[None-pickle-tuple] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_collection.py PASSED [ 9%] 6123s protocol/tests/test_collection.py::test_serialize_collection[None-pickle-dict] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_collection.py PASSED [ 9%] 6123s protocol/tests/test_collection.py::test_serialize_collection[None-pickle-list] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_collection.py PASSED [ 9%] 6123s protocol/tests/test_collection.py::test_large_collections_serialize_simply <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_collection.py PASSED [ 9%] 6123s protocol/tests/test_collection.py::test_nested_types <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_collection.py PASSED [ 9%] 6123s protocol/tests/test_collection_cuda.py::test_serialize_cupy[50-cuda-tuple] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_collection_cuda.py SKIPPED [ 9%] 6123s protocol/tests/test_collection_cuda.py::test_serialize_cupy[50-cuda-dict] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_collection_cuda.py SKIPPED [ 9%] 6123s protocol/tests/test_collection_cuda.py::test_serialize_cupy[None-pickle-tuple] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_collection_cuda.py SKIPPED [ 9%] 6123s protocol/tests/test_collection_cuda.py::test_serialize_cupy[None-pickle-dict] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_collection_cuda.py SKIPPED [ 9%] 6123s protocol/tests/test_collection_cuda.py::test_serialize_pandas_pandas[df20-cuda-tuple] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_collection_cuda.py SKIPPED [ 9%] 6123s protocol/tests/test_collection_cuda.py::test_serialize_pandas_pandas[df20-cuda-dict] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_collection_cuda.py SKIPPED [ 9%] 6123s protocol/tests/test_collection_cuda.py::test_serialize_pandas_pandas[None-pickle-tuple] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_collection_cuda.py SKIPPED [ 9%] 6123s protocol/tests/test_collection_cuda.py::test_serialize_pandas_pandas[None-pickle-dict] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_collection_cuda.py SKIPPED [ 9%] 6123s protocol/tests/test_compression.py::test_get_compression_settings <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py PASSED [ 9%] 6123s protocol/tests/test_compression.py::test_auto_compression <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py PASSED [ 9%] 6123s protocol/tests/test_compression.py::test_compression_1 <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py PASSED [ 9%] 6123s protocol/tests/test_compression.py::test_compression_2 <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py PASSED [ 10%] 6123s protocol/tests/test_compression.py::test_compression_3 <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py PASSED [ 10%] 6123s protocol/tests/test_compression.py::test_compression_without_deserialization <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py PASSED [ 10%] 6123s protocol/tests/test_compression.py::test_lz4_decompression_avoids_deep_copy <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py SKIPPED [ 10%] 6123s protocol/tests/test_compression.py::test_maybe_compress[None-bytes] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py PASSED [ 10%] 6123s protocol/tests/test_compression.py::test_maybe_compress[None-memoryview] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py PASSED [ 10%] 6123s protocol/tests/test_compression.py::test_maybe_compress[zlib-bytes] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py PASSED [ 10%] 6123s protocol/tests/test_compression.py::test_maybe_compress[zlib-memoryview] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py PASSED [ 10%] 6123s protocol/tests/test_compression.py::test_maybe_compress[lz4-bytes] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py SKIPPED [ 10%] 6123s protocol/tests/test_compression.py::test_maybe_compress[lz4-memoryview] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py SKIPPED [ 10%] 6123s protocol/tests/test_compression.py::test_maybe_compress[snappy-bytes] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py SKIPPED [ 10%] 6123s protocol/tests/test_compression.py::test_maybe_compress[snappy-memoryview] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py SKIPPED [ 10%] 6123s protocol/tests/test_compression.py::test_maybe_compress[zstd-bytes] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py SKIPPED [ 10%] 6123s protocol/tests/test_compression.py::test_maybe_compress[zstd-memoryview] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py SKIPPED [ 10%] 6123s protocol/tests/test_compression.py::test_maybe_compress_sample[None] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py PASSED [ 10%] 6123s protocol/tests/test_compression.py::test_maybe_compress_sample[zlib] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py PASSED [ 10%] 6123s protocol/tests/test_compression.py::test_maybe_compress_sample[lz4] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py SKIPPED [ 10%] 6123s protocol/tests/test_compression.py::test_maybe_compress_sample[snappy] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py SKIPPED [ 10%] 6123s protocol/tests/test_compression.py::test_maybe_compress_sample[zstd] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py SKIPPED [ 10%] 6123s protocol/tests/test_compression.py::test_maybe_compress_memoryviews[None] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py PASSED [ 10%] 6124s protocol/tests/test_compression.py::test_maybe_compress_memoryviews[zlib] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py PASSED [ 10%] 6124s protocol/tests/test_compression.py::test_maybe_compress_memoryviews[lz4] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py SKIPPED [ 10%] 6124s protocol/tests/test_compression.py::test_maybe_compress_memoryviews[snappy] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py SKIPPED [ 10%] 6124s protocol/tests/test_compression.py::test_maybe_compress_memoryviews[zstd] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py SKIPPED [ 10%] 6124s protocol/tests/test_compression.py::test_maybe_compress_auto <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py PASSED [ 10%] 6124s protocol/tests/test_compression.py::test_compression_thread_safety[None-bytes] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py SKIPPED [ 10%] 6124s protocol/tests/test_compression.py::test_compression_thread_safety[None-memoryview] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py SKIPPED [ 10%] 6124s protocol/tests/test_compression.py::test_compression_thread_safety[zlib-bytes] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py SKIPPED [ 10%] 6124s protocol/tests/test_compression.py::test_compression_thread_safety[zlib-memoryview] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py SKIPPED [ 10%] 6124s protocol/tests/test_compression.py::test_compression_thread_safety[lz4-bytes] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py SKIPPED [ 10%] 6124s protocol/tests/test_compression.py::test_compression_thread_safety[lz4-memoryview] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py SKIPPED [ 10%] 6124s protocol/tests/test_compression.py::test_compression_thread_safety[snappy-bytes] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py SKIPPED [ 10%] 6124s protocol/tests/test_compression.py::test_compression_thread_safety[snappy-memoryview] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py SKIPPED [ 11%] 6124s protocol/tests/test_compression.py::test_compression_thread_safety[zstd-bytes] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py SKIPPED [ 11%] 6124s protocol/tests/test_compression.py::test_compression_thread_safety[zstd-memoryview] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py SKIPPED [ 11%] 6124s protocol/tests/test_compression.py::test_large_messages[None] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py SKIPPED [ 11%] 6124s protocol/tests/test_compression.py::test_large_messages[zlib] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py SKIPPED [ 11%] 6124s protocol/tests/test_compression.py::test_large_messages[lz4] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py SKIPPED [ 11%] 6124s protocol/tests/test_compression.py::test_large_messages[snappy] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py SKIPPED [ 11%] 6124s protocol/tests/test_compression.py::test_large_messages[zstd] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py SKIPPED [ 11%] 6124s protocol/tests/test_compression.py::test_loads_without_deserialization_avoids_compression <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py PASSED [ 11%] 6124s protocol/tests/test_compression.py::test_compress_remote_comms <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py PASSED [ 11%] 6125s protocol/tests/test_compression.py::test_disable_compression_on_localhost[None] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py PASSED [ 11%] 6125s protocol/tests/test_compression.py::test_disable_compression_on_localhost[127.0.0.1] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py PASSED [ 11%] 6125s protocol/tests/test_compression.py::test_disable_compression_on_localhost[localhost] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py PASSED [ 11%] 6125s protocol/tests/test_highlevelgraph.py::test_combo_of_layer_types <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_highlevelgraph.py PASSED [ 11%] 6125s protocol/tests/test_highlevelgraph.py::test_blockwise <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_highlevelgraph.py PASSED [ 11%] 6126s protocol/tests/test_highlevelgraph.py::test_shuffle <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_highlevelgraph.py PASSED [ 11%] 6127s protocol/tests/test_highlevelgraph.py::test_array_annotations <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_highlevelgraph.py PASSED [ 11%] 6127s protocol/tests/test_highlevelgraph.py::test_dataframe_annotations <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_highlevelgraph.py PASSED [ 11%] 6127s protocol/tests/test_numpy.py::test_serialize <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 11%] 6127s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x0] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 11%] 6127s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x1] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 11%] 6127s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x2] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 11%] 6127s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x3] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 11%] 6127s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x4] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 11%] 6127s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x5] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 11%] 6127s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x6] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 11%] 6127s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x7] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 11%] 6127s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x8] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 11%] 6127s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x9] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 11%] 6127s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x10] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 11%] 6127s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x11] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 11%] 6127s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x12] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 11%] 6127s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x13] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 12%] 6127s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x14] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 12%] 6127s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x15] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 12%] 6127s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x16] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 12%] 6127s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x17] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 12%] 6127s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x18] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 12%] 6127s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x19] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 12%] 6127s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x20] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 12%] 6127s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x21] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 12%] 6127s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x22] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 12%] 6127s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x23] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 12%] 6127s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x24] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 12%] 6127s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x25] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 12%] 6127s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x26] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 12%] 6127s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x27] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 12%] 6127s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x28] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 12%] 6127s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x29] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 12%] 6127s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x30] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 12%] 6127s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x31] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 12%] 6127s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x32] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 12%] 6127s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x33] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 12%] 6127s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x34] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 12%] 6127s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x35] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 12%] 6127s protocol/tests/test_numpy.py::test_dumps_serialize_numpy[x36] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 12%] 6127s protocol/tests/test_numpy.py::test_dumps_numpy_writable[True] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 12%] 6127s protocol/tests/test_numpy.py::test_dumps_numpy_writable[False] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 12%] 6127s protocol/tests/test_numpy.py::test_serialize_numpy_ma_masked_array[x0] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 12%] 6127s protocol/tests/test_numpy.py::test_serialize_numpy_ma_masked_array[x1] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 12%] 6127s protocol/tests/test_numpy.py::test_serialize_numpy_ma_masked_array[x2] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 12%] 6127s protocol/tests/test_numpy.py::test_serialize_numpy_ma_masked_array[x3] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 12%] 6127s protocol/tests/test_numpy.py::test_serialize_numpy_ma_masked_array[x4] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 12%] 6127s protocol/tests/test_numpy.py::test_serialize_numpy_ma_masked_array[x5] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 12%] 6127s protocol/tests/test_numpy.py::test_serialize_numpy_ma_masked <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 12%] 6127s protocol/tests/test_numpy.py::test_dumps_serialize_numpy_custom_dtype <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py SKIPPED [ 13%] 6127s protocol/tests/test_numpy.py::test_memmap <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 13%] 6127s protocol/tests/test_numpy.py::test_dumps_serialize_numpy_large <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py SKIPPED [ 13%] 6127s protocol/tests/test_numpy.py::test_itemsize[f8-8] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 13%] 6127s protocol/tests/test_numpy.py::test_itemsize[i4-4] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 13%] 6127s protocol/tests/test_numpy.py::test_itemsize[c16-16] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 13%] 6127s protocol/tests/test_numpy.py::test_itemsize[b-1] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 13%] 6127s protocol/tests/test_numpy.py::test_itemsize[S3-3] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 13%] 6127s protocol/tests/test_numpy.py::test_itemsize[M8[us]-8] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 13%] 6127s protocol/tests/test_numpy.py::test_itemsize[M8[s]-8] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 13%] 6127s protocol/tests/test_numpy.py::test_itemsize[U3-12] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 13%] 6127s protocol/tests/test_numpy.py::test_itemsize[dt8-12] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 13%] 6127s protocol/tests/test_numpy.py::test_itemsize[dt9-4] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 13%] 6127s protocol/tests/test_numpy.py::test_itemsize[dt10-8] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 13%] 6127s protocol/tests/test_numpy.py::test_itemsize[dt11-88] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 13%] 6127s protocol/tests/test_numpy.py::test_itemsize[dt12-8] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 13%] 6128s protocol/tests/test_numpy.py::test_compress_numpy <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 13%] 6128s protocol/tests/test_numpy.py::test_compress_memoryview <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 13%] 6128s protocol/tests/test_numpy.py::test_dumps_large <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 13%] 6128s protocol/tests/test_numpy.py::test_zero_strided_numpy_array[True-x0] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 13%] 6128s protocol/tests/test_numpy.py::test_zero_strided_numpy_array[True-x1] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 13%] 6128s protocol/tests/test_numpy.py::test_zero_strided_numpy_array[True-x2] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 13%] 6128s protocol/tests/test_numpy.py::test_zero_strided_numpy_array[True-x3] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 13%] 6128s protocol/tests/test_numpy.py::test_zero_strided_numpy_array[False-x0] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 13%] 6128s protocol/tests/test_numpy.py::test_zero_strided_numpy_array[False-x1] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 13%] 6128s protocol/tests/test_numpy.py::test_zero_strided_numpy_array[False-x2] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 13%] 6128s protocol/tests/test_numpy.py::test_zero_strided_numpy_array[False-x3] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 13%] 6128s protocol/tests/test_numpy.py::test_non_zero_strided_array <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 13%] 6128s protocol/tests/test_numpy.py::test_serialize_writeable_array_readonly_base_object <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py PASSED [ 13%] 6128s protocol/tests/test_pandas.py::test_dumps_serialize_pandas[df0] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pandas.py PASSED [ 13%] 6128s protocol/tests/test_pandas.py::test_dumps_serialize_pandas[df1] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pandas.py PASSED [ 13%] 6128s protocol/tests/test_pandas.py::test_dumps_serialize_pandas[df2] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pandas.py PASSED [ 13%] 6128s protocol/tests/test_pandas.py::test_dumps_serialize_pandas[df3] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pandas.py PASSED [ 14%] 6128s protocol/tests/test_pandas.py::test_dumps_serialize_pandas[df4] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pandas.py PASSED [ 14%] 6128s protocol/tests/test_pandas.py::test_dumps_serialize_pandas[df5] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pandas.py PASSED [ 14%] 6128s protocol/tests/test_pandas.py::test_dumps_serialize_pandas[df6] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pandas.py PASSED [ 14%] 6128s protocol/tests/test_pandas.py::test_dumps_serialize_pandas[df7] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pandas.py PASSED [ 14%] 6128s protocol/tests/test_pandas.py::test_dumps_serialize_pandas[df8] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pandas.py PASSED [ 14%] 6128s protocol/tests/test_pandas.py::test_dumps_serialize_pandas[df9] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pandas.py PASSED [ 14%] 6128s protocol/tests/test_pandas.py::test_dumps_serialize_pandas[df10] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pandas.py PASSED [ 14%] 6128s protocol/tests/test_pandas.py::test_dumps_serialize_pandas[df11] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pandas.py PASSED [ 14%] 6128s protocol/tests/test_pandas.py::test_dumps_serialize_pandas[df12] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pandas.py PASSED [ 14%] 6128s protocol/tests/test_pandas.py::test_dumps_serialize_pandas[df13] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pandas.py PASSED [ 14%] 6128s protocol/tests/test_pandas.py::test_dumps_serialize_pandas[df14] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pandas.py PASSED [ 14%] 6128s protocol/tests/test_pandas.py::test_dumps_serialize_pandas[df15] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pandas.py PASSED [ 14%] 6128s protocol/tests/test_pandas.py::test_dumps_serialize_pandas[df16] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pandas.py PASSED [ 14%] 6128s protocol/tests/test_pandas.py::test_dumps_serialize_pandas[df17] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pandas.py PASSED [ 14%] 6128s protocol/tests/test_pandas.py::test_dumps_serialize_pandas[df18] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pandas.py PASSED [ 14%] 6128s protocol/tests/test_pandas.py::test_dumps_serialize_pandas[df19] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pandas.py PASSED [ 14%] 6128s protocol/tests/test_pandas.py::test_dumps_serialize_pandas[df20] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pandas.py PASSED [ 14%] 6128s protocol/tests/test_pandas.py::test_dumps_serialize_pandas[df21] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pandas.py PASSED [ 14%] 6128s protocol/tests/test_pandas.py::test_dumps_serialize_pandas[df22] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pandas.py PASSED [ 14%] 6128s protocol/tests/test_pandas.py::test_dumps_serialize_pandas[df23] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pandas.py PASSED [ 14%] 6128s protocol/tests/test_pandas.py::test_dumps_serialize_pandas[df24] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pandas.py PASSED [ 14%] 6128s protocol/tests/test_pandas.py::test_dumps_serialize_pandas[df25] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pandas.py PASSED [ 14%] 6128s protocol/tests/test_pandas.py::test_dumps_pandas_writable <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pandas.py PASSED [ 14%] 6128s protocol/tests/test_pickle.py::test_pickle_data[4] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pickle.py PASSED [ 14%] 6128s protocol/tests/test_pickle.py::test_pickle_data[5] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pickle.py PASSED [ 14%] 6128s protocol/tests/test_pickle.py::test_pickle_out_of_band[4] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pickle.py PASSED [ 14%] 6128s protocol/tests/test_pickle.py::test_pickle_out_of_band[5] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pickle.py PASSED [ 14%] 6128s protocol/tests/test_pickle.py::test_pickle_empty[4] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pickle.py PASSED [ 14%] 6128s protocol/tests/test_pickle.py::test_pickle_empty[5] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pickle.py PASSED [ 14%] 6128s protocol/tests/test_pickle.py::test_pickle_numpy[4] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pickle.py PASSED [ 14%] 6128s protocol/tests/test_pickle.py::test_pickle_numpy[5] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pickle.py PASSED [ 14%] 6128s protocol/tests/test_pickle.py::test_pickle_functions[4] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pickle.py PASSED [ 15%] 6128s protocol/tests/test_pickle.py::test_pickle_functions[5] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pickle.py PASSED [ 15%] 6128s protocol/tests/test_pickle.py::test_pickle_by_value_when_registered <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pickle.py PASSED [ 15%] 6128s protocol/tests/test_pickle.py::test_allow_pickle_if_registered_in_dask_serialize <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pickle.py PASSED [ 15%] 6128s protocol/tests/test_pickle.py::test_nopickle_nested <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pickle.py PASSED [ 15%] 6128s protocol/tests/test_pickle.py::test_pickle_functions_in_main <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pickle.py SKIPPED [ 15%] 6128s protocol/tests/test_pickle.py::test_pickle_zero_copy_read_only_flag[dask] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pickle.py PASSED [ 15%] 6128s protocol/tests/test_pickle.py::test_pickle_zero_copy_read_only_flag[pickle] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pickle.py PASSED [ 15%] 6128s protocol/tests/test_protocol.py::test_protocol <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol.py PASSED [ 15%] 6128s protocol/tests/test_protocol.py::test_small <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol.py PASSED [ 15%] 6128s protocol/tests/test_protocol.py::test_small_and_big <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol.py PASSED [ 15%] 6128s protocol/tests/test_protocol.py::test_large_bytes[bytes] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol.py PASSED [ 15%] 6128s protocol/tests/test_protocol.py::test_large_bytes[memoryview] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol.py PASSED [ 15%] 6129s protocol/tests/test_protocol.py::test_large_messages_map <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol.py PASSED [ 15%] 6129s protocol/tests/test_protocol.py::test_loads_deserialize_False <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol.py PASSED [ 15%] 6129s protocol/tests/test_protocol.py::test_dumps_loads_Serialize <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol.py PASSED [ 15%] 6129s protocol/tests/test_protocol.py::test_dumps_loads_Serialized <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol.py PASSED [ 15%] 6129s protocol/tests/test_protocol.py::test_preserve_header[serializers0] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol.py PASSED [ 15%] 6129s protocol/tests/test_protocol.py::test_preserve_header[serializers1] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol.py PASSED [ 15%] 6129s protocol/tests/test_protocol.py::test_sizeof_serialize[Serialize-Serialized0] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol.py PASSED [ 15%] 6129s protocol/tests/test_protocol.py::test_sizeof_serialize[Serialize-Serialized1] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol.py PASSED [ 15%] 6129s protocol/tests/test_protocol.py::test_sizeof_serialize[ToPickle-Pickled] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol.py PASSED [ 15%] 6129s protocol/tests/test_protocol.py::test_fallback_to_pickle <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol.py PASSED [ 15%] 6129s protocol/tests/test_protocol.py::test_large_payload[bytes] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol.py SKIPPED [ 15%] 6129s protocol/tests/test_protocol.py::test_large_payload[str] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol.py SKIPPED [ 15%] 6129s protocol/tests/test_protocol.py::test_large_payload[ext] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol.py SKIPPED [ 15%] 6129s protocol/tests/test_protocol_utils.py::test_pack_frames <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol_utils.py PASSED [ 15%] 6129s protocol/tests/test_protocol_utils.py::test_unpack_frames_remainder[456] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol_utils.py PASSED [ 15%] 6129s protocol/tests/test_protocol_utils.py::test_unpack_frames_remainder[] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol_utils.py PASSED [ 15%] 6129s protocol/tests/test_protocol_utils.py::test_unpack_frames_partial <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol_utils.py PASSED [ 15%] 6129s protocol/tests/test_protocol_utils.py::TestMergeMemroyviews::test_empty <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol_utils.py PASSED [ 15%] 6129s protocol/tests/test_protocol_utils.py::TestMergeMemroyviews::test_one <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol_utils.py PASSED [ 15%] 6129s protocol/tests/test_protocol_utils.py::TestMergeMemroyviews::test_parts[slices0] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol_utils.py PASSED [ 15%] 6129s protocol/tests/test_protocol_utils.py::TestMergeMemroyviews::test_parts[slices1] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol_utils.py PASSED [ 16%] 6129s protocol/tests/test_protocol_utils.py::TestMergeMemroyviews::test_parts[slices2] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol_utils.py PASSED [ 16%] 6129s protocol/tests/test_protocol_utils.py::TestMergeMemroyviews::test_parts[slices3] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol_utils.py PASSED [ 16%] 6129s protocol/tests/test_protocol_utils.py::TestMergeMemroyviews::test_parts[slices4] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol_utils.py PASSED [ 16%] 6129s protocol/tests/test_protocol_utils.py::TestMergeMemroyviews::test_parts[slices5] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol_utils.py PASSED [ 16%] 6129s protocol/tests/test_protocol_utils.py::TestMergeMemroyviews::test_parts[slices6] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol_utils.py PASSED [ 16%] 6129s protocol/tests/test_protocol_utils.py::TestMergeMemroyviews::test_parts[slices7] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol_utils.py PASSED [ 16%] 6129s protocol/tests/test_protocol_utils.py::TestMergeMemroyviews::test_parts[slices8] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol_utils.py PASSED [ 16%] 6129s protocol/tests/test_protocol_utils.py::TestMergeMemroyviews::test_parts[slices9] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol_utils.py PASSED [ 16%] 6129s protocol/tests/test_protocol_utils.py::TestMergeMemroyviews::test_readonly_buffer <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol_utils.py PASSED [ 16%] 6129s protocol/tests/test_protocol_utils.py::TestMergeMemroyviews::test_catch_non_memoryview <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol_utils.py PASSED [ 16%] 6129s protocol/tests/test_protocol_utils.py::TestMergeMemroyviews::test_catch_gaps[slices0] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol_utils.py PASSED [ 16%] 6129s protocol/tests/test_protocol_utils.py::TestMergeMemroyviews::test_catch_gaps[slices1] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol_utils.py PASSED [ 16%] 6129s protocol/tests/test_protocol_utils.py::TestMergeMemroyviews::test_catch_gaps[slices2] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol_utils.py PASSED [ 16%] 6129s protocol/tests/test_protocol_utils.py::TestMergeMemroyviews::test_catch_different_buffer <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol_utils.py PASSED [ 16%] 6129s protocol/tests/test_protocol_utils.py::TestMergeMemroyviews::test_catch_different_non_contiguous <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol_utils.py PASSED [ 16%] 6129s protocol/tests/test_protocol_utils.py::TestMergeMemroyviews::test_catch_multidimensional <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol_utils.py PASSED [ 16%] 6129s protocol/tests/test_protocol_utils.py::TestMergeMemroyviews::test_catch_different_formats <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol_utils.py PASSED [ 16%] 6129s protocol/tests/test_serialize.py::test_dumps_serialize <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 16%] 6129s protocol/tests/test_serialize.py::test_serialize_bytestrings <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 16%] 6129s protocol/tests/test_serialize.py::test_serialize_empty_array <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 16%] 6129s protocol/tests/test_serialize.py::test_serialize_arrays[b] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 16%] 6129s protocol/tests/test_serialize.py::test_serialize_arrays[B] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 16%] 6129s protocol/tests/test_serialize.py::test_serialize_arrays[h] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 16%] 6129s protocol/tests/test_serialize.py::test_serialize_arrays[H] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 16%] 6129s protocol/tests/test_serialize.py::test_serialize_arrays[i] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 16%] 6129s protocol/tests/test_serialize.py::test_serialize_arrays[I] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 16%] 6129s protocol/tests/test_serialize.py::test_serialize_arrays[l] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 16%] 6129s protocol/tests/test_serialize.py::test_serialize_arrays[L] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 16%] 6129s protocol/tests/test_serialize.py::test_serialize_arrays[q] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 16%] 6129s protocol/tests/test_serialize.py::test_serialize_arrays[Q] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 16%] 6129s protocol/tests/test_serialize.py::test_serialize_arrays[f] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 16%] 6129s protocol/tests/test_serialize.py::test_serialize_arrays[d] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 17%] 6129s protocol/tests/test_serialize.py::test_Serialize <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 17%] 6129s protocol/tests/test_serialize.py::test_Serialized <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 17%] 6129s protocol/tests/test_serialize.py::test_nested_deserialize <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 17%] 6129s protocol/tests/test_serialize.py::test_serialize_iterate_collection <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 17%] 6129s protocol/tests/test_serialize.py::test_object_in_graph <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 17%] 6129s protocol/tests/test_serialize.py::test_scatter <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 17%] 6129s protocol/tests/test_serialize.py::test_inter_worker_comms <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 17%] 6129s protocol/tests/test_serialize.py::test_empty <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 17%] 6129s protocol/tests/test_serialize.py::test_empty_loads <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 17%] 6129s protocol/tests/test_serialize.py::test_empty_loads_deep <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 17%] 6130s protocol/tests/test_serialize.py::test_serialize_bytes[kwargs0] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 17%] 6132s protocol/tests/test_serialize.py::test_serialize_bytes[kwargs1] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 17%] 6132s protocol/tests/test_serialize.py::test_serialize_bytes_numpy[kwargs0] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 17%] 6132s protocol/tests/test_serialize.py::test_serialize_bytes_numpy[kwargs1] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 17%] 6132s protocol/tests/test_serialize.py::test_deserialize_bytes_zero_copy_read_only <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 17%] 6132s protocol/tests/test_serialize.py::test_deserialize_bytes_zero_copy_writeable <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 17%] 6132s protocol/tests/test_serialize.py::test_serialize_list_compress <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 17%] 6132s protocol/tests/test_serialize.py::test_malicious_exception <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 17%] 6132s protocol/tests/test_serialize.py::test_err_on_bad_deserializer <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 17%] 6132s protocol/tests/test_serialize.py::test_context_specific_serialization <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 17%] 6132s protocol/tests/test_serialize.py::test_context_specific_serialization_class <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 17%] 6132s protocol/tests/test_serialize.py::test_serialize_raises <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 17%] 6132s protocol/tests/test_serialize.py::test_different_compression_families <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 17%] 6132s protocol/tests/test_serialize.py::test_frame_split <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 17%] 6132s protocol/tests/test_serialize.py::test_check_dask_serializable[data0-False] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 17%] 6132s protocol/tests/test_serialize.py::test_check_dask_serializable[data1-False] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 17%] 6132s protocol/tests/test_serialize.py::test_check_dask_serializable[data2-False] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 17%] 6132s protocol/tests/test_serialize.py::test_check_dask_serializable[data3-False] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 17%] 6132s protocol/tests/test_serialize.py::test_check_dask_serializable[data4-False] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 17%] 6132s protocol/tests/test_serialize.py::test_check_dask_serializable[data5-True] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 17%] 6132s protocol/tests/test_serialize.py::test_check_dask_serializable[data6-True] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 17%] 6133s protocol/tests/test_serialize.py::test_check_dask_serializable[data7-True] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py XFAIL [ 18%] 6133s protocol/tests/test_serialize.py::test_check_dask_serializable[data8-True] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 18%] 6133s protocol/tests/test_serialize.py::test_check_dask_serializable[data9-True] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 18%] 6133s protocol/tests/test_serialize.py::test_check_dask_serializable[data10-True] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 18%] 6133s protocol/tests/test_serialize.py::test_check_dask_serializable[data11-True] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 18%] 6133s protocol/tests/test_serialize.py::test_check_dask_serializable[data12-True] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 18%] 6133s protocol/tests/test_serialize.py::test_serialize_lists[serializers0] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 18%] 6133s protocol/tests/test_serialize.py::test_serialize_lists[serializers1] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 18%] 6133s protocol/tests/test_serialize.py::test_serialize_lists[serializers2] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 18%] 6133s protocol/tests/test_serialize.py::test_serialize_lists[serializers3] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 18%] 6133s protocol/tests/test_serialize.py::test_deser_memoryview[data_in0] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 18%] 6133s protocol/tests/test_serialize.py::test_deser_memoryview[data_in1] <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 18%] 6133s protocol/tests/test_serialize.py::test_ser_memoryview_object <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 18%] 6133s protocol/tests/test_serialize.py::test_ser_empty_1d_memoryview <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 18%] 6133s protocol/tests/test_serialize.py::test_ser_empty_nd_memoryview <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 18%] 6135s protocol/tests/test_serialize.py::test_large_pickled_object <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 18%] 6135s protocol/tests/test_serialize.py::test__is_msgpack_serializable <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_serialize.py PASSED [ 18%] 6135s protocol/tests/test_to_pickle.py::test_ToPickle <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_to_pickle.py PASSED [ 18%] 6135s protocol/tests/test_utils.py::test_host_array <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_utils.py PASSED [ 18%] 6135s protocol/tests/test_utils.py::test_host_array_from_buffers <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_utils.py PASSED [ 18%] 6135s protocol/tests/test_utils.py::test_host_array_from_buffers_numpy <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_utils.py PASSED [ 18%] 6135s protocol/tests/test_utils_test.py::test_get_host_array <- ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_utils_test.py PASSED [ 18%] 6136s shuffle/tests/test_buffer.py::test_memory_limit[big_payloads0] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_buffer.py PASSED [ 18%] 6136s shuffle/tests/test_buffer.py::test_memory_limit[big_payloads1] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_buffer.py PASSED [ 18%] 6137s shuffle/tests/test_buffer.py::test_memory_limit[big_payloads2] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_buffer.py PASSED [ 18%] 6137s shuffle/tests/test_buffer.py::test_memory_limit[big_payloads3] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_buffer.py PASSED [ 18%] 6137s shuffle/tests/test_buffer.py::test_memory_limit_blocked_exception <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_buffer.py PASSED [ 18%] 6137s shuffle/tests/test_comm_buffer.py::test_basic <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_comm_buffer.py PASSED [ 18%] 6137s shuffle/tests/test_comm_buffer.py::test_exceptions <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_comm_buffer.py PASSED [ 18%] 6137s shuffle/tests/test_comm_buffer.py::test_slow_send <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_comm_buffer.py PASSED [ 18%] 6137s shuffle/tests/test_comm_buffer.py::test_concurrent_puts <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_comm_buffer.py PASSED [ 18%] 6137s shuffle/tests/test_comm_buffer.py::test_concurrent_puts_error <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_comm_buffer.py PASSED [ 18%] 6137s shuffle/tests/test_core.py::test_mean_shard_size <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_core.py PASSED [ 18%] 6137s shuffle/tests/test_core.py::test_mean_shard_size_numpy <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_core.py PASSED [ 19%] 6137s shuffle/tests/test_disk_buffer.py::test_basic <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_disk_buffer.py PASSED [ 19%] 6137s shuffle/tests/test_disk_buffer.py::test_read_before_flush <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_disk_buffer.py PASSED [ 19%] 6137s shuffle/tests/test_disk_buffer.py::test_many[2] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_disk_buffer.py PASSED [ 19%] 6138s shuffle/tests/test_disk_buffer.py::test_many[100] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_disk_buffer.py PASSED [ 19%] 6138s shuffle/tests/test_disk_buffer.py::test_many[1000] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_disk_buffer.py PASSED [ 19%] 6138s shuffle/tests/test_disk_buffer.py::test_exceptions <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_disk_buffer.py PASSED [ 19%] 6138s shuffle/tests/test_disk_buffer.py::test_high_pressure_flush_with_exception <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_disk_buffer.py PASSED [ 19%] 6139s shuffle/tests/test_limiter.py::test_limiter_basic <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_limiter.py PASSED [ 19%] 6139s shuffle/tests/test_limiter.py::test_unlimited_limiter <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_limiter.py PASSED [ 19%] 6139s shuffle/tests/test_limiter.py::test_limiter_concurrent_decrease_releases_waiter <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_limiter.py PASSED [ 19%] 6139s shuffle/tests/test_limiter.py::test_limiter_statistics <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_limiter.py PASSED [ 19%] 6139s shuffle/tests/test_limiter.py::test_limiter_no_limit_no_statistics <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_limiter.py PASSED [ 19%] 6139s shuffle/tests/test_memory_buffer.py::test_basic <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_memory_buffer.py PASSED [ 19%] 6139s shuffle/tests/test_memory_buffer.py::test_read_before_flush <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_memory_buffer.py PASSED [ 19%] 6139s shuffle/tests/test_memory_buffer.py::test_many[2] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_memory_buffer.py PASSED [ 19%] 6139s shuffle/tests/test_memory_buffer.py::test_many[100] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_memory_buffer.py PASSED [ 19%] 6139s shuffle/tests/test_memory_buffer.py::test_many[1000] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_memory_buffer.py PASSED [ 19%] 6139s shuffle/tests/test_pickle.py::test_pickle <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_pickle.py PASSED [ 19%] 6139s shuffle/tests/test_pickle.py::test_pickle_numpy <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_pickle.py PASSED [ 19%] 6139s shuffle/tests/test_pickle.py::test_pickle_zero_copy <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_pickle.py PASSED [ 19%] 6139s shuffle/tests/test_read_write_lock.py::test_basic <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_read_write_lock.py PASSED [ 19%] 6139s shuffle/tests/test_read_write_lock.py::test_lock_timeout <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_read_write_lock.py PASSED [ 19%] 6139s shuffle/tests/test_read_write_lock.py::test_concurrent_reads_are_allowed <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_read_write_lock.py PASSED [ 19%] 6139s shuffle/tests/test_read_write_lock.py::test_read_blocks_write <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_read_write_lock.py PASSED [ 19%] 6139s shuffle/tests/test_read_write_lock.py::test_write_blocks_read <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_read_write_lock.py PASSED [ 19%] 6139s shuffle/tests/test_read_write_lock.py::test_write_blocks_write <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_read_write_lock.py PASSED [ 19%] 6140s shuffle/tests/test_read_write_lock.py::test_write_preferred_over_read <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_read_write_lock.py PASSED [ 19%] 6140s shuffle/tests/test_rechunk.py::test_lowlevel_rechunk[True-True-1] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 19%] 6140s shuffle/tests/test_rechunk.py::test_lowlevel_rechunk[True-True-10] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 19%] 6140s shuffle/tests/test_rechunk.py::test_lowlevel_rechunk[True-False-1] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 19%] 6140s shuffle/tests/test_rechunk.py::test_lowlevel_rechunk[True-False-10] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 19%] 6140s shuffle/tests/test_rechunk.py::test_lowlevel_rechunk[False-True-1] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 20%] 6140s shuffle/tests/test_rechunk.py::test_lowlevel_rechunk[False-True-10] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 20%] 6140s shuffle/tests/test_rechunk.py::test_lowlevel_rechunk[False-False-1] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 20%] 6140s shuffle/tests/test_rechunk.py::test_lowlevel_rechunk[False-False-10] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 20%] 6141s shuffle/tests/test_rechunk.py::test_rechunk_configuration[tasks-tasks] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 20%] 6141s shuffle/tests/test_rechunk.py::test_rechunk_configuration[tasks-p2p] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 20%] 6141s shuffle/tests/test_rechunk.py::test_rechunk_configuration[tasks-None] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 20%] 6141s shuffle/tests/test_rechunk.py::test_rechunk_configuration[p2p-tasks] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 20%] 6142s shuffle/tests/test_rechunk.py::test_rechunk_configuration[p2p-p2p] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 20%] 6142s shuffle/tests/test_rechunk.py::test_rechunk_configuration[p2p-None] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 20%] 6142s shuffle/tests/test_rechunk.py::test_rechunk_configuration[None-tasks] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 20%] 6142s shuffle/tests/test_rechunk.py::test_rechunk_configuration[None-p2p] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 20%] 6143s shuffle/tests/test_rechunk.py::test_rechunk_configuration[None-None] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 20%] 6144s shuffle/tests/test_rechunk.py::test_rechunk_heuristic[new0-p2p] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 20%] 6145s shuffle/tests/test_rechunk.py::test_rechunk_heuristic[new1-tasks] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 20%] 6147s shuffle/tests/test_rechunk.py::test_rechunk_heuristic[new2-tasks] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 20%] 6149s shuffle/tests/test_rechunk.py::test_rechunk_heuristic[new3-p2p] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 20%] 6149s shuffle/tests/test_rechunk.py::test_cull_p2p_rechunk_independent_partitions <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 20%] 6149s shuffle/tests/test_rechunk.py::test_cull_p2p_rechunking_single_chunk <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 20%] 6150s shuffle/tests/test_rechunk.py::test_cull_p2p_rechunk_overlapping_partitions <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 20%] 6150s shuffle/tests/test_rechunk.py::test_rechunk_2d[True] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 20%] 6150s shuffle/tests/test_rechunk.py::test_rechunk_2d[False] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 20%] 6150s shuffle/tests/test_rechunk.py::test_rechunk_4d[True] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 20%] 6150s shuffle/tests/test_rechunk.py::test_rechunk_4d[False] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 20%] 6151s shuffle/tests/test_rechunk.py::test_rechunk_expand <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 20%] 6151s shuffle/tests/test_rechunk.py::test_rechunk_expand2 <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 20%] 6157s shuffle/tests/test_rechunk.py::test_rechunk_method <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 20%] 6157s shuffle/tests/test_rechunk.py::test_rechunk_blockshape <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 20%] 6157s shuffle/tests/test_rechunk.py::test_dtype <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 20%] 6158s shuffle/tests/test_rechunk.py::test_rechunk_with_dict <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 20%] 6158s shuffle/tests/test_rechunk.py::test_rechunk_with_empty_input <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 20%] 6158s shuffle/tests/test_rechunk.py::test_rechunk_with_null_dimensions <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 20%] 6158s shuffle/tests/test_rechunk.py::test_rechunk_with_integer <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 21%] 6158s shuffle/tests/test_rechunk.py::test_rechunk_0d <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 21%] 6158s shuffle/tests/test_rechunk.py::test_rechunk_empty_array[arr0] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 21%] 6158s shuffle/tests/test_rechunk.py::test_rechunk_empty_array[arr1] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 21%] 6158s shuffle/tests/test_rechunk.py::test_rechunk_empty_array[arr2] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 21%] 6158s shuffle/tests/test_rechunk.py::test_rechunk_empty <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 21%] 6159s shuffle/tests/test_rechunk.py::test_rechunk_zero_dim_array <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 21%] 6159s shuffle/tests/test_rechunk.py::test_rechunk_zero_dim_array_II <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 21%] 6159s shuffle/tests/test_rechunk.py::test_rechunk_same <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 21%] 6159s shuffle/tests/test_rechunk.py::test_rechunk_same_fully_unknown <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 21%] 6159s shuffle/tests/test_rechunk.py::test_rechunk_same_fully_unknown_floats <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 21%] 6159s shuffle/tests/test_rechunk.py::test_rechunk_same_partially_unknown <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 21%] 6159s shuffle/tests/test_rechunk.py::test_rechunk_with_zero_placeholders <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 21%] 6159s shuffle/tests/test_rechunk.py::test_rechunk_minus_one <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 21%] 6160s shuffle/tests/test_rechunk.py::test_rechunk_warning <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 21%] 6160s shuffle/tests/test_rechunk.py::test_rechunk_unknown_from_pandas <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 21%] 6160s shuffle/tests/test_rechunk.py::test_rechunk_unknown_from_array <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 21%] 6160s shuffle/tests/test_rechunk.py::test_rechunk_with_fully_unknown_dimension[x0-chunks0] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 21%] 6161s shuffle/tests/test_rechunk.py::test_rechunk_with_fully_unknown_dimension[x1-chunks1] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 21%] 6161s shuffle/tests/test_rechunk.py::test_rechunk_with_fully_unknown_dimension[x2-chunks2] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 21%] 6163s shuffle/tests/test_rechunk.py::test_rechunk_with_fully_unknown_dimension[x3-chunks3] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 21%] 6165s shuffle/tests/test_rechunk.py::test_rechunk_with_fully_unknown_dimension[x4-chunks4] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 21%] 6167s shuffle/tests/test_rechunk.py::test_rechunk_with_fully_unknown_dimension[x5-chunks5] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 21%] 6168s shuffle/tests/test_rechunk.py::test_rechunk_with_fully_unknown_dimension[x6-chunks6] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 21%] 6168s shuffle/tests/test_rechunk.py::test_rechunk_with_fully_unknown_dimension[x7-chunks7] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 21%] 6168s shuffle/tests/test_rechunk.py::test_rechunk_with_fully_unknown_dimension[x8-chunks8] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 21%] 6169s shuffle/tests/test_rechunk.py::test_rechunk_with_fully_unknown_dimension[x9-chunks9] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 21%] 6169s shuffle/tests/test_rechunk.py::test_rechunk_with_fully_unknown_dimension[x10-chunks10] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 21%] 6169s shuffle/tests/test_rechunk.py::test_rechunk_with_fully_unknown_dimension[x11-chunks11] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 21%] 6170s shuffle/tests/test_rechunk.py::test_rechunk_with_partially_unknown_dimension[x0-chunks0] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 21%] 6170s shuffle/tests/test_rechunk.py::test_rechunk_with_partially_unknown_dimension[x1-chunks1] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 21%] 6171s shuffle/tests/test_rechunk.py::test_rechunk_with_partially_unknown_dimension[x2-chunks2] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 21%] 6177s shuffle/tests/test_rechunk.py::test_rechunk_with_partially_unknown_dimension[x3-chunks3] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 21%] 6181s shuffle/tests/test_rechunk.py::test_rechunk_with_partially_unknown_dimension[x4-chunks4] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 22%] 6186s shuffle/tests/test_rechunk.py::test_rechunk_with_partially_unknown_dimension[x5-chunks5] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 22%] 6187s shuffle/tests/test_rechunk.py::test_rechunk_with_partially_unknown_dimension[x6-chunks6] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 22%] 6187s shuffle/tests/test_rechunk.py::test_rechunk_with_partially_unknown_dimension[x7-chunks7] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 22%] 6188s shuffle/tests/test_rechunk.py::test_rechunk_with_partially_unknown_dimension[x8-chunks8] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 22%] 6188s shuffle/tests/test_rechunk.py::test_rechunk_with_partially_unknown_dimension[x9-chunks9] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 22%] 6189s shuffle/tests/test_rechunk.py::test_rechunk_with_partially_unknown_dimension[x10-chunks10] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 22%] 6189s shuffle/tests/test_rechunk.py::test_rechunk_with_partially_unknown_dimension[x11-chunks11] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 22%] 6190s shuffle/tests/test_rechunk.py::test_rechunk_with_fully_unknown_dimension_explicit[new_chunks0] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 22%] 6190s shuffle/tests/test_rechunk.py::test_rechunk_with_fully_unknown_dimension_explicit[new_chunks1] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 22%] 6191s shuffle/tests/test_rechunk.py::test_rechunk_with_fully_unknown_dimension_explicit[new_chunks2] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 22%] 6191s shuffle/tests/test_rechunk.py::test_rechunk_unknown_raises <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 22%] 6191s shuffle/tests/test_rechunk.py::test_rechunk_zero_dim <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 22%] 6192s shuffle/tests/test_rechunk.py::test_rechunk_empty_chunks <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 22%] 6192s shuffle/tests/test_rechunk.py::test_rechunk_avoid_needless_chunking <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 22%] 6192s shuffle/tests/test_rechunk.py::test_rechunk_auto_1d[100-1-10-expected0] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 22%] 6192s shuffle/tests/test_rechunk.py::test_rechunk_auto_1d[100-50-10-expected1] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 22%] 6192s shuffle/tests/test_rechunk.py::test_rechunk_auto_1d[100-100-10-expected2] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 22%] 6192s shuffle/tests/test_rechunk.py::test_rechunk_auto_1d[20-7-10-expected3] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 22%] 6192s shuffle/tests/test_rechunk.py::test_rechunk_auto_1d[20-chunks4-5-expected4] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 22%] 6192s shuffle/tests/test_rechunk.py::test_rechunk_auto_2d <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 22%] 6193s shuffle/tests/test_rechunk.py::test_rechunk_auto_3d <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 22%] 6193s shuffle/tests/test_rechunk.py::test_rechunk_auto_image_stack[100] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 22%] 6193s shuffle/tests/test_rechunk.py::test_rechunk_auto_image_stack[1000] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 22%] 6193s shuffle/tests/test_rechunk.py::test_rechunk_down <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 22%] 6193s shuffle/tests/test_rechunk.py::test_rechunk_zero <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 22%] 6193s shuffle/tests/test_rechunk.py::test_rechunk_bad_keys <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 22%] 6193s shuffle/tests/test_rechunk.py::test_rechunk_with_zero <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 22%] 6193s shuffle/tests/test_rechunk.py::test_split_axes_1 <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 22%] 6193s shuffle/tests/test_rechunk.py::test_split_axes_2 <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 22%] 6193s shuffle/tests/test_rechunk.py::test_split_axes_nan <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 22%] 6193s shuffle/tests/test_rechunk.py::test_split_axes_nan_single <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 22%] 6193s shuffle/tests/test_rechunk.py::test_split_axes_nan_long <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 23%] 6193s shuffle/tests/test_rechunk.py::test_split_axes_with_nonzero <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 23%] 6193s shuffle/tests/test_rechunk.py::test_split_axes_with_zero <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 23%] 6194s shuffle/tests/test_rechunk.py::test_preserve_writeable_flag <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 23%] 6194s shuffle/tests/test_rechunk.py::test_rechunk_in_memory_shards_dont_share_buffer <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 23%] 6194s shuffle/tests/test_rechunk.py::test_pick_worker_homogeneous_distribution[1] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 23%] 6194s shuffle/tests/test_rechunk.py::test_pick_worker_homogeneous_distribution[2] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 23%] 6194s shuffle/tests/test_rechunk.py::test_pick_worker_homogeneous_distribution[41] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 23%] 6194s shuffle/tests/test_rechunk.py::test_pick_worker_homogeneous_distribution[50] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 23%] 6194s shuffle/tests/test_rechunk.py::test_partial_rechunk_homogeneous_distribution <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py SKIPPED [ 23%] 6194s shuffle/tests/test_rechunk.py::test_partial_rechunk_taskgroups <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 23%] 6194s shuffle/tests/test_rechunk.py::test_calculate_prechunking_1d[old0-new0-expected0] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 23%] 6194s shuffle/tests/test_rechunk.py::test_calculate_prechunking_1d[old1-new1-expected1] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 23%] 6194s shuffle/tests/test_rechunk.py::test_calculate_prechunking_1d[old2-new2-expected2] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 23%] 6194s shuffle/tests/test_rechunk.py::test_calculate_prechunking_1d[old3-new3-expected3] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 23%] 6194s shuffle/tests/test_rechunk.py::test_calculate_prechunking_1d[old4-new4-expected4] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 23%] 6194s shuffle/tests/test_rechunk.py::test_calculate_prechunking_2d[old0-new0-expected0] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 23%] 6194s shuffle/tests/test_rechunk.py::test_calculate_prechunking_2d[old1-new1-expected1] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 23%] 6194s shuffle/tests/test_rechunk.py::test_calculate_prechunking_2d[old2-new2-expected2] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 23%] 6194s shuffle/tests/test_rechunk.py::test_calculate_prechunking_2d[old3-new3-expected3] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 23%] 6194s shuffle/tests/test_rechunk.py::test_calculate_prechunking_2d[old4-new4-expected4] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 23%] 6194s shuffle/tests/test_rechunk.py::test_calculate_prechunking_2d[old5-new5-expected5] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 23%] 6194s shuffle/tests/test_rechunk.py::test_calculate_prechunking_3d[old0-new0-expected0] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 23%] 6194s shuffle/tests/test_rechunk.py::test_calculate_prechunking_3d[old1-new1-expected1] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 23%] 6194s shuffle/tests/test_rechunk.py::test_calculate_prechunking_3d[old2-new2-expected2] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 23%] 6194s shuffle/tests/test_rechunk.py::test_calculate_prechunking_3d[old3-new3-expected3] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 23%] 6194s shuffle/tests/test_rechunk.py::test_calculate_prechunking_concatenation[1 B-expected0] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 23%] 6194s shuffle/tests/test_rechunk.py::test_calculate_prechunking_concatenation[20 B-expected1] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 23%] 6194s shuffle/tests/test_rechunk.py::test_calculate_prechunking_concatenation[40 B-expected2] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 23%] 6194s shuffle/tests/test_rechunk.py::test_calculate_prechunking_concatenation[100 B-expected3] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 23%] 6194s shuffle/tests/test_rechunk.py::test_calculate_prechunking_does_not_concatenate_object_type <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 23%] 6194s shuffle/tests/test_rechunk.py::test_calculate_prechunking_splitting[old0-new0-expected0] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 23%] 6194s shuffle/tests/test_rechunk.py::test_calculate_prechunking_splitting[old1-new1-expected1] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 24%] 6194s shuffle/tests/test_rechunk.py::test_calculate_prechunking_splitting[old2-new2-expected2] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 24%] 6199s shuffle/tests/test_rechunk.py::test_homogeneously_schedule_unpack <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 24%] 6200s shuffle/tests/test_rechunk.py::test_rechunk_datetime[tasks] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 24%] 6200s shuffle/tests/test_rechunk.py::test_rechunk_datetime[p2p] <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py PASSED [ 24%] 6200s shuffle/tests/test_shuffle_plugins.py::test_installation_on_worker <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_shuffle_plugins.py PASSED [ 24%] 6200s shuffle/tests/test_shuffle_plugins.py::test_installation_on_scheduler <- ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_shuffle_plugins.py PASSED [ 24%] 6200s tests/test_active_memory_manager.py::test_no_policies <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 24%] 6201s tests/test_active_memory_manager.py::test_drop <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 24%] 6202s tests/test_active_memory_manager.py::test_start_stop <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 24%] 6202s tests/test_active_memory_manager.py::test_auto_start <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 24%] 6202s tests/test_active_memory_manager.py::test_add_policy <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 24%] 6203s tests/test_active_memory_manager.py::test_multi_start <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 24%] 6203s tests/test_active_memory_manager.py::test_not_registered <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 24%] 6205s tests/test_active_memory_manager.py::test_client_proxy_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 24%] 6205s tests/test_active_memory_manager.py::test_client_proxy_async <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 24%] 6205s tests/test_active_memory_manager.py::test_drop_not_in_memory <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 24%] 6206s tests/test_active_memory_manager.py::test_drop_with_waiter <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 24%] 6206s tests/test_active_memory_manager.py::test_double_drop <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 24%] 6207s tests/test_active_memory_manager.py::test_double_drop_stress <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 24%] 6207s tests/test_active_memory_manager.py::test_drop_from_worker_with_least_free_memory <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 24%] 6207s tests/test_active_memory_manager.py::test_drop_with_candidates <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 24%] 6208s tests/test_active_memory_manager.py::test_drop_with_empty_candidates <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 24%] 6208s tests/test_active_memory_manager.py::test_drop_from_candidates_without_key <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 24%] 6209s tests/test_active_memory_manager.py::test_drop_with_bad_candidates <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 24%] 6209s tests/test_active_memory_manager.py::test_drop_prefers_paused_workers <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 24%] 6209s tests/test_active_memory_manager.py::test_drop_with_paused_workers_with_running_tasks_1 <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 24%] 6210s tests/test_active_memory_manager.py::test_drop_with_paused_workers_with_running_tasks_2 <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 24%] 6210s tests/test_active_memory_manager.py::test_drop_with_paused_workers_with_running_tasks_3_4[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 24%] 6210s tests/test_active_memory_manager.py::test_drop_with_paused_workers_with_running_tasks_3_4[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 24%] 6210s tests/test_active_memory_manager.py::test_drop_with_paused_workers_with_running_tasks_5 <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 24%] 6211s tests/test_active_memory_manager.py::test_replicate <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 24%] 6211s tests/test_active_memory_manager.py::test_replicate_not_in_memory <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 25%] 6211s tests/test_active_memory_manager.py::test_double_replicate_stress <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 25%] 6211s tests/test_active_memory_manager.py::test_replicate_to_worker_with_most_free_memory <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 25%] 6212s tests/test_active_memory_manager.py::test_replicate_with_candidates <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 25%] 6212s tests/test_active_memory_manager.py::test_replicate_with_empty_candidates <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 25%] 6212s tests/test_active_memory_manager.py::test_replicate_to_candidates_with_key <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 25%] 6213s tests/test_active_memory_manager.py::test_replicate_avoids_paused_workers_1 <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 25%] 6213s tests/test_active_memory_manager.py::test_replicate_avoids_paused_workers_2 <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 25%] 6213s tests/test_active_memory_manager.py::test_bad_measure <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 25%] 6213s tests/test_active_memory_manager.py::test_ReduceReplicas <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 25%] 6214s tests/test_active_memory_manager.py::test_ReduceReplicas_with_waiters[0-0-0-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 25%] 6214s tests/test_active_memory_manager.py::test_ReduceReplicas_with_waiters[1-0-0-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 25%] 6215s tests/test_active_memory_manager.py::test_ReduceReplicas_with_waiters[0-0-1-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 25%] 6215s tests/test_active_memory_manager.py::test_ReduceReplicas_with_waiters[2-0-0-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 25%] 6216s tests/test_active_memory_manager.py::test_ReduceReplicas_with_waiters[1-1-0-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 25%] 6216s tests/test_active_memory_manager.py::test_ReduceReplicas_with_waiters[1-1-1-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 25%] 6217s tests/test_active_memory_manager.py::test_ReduceReplicas_with_waiters[1-1-2-4] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 25%] 6217s tests/test_active_memory_manager.py::test_ReduceReplicas_with_waiters[2-1-1-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 25%] 6219s tests/test_active_memory_manager.py::test_ReduceReplicas_with_waiters[1-1-17-4] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 25%] 6219s tests/test_active_memory_manager.py::test_ReduceReplicas_with_waiters[17-1-1-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 25%] 6219s tests/test_active_memory_manager.py::test_ReduceReplicas_with_waiters[18-1-1-4] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 25%] 6219s tests/test_active_memory_manager.py::test_RetireWorker_amm_on_off[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 25%] 6219s tests/test_active_memory_manager.py::test_RetireWorker_amm_on_off[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 25%] 6219s tests/test_active_memory_manager.py::test_RetireWorker_no_extension <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 25%] 6219s tests/test_active_memory_manager.py::test_RetireWorker_no_remove <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 25%] 6219s tests/test_active_memory_manager.py::test_RetireWorker_with_ReduceReplicas[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 25%] 6219s tests/test_active_memory_manager.py::test_RetireWorker_with_ReduceReplicas[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 25%] 6220s tests/test_active_memory_manager.py::test_RetireWorker_all_replicas_are_being_retired <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 25%] 6220s tests/test_active_memory_manager.py::test_RetireWorker_no_recipients <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 25%] 6220s tests/test_active_memory_manager.py::test_RetireWorker_all_recipients_are_paused <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 25%] 6221s tests/test_active_memory_manager.py::test_RetireWorker_new_keys_arrive_after_all_keys_moved_away <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 25%] 6221s tests/test_active_memory_manager.py::test_RetireWorker_faulty_recipient <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 25%] 6222s tests/test_active_memory_manager.py::test_RetireWorker_mass <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 25%] 6222s tests/test_active_memory_manager.py::test_RetireWorker_incremental <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 26%] 6222s tests/test_active_memory_manager.py::test_dont_drop_actors <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 26%] 6223s tests/test_active_memory_manager.py::test_dont_replicate_actors <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 26%] 6223s tests/test_active_memory_manager.py::test_RetireWorker_with_actor[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 26%] 6223s tests/test_active_memory_manager.py::test_RetireWorker_with_actor[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 26%] 6223s tests/test_active_memory_manager.py::test_RetireWorker_with_actor_proxy <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py PASSED [ 26%] 6223s tests/test_active_memory_manager.py::test_noamm_stress <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py SKIPPED [ 26%] 6223s tests/test_active_memory_manager.py::test_drop_stress <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py SKIPPED [ 26%] 6223s tests/test_active_memory_manager.py::test_ReduceReplicas_stress <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py SKIPPED [ 26%] 6223s tests/test_active_memory_manager.py::test_RetireWorker_stress[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py SKIPPED [ 26%] 6223s tests/test_active_memory_manager.py::test_RetireWorker_stress[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py SKIPPED [ 26%] 6223s tests/test_actor.py::test_client_actions[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 26%] 6224s tests/test_actor.py::test_client_actions[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 26%] 6224s tests/test_actor.py::test_worker_actions[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 26%] 6224s tests/test_actor.py::test_worker_actions[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 26%] 6224s tests/test_actor.py::test_Actor <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 26%] 6225s tests/test_actor.py::test_linear_access <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py XFAILges rather than 6225s rpc) [ 26%] 6225s tests/test_actor.py::test_exceptions_create <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 26%] 6225s tests/test_actor.py::test_exceptions_method <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 26%] 6226s tests/test_actor.py::test_gc <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 26%] 6226s tests/test_actor.py::test_track_dependencies <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 26%] 6226s tests/test_actor.py::test_future <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 26%] 6227s tests/test_actor.py::test_future_dependencies <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 26%] 6228s tests/test_actor.py::test_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 26%] 6230s tests/test_actor.py::test_timeout <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 26%] 6230s tests/test_actor.py::test_failed_worker <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 26%] 6231s tests/test_actor.py::test_numpy_roundtrip <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 26%] 6231s tests/test_actor.py::test_numpy_roundtrip_getattr <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 26%] 6231s tests/test_actor.py::test_repr <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 26%] 6231s tests/test_actor.py::test_dir <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 26%] 6231s tests/test_actor.py::test_many_computations <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 26%] 6231s tests/test_actor.py::test_thread_safety <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 26%] 6232s tests/test_actor.py::test_Actors_create_dependencies <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 27%] 6232s tests/test_actor.py::test_load_balance <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 27%] 6233s tests/test_actor.py::test_load_balance_map <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 27%] 6233s tests/test_actor.py::test_compute <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 27%] 6235s tests/test_actor.py::test_compute_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 27%] 6235s tests/test_actor.py::test_actors_in_profile <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 27%] 6236s tests/test_actor.py::test_waiter <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 27%] 6236s tests/test_actor.py::test_worker_actor_handle_is_weakref <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 27%] 6238s tests/test_actor.py::test_worker_actor_handle_is_weakref_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 27%] 6240s tests/test_actor.py::test_worker_actor_handle_is_weakref_from_compute_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 27%] 6242s tests/test_actor.py::test_one_thread_deadlock <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 27%] 6243s tests/test_actor.py::test_one_thread_deadlock_timeout <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 27%] 6245s tests/test_actor.py::test_one_thread_deadlock_sync_client <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 27%] 6245s tests/test_actor.py::test_async_deadlock <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 27%] 6247s tests/test_actor.py::test_exception <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 27%] 6247s tests/test_actor.py::test_exception_async <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 27%] 6249s tests/test_actor.py::test_as_completed <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 27%] 6249s tests/test_actor.py::test_actor_future_awaitable <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 27%] 6249s tests/test_actor.py::test_actor_future_awaitable_deadlock <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 27%] 6249s tests/test_actor.py::test_serialize_with_pickle <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 27%] 6250s tests/test_actor.py::test_worker_client_async <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 27%] 6250s tests/test_actor.py::test_worker_client_separate_thread <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 27%] 6250s tests/test_actor.py::test_get_worker <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_actor.py PASSED [ 27%] 6250s tests/test_as_completed.py::test_as_completed_async <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_as_completed.py PASSED [ 27%] 6251s tests/test_as_completed.py::test_as_completed_timeout_async <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_as_completed.py PASSED [ 27%] 6254s tests/test_as_completed.py::test_as_completed_timeout_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_as_completed.py PASSED [ 27%] 6255s tests/test_as_completed.py::test_as_completed_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_as_completed.py PASSED [ 27%] 6257s tests/test_as_completed.py::test_as_completed_with_non_futures <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_as_completed.py PASSED [ 27%] 6259s tests/test_as_completed.py::test_as_completed_add <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_as_completed.py PASSED [ 27%] 6261s tests/test_as_completed.py::test_as_completed_update <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_as_completed.py PASSED [ 27%] 6263s tests/test_as_completed.py::test_as_completed_repeats <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_as_completed.py PASSED [ 27%] 6264s tests/test_as_completed.py::test_as_completed_is_empty <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_as_completed.py PASSED [ 27%] 6265s tests/test_as_completed.py::test_as_completed_cancel <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_as_completed.py PASSED [ 28%] 6267s tests/test_as_completed.py::test_as_completed_cancel_last <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_as_completed.py PASSED [ 28%] 6267s tests/test_as_completed.py::test_async_for_py2_equivalent <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_as_completed.py PASSED [ 28%] 6267s tests/test_as_completed.py::test_as_completed_error_async <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_as_completed.py PASSED [ 28%] 6269s tests/test_as_completed.py::test_as_completed_error <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_as_completed.py PASSED [ 28%] 6271s tests/test_as_completed.py::test_as_completed_with_results <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_as_completed.py PASSED [ 28%] 6272s tests/test_as_completed.py::test_as_completed_with_results_async <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_as_completed.py PASSED [ 28%] 6274s tests/test_as_completed.py::test_as_completed_with_results_no_raise <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_as_completed.py PASSED [ 28%] 6274s tests/test_as_completed.py::test_str <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_as_completed.py PASSED [ 28%] 6274s tests/test_as_completed.py::test_as_completed_with_results_no_raise_async <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_as_completed.py PASSED [ 28%] 6275s tests/test_as_completed.py::test_clear <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_as_completed.py PASSED [ 28%] 6275s tests/test_async_task_group.py::test_async_task_group_initialization <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_async_task_group.py PASSED [ 28%] 6275s tests/test_async_task_group.py::test_async_task_group_call_soon_executes_task_in_background <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_async_task_group.py PASSED [ 28%] 6276s tests/test_async_task_group.py::test_async_task_group_call_later_executes_delayed_task_in_background <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_async_task_group.py PASSED [ 28%] 6276s tests/test_async_task_group.py::test_async_task_group_close_closes <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_async_task_group.py PASSED [ 28%] 6276s tests/test_async_task_group.py::test_async_task_group_close_does_not_cancel_existing_tasks <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_async_task_group.py PASSED [ 28%] 6276s tests/test_async_task_group.py::test_async_task_group_close_prohibits_new_tasks <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_async_task_group.py PASSED [ 28%] 6276s tests/test_async_task_group.py::test_async_task_group_stop_disallows_shutdown <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_async_task_group.py PASSED [ 28%] 6276s tests/test_async_task_group.py::test_async_task_group_stop_cancels_long_running <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_async_task_group.py PASSED [ 28%] 6276s tests/test_asyncio.py::test_rlock <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_asyncio.py PASSED [ 28%] 6276s tests/test_asyncio.py::test_rlock_nonreentrant <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_asyncio.py PASSED [ 28%] 6276s tests/test_asyncio.py::test_rlock_none <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_asyncio.py PASSED [ 28%] 6276s tests/test_asyncio.py::test_rlock_release_on_raise <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_asyncio.py PASSED [ 28%] 6277s tests/test_asyncprocess.py::test_simple <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_asyncprocess.py PASSED [ 28%] 6278s tests/test_asyncprocess.py::test_exitcode <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_asyncprocess.py PASSED [ 28%] 6279s tests/test_asyncprocess.py::test_sigint_from_same_process <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_asyncprocess.py PASSED [ 28%] 6279s tests/test_asyncprocess.py::test_sigterm_from_parent_process <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_asyncprocess.py PASSED [ 28%] 6279s tests/test_asyncprocess.py::test_terminate <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_asyncprocess.py PASSED [ 28%] 6280s tests/test_asyncprocess.py::test_close <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_asyncprocess.py PASSED [ 28%] 6282s tests/test_asyncprocess.py::test_exit_callback <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_asyncprocess.py PASSED [ 28%] 6282s tests/test_asyncprocess.py::test_child_main_thread <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_asyncprocess.py PASSED [ 28%] 6285s tests/test_asyncprocess.py::test_num_fds <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_asyncprocess.py PASSED [ 28%] 6285s tests/test_asyncprocess.py::test_terminate_after_stop <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_asyncprocess.py PASSED [ 28%] 6286s tests/test_asyncprocess.py::test_kill <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_asyncprocess.py PASSED [ 29%] 6288s tests/test_asyncprocess.py::test_asyncprocess_child_teardown_on_parent_exit <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_asyncprocess.py PASSED [ 29%] 6288s tests/test_batched.py::test_close_not_started <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_batched.py PASSED [ 29%] 6288s tests/test_batched.py::test_stress <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_batched.py SKIPPED [ 29%] 6288s tests/test_batched.py::test_large_traffic_jam <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_batched.py SKIPPED [ 29%] 6288s tests/test_cancelled_state.py::test_abort_execution_release <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 29%] 6288s tests/test_cancelled_state.py::test_abort_execution_reschedule <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 29%] 6288s tests/test_cancelled_state.py::test_abort_execution_add_as_dependency <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 29%] 6288s tests/test_cancelled_state.py::test_abort_execution_to_fetch <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 29%] 6289s tests/test_cancelled_state.py::test_worker_stream_died_during_comm <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 29%] 6289s tests/test_cancelled_state.py::test_flight_to_executing_via_cancelled_resumed <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 29%] 6289s tests/test_cancelled_state.py::test_executing_cancelled_error <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 29%] 6289s tests/test_cancelled_state.py::test_flight_cancelled_error <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 29%] 6289s tests/test_cancelled_state.py::test_in_flight_lost_after_resumed <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 29%] 6289s tests/test_cancelled_state.py::test_cancelled_error <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 29%] 6290s tests/test_cancelled_state.py::test_cancelled_error_with_resources <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 29%] 6290s tests/test_cancelled_state.py::test_cancelled_resumed_after_flight_with_dependencies <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 29%] 6290s tests/test_cancelled_state.py::test_cancelled_resumed_after_flight_with_dependencies_workerstate <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 29%] 6290s tests/test_cancelled_state.py::test_resumed_cancelled_handle_compute[True-True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 29%] 6290s tests/test_cancelled_state.py::test_resumed_cancelled_handle_compute[True-False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 29%] 6291s tests/test_cancelled_state.py::test_resumed_cancelled_handle_compute[False-True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 29%] 6291s tests/test_cancelled_state.py::test_resumed_cancelled_handle_compute[False-False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 29%] 6291s tests/test_cancelled_state.py::test_cancelled_handle_compute[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 29%] 6292s tests/test_cancelled_state.py::test_cancelled_handle_compute[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 29%] 6292s tests/test_cancelled_state.py::test_cancelled_task_error_rejected <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 29%] 6293s tests/test_cancelled_state.py::test_deadlock_cancelled_after_inflight_before_gather_from_worker[True-resumed] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 29%] 6293s tests/test_cancelled_state.py::test_deadlock_cancelled_after_inflight_before_gather_from_worker[True-cancelled] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 29%] 6293s tests/test_cancelled_state.py::test_workerstate_executing_to_executing[executing] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 29%] 6293s tests/test_cancelled_state.py::test_workerstate_executing_to_executing[long-running] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 29%] 6293s tests/test_cancelled_state.py::test_workerstate_flight_to_flight <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 29%] 6293s tests/test_cancelled_state.py::test_workerstate_executing_skips_fetch_on_success[executing] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 29%] 6293s tests/test_cancelled_state.py::test_workerstate_executing_skips_fetch_on_success[long-running] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 29%] 6293s tests/test_cancelled_state.py::test_workerstate_executing_failure_to_fetch[executing] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 30%] 6293s tests/test_cancelled_state.py::test_workerstate_executing_failure_to_fetch[long-running] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 30%] 6293s tests/test_cancelled_state.py::test_workerstate_flight_skips_executing_on_success <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 30%] 6293s tests/test_cancelled_state.py::test_workerstate_flight_failure_to_executing[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 30%] 6293s tests/test_cancelled_state.py::test_workerstate_flight_failure_to_executing[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 30%] 6293s tests/test_cancelled_state.py::test_workerstate_resumed_fetch_to_cancelled_to_executing[executing] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 30%] 6293s tests/test_cancelled_state.py::test_workerstate_resumed_fetch_to_cancelled_to_executing[long-running] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 30%] 6293s tests/test_cancelled_state.py::test_workerstate_resumed_fetch_to_executing[executing] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 30%] 6293s tests/test_cancelled_state.py::test_workerstate_resumed_fetch_to_executing[long-running] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 30%] 6293s tests/test_cancelled_state.py::test_workerstate_resumed_waiting_to_flight <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 30%] 6294s tests/test_cancelled_state.py::test_execute_preamble_early_cancel[executing-False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 30%] 6294s tests/test_cancelled_state.py::test_execute_preamble_early_cancel[executing-True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 30%] 6294s tests/test_cancelled_state.py::test_execute_preamble_early_cancel[resumed-False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 30%] 6294s tests/test_cancelled_state.py::test_execute_preamble_early_cancel[resumed-True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 30%] 6294s tests/test_cancelled_state.py::test_cancel_with_dependencies_in_memory[ExecuteSuccessEvent-False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 30%] 6294s tests/test_cancelled_state.py::test_cancel_with_dependencies_in_memory[ExecuteSuccessEvent-True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 30%] 6294s tests/test_cancelled_state.py::test_cancel_with_dependencies_in_memory[ExecuteFailureEvent-False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 30%] 6294s tests/test_cancelled_state.py::test_cancel_with_dependencies_in_memory[ExecuteFailureEvent-True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 30%] 6294s tests/test_cancelled_state.py::test_cancel_with_dependencies_in_memory[RescheduleEvent-False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 30%] 6294s tests/test_cancelled_state.py::test_cancel_with_dependencies_in_memory[RescheduleEvent-True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 30%] 6294s tests/test_cancelled_state.py::test_secede_cancelled_or_resumed_workerstate[ExecuteSuccessEvent-False-False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 30%] 6294s tests/test_cancelled_state.py::test_secede_cancelled_or_resumed_workerstate[ExecuteSuccessEvent-False-True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 30%] 6294s tests/test_cancelled_state.py::test_secede_cancelled_or_resumed_workerstate[ExecuteSuccessEvent-True-False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 30%] 6294s tests/test_cancelled_state.py::test_secede_cancelled_or_resumed_workerstate[ExecuteSuccessEvent-True-True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 30%] 6294s tests/test_cancelled_state.py::test_secede_cancelled_or_resumed_workerstate[ExecuteFailureEvent-False-False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 30%] 6294s tests/test_cancelled_state.py::test_secede_cancelled_or_resumed_workerstate[ExecuteFailureEvent-False-True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 30%] 6294s tests/test_cancelled_state.py::test_secede_cancelled_or_resumed_workerstate[ExecuteFailureEvent-True-False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 30%] 6294s tests/test_cancelled_state.py::test_secede_cancelled_or_resumed_workerstate[ExecuteFailureEvent-True-True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 30%] 6294s tests/test_cancelled_state.py::test_secede_cancelled_or_resumed_workerstate[RescheduleEvent-False-False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 30%] 6294s tests/test_cancelled_state.py::test_secede_cancelled_or_resumed_workerstate[RescheduleEvent-False-True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 30%] 6294s tests/test_cancelled_state.py::test_secede_cancelled_or_resumed_workerstate[RescheduleEvent-True-False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 30%] 6294s tests/test_cancelled_state.py::test_secede_cancelled_or_resumed_workerstate[RescheduleEvent-True-True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 30%] 6294s tests/test_cancelled_state.py::test_secede_cancelled_or_resumed_scheduler <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 31%] 6294s tests/test_cancelled_state.py::test_workerstate_remove_replica_of_cancelled_task_dependency <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cancelled_state.py PASSED [ 31%] 6299s tests/test_chaos.py::test_KillWorker[sys.exit] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_chaos.py PASSED [ 31%] 6301s tests/test_chaos.py::test_KillWorker[graceful] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_chaos.py PASSED [ 31%] 6307s tests/test_chaos.py::test_KillWorker[segfault] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_chaos.py PASSED [ 31%] 6307s tests/test_client.py::test_submit <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 31%] 6308s tests/test_client.py::test_map <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 31%] 6308s tests/test_client.py::test_map_empty <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 31%] 6308s tests/test_client.py::test_map_keynames <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 31%] 6308s tests/test_client.py::test_map_retries <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 31%] 6309s tests/test_client.py::test_map_batch_size <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 31%] 6309s tests/test_client.py::test_custom_key_with_batches <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 31%] 6310s tests/test_client.py::test_compute_retries <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 31%] 6310s tests/test_client.py::test_compute_retries_annotations <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 31%] 6312s tests/test_client.py::test_retries_get <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 31%] 6312s tests/test_client.py::test_persist_retries <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 31%] 6312s tests/test_client.py::test_persist_retries_annotations <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 31%] 6313s tests/test_client.py::test_retries_dask_array <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 31%] 6313s tests/test_client.py::test_future_repr <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 31%] 6313s tests/test_client.py::test_future_tuple_repr <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 31%] 6313s tests/test_client.py::test_Future_exception <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 31%] 6315s tests/test_client.py::test_Future_exception_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 31%] 6316s tests/test_client.py::test_Future_release <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 31%] 6318s tests/test_client.py::test_Future_release_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 31%] 6320s tests/test_client.py::test_short_tracebacks[result] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 31%] 6322s tests/test_client.py::test_short_tracebacks[gather] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 31%] 6322s tests/test_client.py::test_short_tracebacks_async[await] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 31%] 6322s tests/test_client.py::test_short_tracebacks_async[result] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 31%] 6322s tests/test_client.py::test_short_tracebacks_async[gather] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 31%] 6322s tests/test_client.py::test_map_naming <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 31%] 6322s tests/test_client.py::test_submit_naming <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 31%] 6323s tests/test_client.py::test_exceptions <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 31%] 6323s tests/test_client.py::test_gc <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 31%] 6325s tests/test_client.py::test_thread <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 32%] 6327s tests/test_client.py::test_sync_exceptions <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 32%] 6327s tests/test_client.py::test_gather <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 32%] 6327s tests/test_client.py::test_gather_mismatched_client <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 32%] 6328s tests/test_client.py::test_gather_lost <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 32%] 6330s tests/test_client.py::test_gather_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 32%] 6330s tests/test_client.py::test_gather_strict <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 32%] 6330s tests/test_client.py::test_gather_skip <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 32%] 6331s tests/test_client.py::test_limit_concurrent_gathering <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 32%] 6331s tests/test_client.py::test_get <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 32%] 6333s tests/test_client.py::test_get_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 32%] 6335s tests/test_client.py::test_no_future_references <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 32%] 6337s tests/test_client.py::test_get_sync_optimize_graph_passes_through <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 32%] 6337s tests/test_client.py::test_gather_errors <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 32%] 6337s tests/test_client.py::test_wait <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 32%] 6338s tests/test_client.py::test_wait_first_completed <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 32%] 6338s tests/test_client.py::test_wait_timeout <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 32%] 6340s tests/test_client.py::test_wait_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 32%] 6342s tests/test_client.py::test_wait_informative_error_for_timeouts <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 32%] 6342s tests/test_client.py::test_garbage_collection <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 32%] 6342s tests/test_client.py::test_garbage_collection_with_scatter <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 32%] 6342s tests/test_client.py::test_recompute_released_key <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 32%] 6342s tests/test_client.py::test_long_tasks_dont_trigger_timeout <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py SKIPPED [ 32%] 6342s tests/test_client.py::test_tokenize_on_futures <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 32%] 6343s tests/test_client.py::test_restrictions_submit <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 32%] 6343s tests/test_client.py::test_restrictions_ip_port <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 32%] 6343s tests/test_client.py::test_restrictions_map <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 32%] 6343s tests/test_client.py::test_restrictions_get <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 32%] 6343s tests/test_client.py::test_restrictions_get_annotate <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 32%] 6344s tests/test_client.py::test_remove_worker <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 32%] 6344s tests/test_client.py::test_errors_dont_block <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 32%] 6344s tests/test_client.py::test_submit_quotes <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 32%] 6344s tests/test_client.py::test_map_quotes <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 33%] 6344s tests/test_client.py::test_two_consecutive_clients_share_results <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 33%] 6345s tests/test_client.py::test_submit_then_get_with_Future <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 33%] 6345s tests/test_client.py::test_aliases <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 33%] 6345s tests/test_client.py::test_aliases_2 <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 33%] 6345s tests/test_client.py::test_scatter <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 33%] 6345s tests/test_client.py::test_scatter_types <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 33%] 6346s tests/test_client.py::test_scatter_non_list <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 33%] 6346s tests/test_client.py::test_scatter_tokenize_local <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 33%] 6346s tests/test_client.py::test_scatter_singletons <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 33%] 6346s tests/test_client.py::test_scatter_typename <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 33%] 6346s tests/test_client.py::test_scatter_hash <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 33%] 6347s tests/test_client.py::test_scatter_hash_2 <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 33%] 6347s tests/test_client.py::test_get_releases_data <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 33%] 6349s tests/test_client.py::test_current <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 33%] 6351s tests/test_client.py::test_current_nested <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 33%] 6352s tests/test_client.py::test_current_nested_async <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 33%] 6352s tests/test_client.py::test_current_concurrent <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 33%] 6352s tests/test_client.py::test_context_manager_used_from_different_tasks <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 33%] 6354s tests/test_client.py::test_context_manager_used_from_different_threads <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 33%] 6356s tests/test_client.py::test_global_clients <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 33%] 6356s tests/test_client.py::test_exception_on_exception <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 33%] 6356s tests/test_client.py::test_get_task_prefix_states <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 33%] 6356s tests/test_client.py::test_get_nbytes <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 33%] 6356s tests/test_client.py::test_nbytes_determines_worker <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 33%] 6356s tests/test_client.py::test_if_intermediates_clear_on_error <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 33%] 6357s tests/test_client.py::test_pragmatic_move_small_data_to_large_data <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 33%] 6357s tests/test_client.py::test_get_with_non_list_key <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 33%] 6357s tests/test_client.py::test_get_with_error <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 33%] 6359s tests/test_client.py::test_get_with_error_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 33%] 6359s tests/test_client.py::test_directed_scatter <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 33%] 6359s tests/test_client.py::test_scatter_direct <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 33%] 6359s tests/test_client.py::test_scatter_direct_2 <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 34%] 6360s tests/test_client.py::test_scatter_direct_numpy <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 34%] 6360s tests/test_client.py::test_scatter_direct_broadcast <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 34%] 6360s tests/test_client.py::test_scatter_direct_balanced <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 34%] 6360s tests/test_client.py::test_scatter_direct_broadcast_target <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 34%] 6360s tests/test_client.py::test_scatter_direct_empty <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 34%] 6361s tests/test_client.py::test_scatter_direct_spread_evenly <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 34%] 6362s tests/test_client.py::test_scatter_gather_sync[True-True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 34%] 6364s tests/test_client.py::test_scatter_gather_sync[True-False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 34%] 6366s tests/test_client.py::test_scatter_gather_sync[False-True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 34%] 6367s tests/test_client.py::test_scatter_gather_sync[False-False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 34%] 6368s tests/test_client.py::test_gather_direct <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 34%] 6368s tests/test_client.py::test_many_submits_spread_evenly <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 34%] 6368s tests/test_client.py::test_traceback <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 34%] 6368s tests/test_client.py::test_get_traceback <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 34%] 6368s tests/test_client.py::test_gather_traceback <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 34%] 6370s tests/test_client.py::test_traceback_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 34%] 6370s tests/test_client.py::test_upload_file <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 34%] 6371s tests/test_client.py::test_upload_file_refresh_delayed <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 34%] 6371s tests/test_client.py::test_upload_file_no_extension <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 34%] 6371s tests/test_client.py::test_upload_file_zip <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py SKIPPEDues/8708 and 6371s https://github.com/python/cpython/issues/121342.) [ 34%] 6371s tests/test_client.py::test_upload_file_egg <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py SKIPPED [ 34%] 6371s tests/test_client.py::test_upload_large_file <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 34%] 6373s tests/test_client.py::test_upload_file_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 34%] 6374s tests/test_client.py::test_upload_file_exception <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 34%] 6375s tests/test_client.py::test_upload_file_exception_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 34%] 6376s tests/test_client.py::test_upload_file_load <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 34%] 6376s tests/test_client.py::test_upload_file_new_worker <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 34%] 6376s tests/test_client.py::test_multiple_clients <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py SKIPPED [ 34%] 6376s tests/test_client.py::test_async_compute <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 34%] 6376s tests/test_client.py::test_async_compute_with_scatter <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 34%] 6378s tests/test_client.py::test_sync_compute <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 34%] 6378s tests/test_client.py::test_remote_scatter_gather <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 34%] 6378s tests/test_client.py::test_remote_submit_on_Future <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 35%] 6380s tests/test_client.py::test_start_is_idempotent <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 35%] 6380s tests/test_client.py::test_client_with_scheduler <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 35%] 6381s tests/test_client.py::test_allow_restrictions <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 35%] 6381s tests/test_client.py::test_bad_address <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 35%] 6381s tests/test_client.py::test_informative_error_on_cluster_type <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 35%] 6381s tests/test_client.py::test_long_error <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 35%] 6381s tests/test_client.py::test_map_on_futures_with_kwargs <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 35%] 6381s tests/test_client.py::test_badly_serialized_input_stderr <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py SKIPPED [ 35%] 6383s tests/test_client.py::test_repr[str] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 35%] 6385s tests/test_client.py::test_repr[repr] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 35%] 6387s tests/test_client.py::test_repr[func2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 35%] 6387s tests/test_client.py::test_repr_async <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 35%] 6388s tests/test_client.py::test_repr_no_memory_limit <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 35%] 6388s tests/test_client.py::test_forget_simple <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 35%] 6388s tests/test_client.py::test_forget_complex <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 35%] 6388s tests/test_client.py::test_forget_in_flight <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 35%] 6389s tests/test_client.py::test_forget_errors <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 35%] 6391s tests/test_client.py::test_repr_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 35%] 6391s tests/test_client.py::test_multi_client <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 35%] 6393s tests/test_client.py::test_cleanup_after_broken_client_connection <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 35%] 6393s tests/test_client.py::test_multi_garbage_collection <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 35%] 6393s tests/test_client.py::test__broadcast <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 35%] 6394s tests/test_client.py::test__broadcast_integer <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 35%] 6394s tests/test_client.py::test__broadcast_dict <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 35%] 6395s tests/test_client.py::test_proxy <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 35%] 6395s tests/test_client.py::test_cancel <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 35%] 6395s tests/test_client.py::test_cancel_tuple_key <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 35%] 6395s tests/test_client.py::test_cancel_multi_client <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 35%] 6395s tests/test_client.py::test_cancel_before_known_to_scheduler <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 35%] 6396s tests/test_client.py::test_cancel_collection <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 35%] 6398s tests/test_client.py::test_cancel_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 35%] 6398s tests/test_client.py::test_future_type <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 36%] 6398s tests/test_client.py::test_traceback_clean <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 36%] 6398s tests/test_client.py::test_map_differnet_lengths <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 36%] 6400s tests/test_client.py::test_Future_exception_sync_2 <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 36%] 6400s tests/test_client.py::test_async_persist <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 36%] 6400s tests/test_client.py::test_persist_async <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 36%] 6402s tests/test_client.py::test_persist <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 36%] 6402s tests/test_client.py::test_long_traceback <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 36%] 6402s tests/test_client.py::test_wait_on_collections <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 36%] 6402s tests/test_client.py::test_futures_of_get <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 36%] 6402s tests/test_client.py::test_futures_of_class <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 36%] 6403s tests/test_client.py::test_futures_of_cancelled_raises <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 36%] 6403s tests/test_client.py::test_balance_tasks_by_stacks <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py SKIPPED [ 36%] 6403s tests/test_client.py::test_run <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 36%] 6403s tests/test_client.py::test_run_handles_picklable_data <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 36%] 6405s tests/test_client.py::test_run_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 36%] 6405s tests/test_client.py::test_run_coroutine <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 36%] 6407s tests/test_client.py::test_run_coroutine_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 36%] 6407s tests/test_client.py::test_run_exception <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 36%] 6408s tests/test_client.py::test_run_rpc_error <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 36%] 6410s tests/test_client.py::test_diagnostic_ui <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 36%] 6411s tests/test_client.py::test_diagnostic_nbytes_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 36%] 6412s tests/test_client.py::test_diagnostic_nbytes <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 36%] 6412s tests/test_client.py::test_worker_aliases <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 36%] 6414s tests/test_client.py::test_persist_get_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 36%] 6414s tests/test_client.py::test_persist_get[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 36%] 6414s tests/test_client.py::test_persist_get[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 36%] 6416s tests/test_client.py::test_client_num_fds <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 36%] 6416s tests/test_client.py::test_startup_close_startup <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 36%] 6418s tests/test_client.py::test_startup_close_startup_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 36%] 6418s tests/test_client.py::test_badly_serialized_exceptions <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 36%] 6418s tests/test_client.py::test_rebalance <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 36%] 6419s tests/test_client.py::test_rebalance_workers_and_keys <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 37%] 6419s tests/test_client.py::test_rebalance_unprepared <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 37%] 6420s tests/test_client.py::test_receive_lost_key <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 37%] 6420s tests/test_client.py::test_unrunnable_task_runs <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 37%] 6422s tests/test_client.py::test_add_worker_after_tasks <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 37%] 6422s tests/test_client.py::test_workers_register_indirect_data <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 37%] 6422s tests/test_client.py::test_submit_on_cancelled_future <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 37%] 6423s tests/test_client.py::test_replicate <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 37%] 6423s tests/test_client.py::test_replicate_tuple_keys <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 37%] 6424s tests/test_client.py::test_replicate_workers <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 37%] 6424s tests/test_client.py::test_replicate_tree_branching <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 37%] 6425s tests/test_client.py::test_client_replicate <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 37%] 6425s tests/test_client.py::test_client_replicate_host <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 37%] 6428s tests/test_client.py::test_client_replicate_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 37%] 6428s tests/test_client.py::test_task_load_adapts_quickly <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 37%] 6428s tests/test_client.py::test_even_load_after_fast_functions <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 37%] 6429s tests/test_client.py::test_even_load_on_startup <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 37%] 6429s tests/test_client.py::test_contiguous_load <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py SKIPPED [ 37%] 6429s tests/test_client.py::test_balanced_with_submit <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 37%] 6429s tests/test_client.py::test_balanced_with_submit_and_resident_data <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 37%] 6430s tests/test_client.py::test_scheduler_saturates_cores <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 37%] 6430s tests/test_client.py::test_scheduler_saturates_cores_random <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 37%] 6430s tests/test_client.py::test_cancel_clears_processing <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 37%] 6433s tests/test_client.py::test_default_get <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 37%] 6433s tests/test_client.py::test_get_scheduler_default_client_config_interleaving <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 37%] 6433s tests/test_client.py::test_ensure_default_client <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 37%] 6433s tests/test_client.py::test_set_as_default <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 37%] 6434s tests/test_client.py::test_get_foo <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 37%] 6434s tests/test_client.py::test_get_foo_lost_keys <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 37%] 6434s tests/test_client.py::test_bad_tasks_fail <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py SKIPPED [ 37%] 6436s tests/test_client.py::test_get_processing_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 37%] 6437s tests/test_client.py::test_close_idempotent <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 37%] 6440s tests/test_client.py::test_get_returns_early <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 37%] 6440s tests/test_client.py::test_Client_clears_references_after_restart <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py SKIPPED [ 38%] 6441s tests/test_client.py::test_get_stops_work_after_error <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 38%] 6443s tests/test_client.py::test_as_completed_list <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 38%] 6445s tests/test_client.py::test_as_completed_results <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 38%] 6447s tests/test_client.py::test_as_completed_batches[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 38%] 6449s tests/test_client.py::test_as_completed_batches[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 38%] 6451s tests/test_client.py::test_as_completed_next_batch <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 38%] 6451s tests/test_client.py::test_status <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 38%] 6451s tests/test_client.py::test_persist_optimize_graph <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 38%] 6452s tests/test_client.py::test_scatter_raises_if_no_workers <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 38%] 6452s tests/test_client.py::test_reconnect <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py SKIPPED [ 38%] 6453s tests/test_client.py::test_reconnect_timeout <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 38%] 6453s tests/test_client.py::test_idempotence <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 38%] 6455s tests/test_client.py::test_scheduler_info <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 38%] 6457s tests/test_client.py::test_write_scheduler_file <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 38%] 6460s tests/test_client.py::test_get_versions_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 38%] 6460s tests/test_client.py::test_get_versions_async <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 38%] 6460s tests/test_client.py::test_get_versions_rpc_error <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 38%] 6463s tests/test_client.py::test_threaded_get_within_distributed <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 38%] 6463s tests/test_client.py::test_lose_scattered_data <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 38%] 6464s tests/test_client.py::test_partially_lose_scattered_data <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 38%] 6464s tests/test_client.py::test_scatter_compute_lose <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 38%] 6464s tests/test_client.py::test_scatter_compute_store_lose <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 38%] 6465s tests/test_client.py::test_scatter_compute_store_lose_processing <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 38%] 6465s tests/test_client.py::test_temp_default_client <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 38%] 6465s tests/test_client.py::test_as_current <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 38%] 6467s tests/test_client.py::test_as_current_is_thread_local <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 38%] 6467s tests/test_client.py::test_as_current_is_task_local <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 38%] 6468s tests/test_client.py::test_persist_workers_annotate <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 38%] 6468s tests/test_client.py::test_persist_workers_annotate2 <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 38%] 6468s tests/test_client.py::test_persist_workers <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 38%] 6469s tests/test_client.py::test_compute_workers_annotate <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 38%] 6469s tests/test_client.py::test_compute_workers <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 39%] 6469s tests/test_client.py::test_compute_nested_containers <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 39%] 6469s tests/test_client.py::test_scatter_type <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 39%] 6470s tests/test_client.py::test_retire_workers_2 <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 39%] 6470s tests/test_client.py::test_retire_many_workers <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 39%] 6471s tests/test_client.py::test_weight_occupancy_against_data_movement <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 39%] 6471s tests/test_client.py::test_distribute_tasks_by_nthreads <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 39%] 6471s tests/test_client.py::test_add_done_callback <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 39%] 6472s tests/test_client.py::test_normalize_collection <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 39%] 6472s tests/test_client.py::test_normalize_collection_dask_array <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 39%] 6472s tests/test_client.py::test_normalize_collection_with_released_futures <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py SKIPPED [ 39%] 6472s tests/test_client.py::test_auto_normalize_collection <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py XPASS [ 39%] 6474s tests/test_client.py::test_auto_normalize_collection_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py XPASS [ 39%] 6475s tests/test_client.py::test_interleave_computations <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 39%] 6475s tests/test_client.py::test_interleave_computations_map <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py SKIPPED [ 39%] 6475s tests/test_client.py::test_scatter_dict_workers <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 39%] 6475s tests/test_client.py::test_client_timeout <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py SKIPPED [ 39%] 6475s tests/test_client.py::test_submit_list_kwargs <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 39%] 6476s tests/test_client.py::test_map_list_kwargs <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 39%] 6478s tests/test_client.py::test_recreate_error_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 39%] 6479s tests/test_client.py::test_recreate_error_not_error <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 39%] 6481s tests/test_client.py::test_recreate_task_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 39%] 6482s tests/test_client.py::test_retire_workers <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 39%] 6482s tests/test_client.py::test_restart_workers <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py SKIPPED [ 39%] 6482s tests/test_client.py::test_restart_workers_no_nanny_raises <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 39%] 6482s tests/test_client.py::test_restart_workers_kill_timeout[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py SKIPPED [ 39%] 6482s tests/test_client.py::test_restart_workers_kill_timeout[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py SKIPPED [ 39%] 6482s tests/test_client.py::test_restart_workers_restart_timeout[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py SKIPPED [ 39%] 6482s tests/test_client.py::test_restart_workers_restart_timeout[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py SKIPPED [ 39%] 6482s tests/test_client.py::test_restart_workers_exception <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py SKIPPED [ 39%] 6482s tests/test_client.py::test_restart_workers_by_name[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py SKIPPED [ 39%] 6482s tests/test_client.py::test_restart_workers_by_name[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py SKIPPED [ 39%] 6482s tests/test_client.py::test_robust_unserializable <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 40%] 6482s tests/test_client.py::test_robust_undeserializable <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 40%] 6482s tests/test_client.py::test_robust_undeserializable_function <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 40%] 6483s tests/test_client.py::test_fire_and_forget <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 40%] 6483s tests/test_client.py::test_fire_and_forget_err <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 40%] 6483s tests/test_client.py::test_close <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 40%] 6486s tests/test_client.py::test_threadsafe <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 40%] 6486s tests/test_client.py::test_threadsafe_get <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py SKIPPED [ 40%] 6486s tests/test_client.py::test_threadsafe_compute <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py SKIPPED [ 40%] 6486s tests/test_client.py::test_identity <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 40%] 6487s tests/test_client.py::test_get_client <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 40%] 6487s tests/test_client.py::test_get_client_no_cluster <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 40%] 6487s tests/test_client.py::test_serialize_collections <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 40%] 6487s tests/test_client.py::test_secede_simple <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 40%] 6488s tests/test_client.py::test_secede_balances <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 40%] 6488s tests/test_client.py::test_long_running_not_in_occupancy[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 40%] 6488s tests/test_client.py::test_long_running_not_in_occupancy[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 40%] 6489s tests/test_client.py::test_long_running_removal_clean[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 40%] 6489s tests/test_client.py::test_long_running_removal_clean[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 40%] 6489s tests/test_client.py::test_sub_submit_priority <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 40%] 6492s tests/test_client.py::test_get_client_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 40%] 6492s tests/test_client.py::test_serialize_collections_of_futures <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 40%] 6494s tests/test_client.py::test_serialize_collections_of_futures_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 40%] 6497s tests/test_client.py::test_dynamic_workloads_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 40%] 6497s tests/test_client.py::test_dynamic_workloads_sync_random <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py SKIPPED [ 40%] 6497s tests/test_client.py::test_bytes_keys <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 40%] 6498s tests/test_client.py::test_unicode_ascii_keys <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 40%] 6498s tests/test_client.py::test_unicode_keys <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 40%] 6500s tests/test_client.py::test_use_synchronous_client_in_async_context <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 40%] 6502s tests/test_client.py::test_quiet_quit_when_cluster_leaves <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 40%] 6503s tests/test_client.py::test_call_stack_future <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 40%] 6504s tests/test_client.py::test_call_stack_all <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 40%] 6506s tests/test_client.py::test_call_stack_collections <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 40%] 6507s tests/test_client.py::test_call_stack_collections_all <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 41%] 6508s tests/test_client.py::test_profile <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 41%] 6509s tests/test_client.py::test_profile_disabled <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 41%] 6510s tests/test_client.py::test_profile_keys <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 41%] 6510s tests/test_client.py::test_client_with_name <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 41%] 6510s tests/test_client.py::test_client_async_before_loop_starts <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 41%] 6510s tests/test_client.py::test_nested_compute <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py SKIPPED [ 41%] 6511s tests/test_client.py::test_task_metadata <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 41%] 6512s tests/test_client.py::test_logs <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 41%] 6514s tests/test_client.py::test_logs_from_worker_submodules <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 41%] 6514s tests/test_client.py::test_avoid_delayed_finalize <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 41%] 6514s tests/test_client.py::test_config_scheduler_address <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 41%] 6515s tests/test_client.py::test_warn_when_submitting_large_values <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 41%] 6515s tests/test_client.py::test_warn_when_submitting_large_values_memoryview <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 41%] 6515s tests/test_client.py::test_unhashable_function <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 41%] 6515s tests/test_client.py::test_client_name <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 41%] 6517s tests/test_client.py::test_client_doesnt_close_given_loop <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 41%] 6517s tests/test_client.py::test_quiet_scheduler_loss <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py SKIPPED [ 41%] 6519s tests/test_client.py::test_dashboard_link <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 41%] 6519s tests/test_client.py::test_client_timeout_2 <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 41%] 6519s tests/test_client.py::test_turn_off_pickle[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 41%] 6520s tests/test_client.py::test_turn_off_pickle[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 41%] 6520s tests/test_client.py::test_de_serialization <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 41%] 6520s tests/test_client.py::test_de_serialization_none <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 41%] 6520s tests/test_client.py::test_client_repr_closed <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 41%] 6520s tests/test_client.py::test_client_repr_closed_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py SKIPPED [ 41%] 6520s tests/test_client.py::test_nested_prioritization <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py XPASS [ 41%] 6521s tests/test_client.py::test_scatter_error_cancel <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 41%] 6521s tests/test_client.py::test_scatter_and_replicate_avoid_paused_workers[False-False-False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 41%] 6522s tests/test_client.py::test_scatter_and_replicate_avoid_paused_workers[False-False-True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 41%] 6522s tests/test_client.py::test_scatter_and_replicate_avoid_paused_workers[False-True-False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 41%] 6523s tests/test_client.py::test_scatter_and_replicate_avoid_paused_workers[False-True-True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 41%] 6525s tests/test_client.py::test_scatter_and_replicate_avoid_paused_workers[True-False-False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 42%] 6525s tests/test_client.py::test_scatter_and_replicate_avoid_paused_workers[True-False-True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 42%] 6526s tests/test_client.py::test_scatter_and_replicate_avoid_paused_workers[True-True-False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 42%] 6526s tests/test_client.py::test_scatter_and_replicate_avoid_paused_workers[True-True-True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 42%] 6527s tests/test_client.py::test_scatter_and_replicate_avoid_paused_workers[10-False-False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 42%] 6528s tests/test_client.py::test_scatter_and_replicate_avoid_paused_workers[10-False-True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 42%] 6529s tests/test_client.py::test_scatter_and_replicate_avoid_paused_workers[10-True-False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 42%] 6530s tests/test_client.py::test_scatter_and_replicate_avoid_paused_workers[10-True-True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 42%] 6530s tests/test_client.py::test_no_threads_lingering <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py XPASS [ 42%] 6530s tests/test_client.py::test_direct_async <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 42%] 6532s tests/test_client.py::test_direct_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 42%] 6532s tests/test_client.py::test_mixing_clients_same_scheduler <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 42%] 6532s tests/test_client.py::test_tuple_keys <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 42%] 6532s tests/test_client.py::test_multiple_scatter <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 42%] 6533s tests/test_client.py::test_map_large_kwargs_in_graph <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 42%] 6533s tests/test_client.py::test_retry <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 42%] 6533s tests/test_client.py::test_retry_dependencies <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 42%] 6533s tests/test_client.py::test_released_dependencies <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 42%] 6533s tests/test_client.py::test_profile_bokeh <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py SKIPPED [ 42%] 6534s tests/test_client.py::test_get_mix_futures_and_SubgraphCallable <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 42%] 6534s tests/test_client.py::test_get_mix_futures_and_SubgraphCallable_dask_dataframe <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 42%] 6536s tests/test_client.py::test_direct_to_workers <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 42%] 6536s tests/test_client.py::test_instances <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 42%] 6537s tests/test_client.py::test_wait_for_workers <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 42%] 6538s tests/test_client.py::test_config_inherited_by_subprocess <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 42%] 6538s tests/test_client.py::test_futures_of_sorted <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 42%] 6540s tests/test_client.py::test_profile_server <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 42%] 6542s tests/test_client.py::test_profile_server_disabled <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 42%] 6542s tests/test_client.py::test_await_future <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 42%] 6543s tests/test_client.py::test_as_completed_async_for <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 42%] 6543s tests/test_client.py::test_as_completed_async_for_results <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 42%] 6543s tests/test_client.py::test_as_completed_async_for_cancel <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 42%] 6545s tests/test_client.py::test_client_sync_with_async_def <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 43%] 6545s tests/test_client.py::test_dont_hold_on_to_large_messages <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py SKIPPED [ 43%] 6546s tests/test_client.py::test_run_on_scheduler_async_def <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 43%] 6546s tests/test_client.py::test_run_on_scheduler_async_def_wait <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 43%] 6546s tests/test_client.py::test_performance_report[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py SKIPPED [ 43%] 6546s tests/test_client.py::test_performance_report[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py SKIPPED [ 43%] 6546s tests/test_client.py::test_as_completed_condition_loop <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 43%] 6546s tests/test_client.py::test_mixed_compression <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py SKIPPED [ 43%] 6549s tests/test_client.py::test_futures_in_subgraphs <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 43%] 6550s tests/test_client.py::test_get_task_metadata <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 43%] 6550s tests/test_client.py::test_get_task_metadata_multiple <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 43%] 6550s tests/test_client.py::test_register_worker_plugin_instance_required <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 43%] 6551s tests/test_client.py::test_register_worker_plugin_exception <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 43%] 6551s tests/test_client.py::test_annotations_task_state <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 43%] 6551s tests/test_client.py::test_annotations_compute_time[compute] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 43%] 6551s tests/test_client.py::test_annotations_compute_time[persist] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 43%] 6552s tests/test_client.py::test_annotations_survive_optimization <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py XFAIL [ 43%] 6552s tests/test_client.py::test_annotations_priorities <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 43%] 6552s tests/test_client.py::test_annotations_workers <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 43%] 6552s tests/test_client.py::test_annotations_retries <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 43%] 6553s tests/test_client.py::test_annotations_blockwise_unpack <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 43%] 6553s tests/test_client.py::test_annotations_resources <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 43%] 6553s tests/test_client.py::test_annotations_resources_culled <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 43%] 6553s tests/test_client.py::test_annotations_loose_restrictions <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 43%] 6554s tests/test_client.py::test_annotations_submit_map <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 43%] 6554s tests/test_client.py::test_annotations_global_vs_local <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 43%] 6554s tests/test_client.py::test_workers_collection_restriction <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 43%] 6554s tests/test_client.py::test_get_client_functions_spawn_clusters <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py SKIPPED [ 43%] 6554s tests/test_client.py::test_computation_code_walk_frames <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 43%] 6554s tests/test_client.py::test_computation_ignore_ipython_frames[2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py SKIPPED [ 43%] 6554s tests/test_client.py::test_computation_ignore_ipython_frames[3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py SKIPPED [ 43%] 6554s tests/test_client.py::test_computation_store_annotations <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 43%] 6556s tests/test_client.py::test_computation_object_code_dask_compute <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 43%] 6558s tests/test_client.py::test_computation_object_code_dask_compute_no_frames_default <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 44%] 6560s tests/test_client.py::test_computation_object_code_not_available <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py SKIPPED [ 44%] 6560s tests/test_client.py::test_computation_object_code_dask_persist <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 44%] 6561s tests/test_client.py::test_computation_object_code_client_submit_simple <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 44%] 6561s tests/test_client.py::test_computation_object_code_client_submit_list_comp <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 44%] 6561s tests/test_client.py::test_computation_object_code_client_submit_dict_comp <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 44%] 6561s tests/test_client.py::test_computation_object_code_client_map <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 44%] 6562s tests/test_client.py::test_computation_object_code_client_compute <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 44%] 6562s tests/test_client.py::test_upload_directory <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py SKIPPED [ 44%] 6562s tests/test_client.py::test_duck_typed_register_plugin_raises <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 44%] 6562s tests/test_client.py::test_exception_text <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 44%] 6562s tests/test_client.py::test_async_task <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 44%] 6563s tests/test_client.py::test_async_task_with_partial <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 44%] 6563s tests/test_client.py::test_warn_manual <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 44%] 6563s tests/test_client.py::test_warn_remote <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 44%] 6565s tests/test_client.py::test_print_remote <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 44%] 6566s tests/test_client.py::test_print_manual <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 44%] 6568s tests/test_client.py::test_print_manual_bad_args <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 44%] 6569s tests/test_client.py::test_print_non_msgpack_serializable <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 44%] 6569s tests/test_client.py::test_print_local <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 44%] 6571s tests/test_client.py::test_forward_logging <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 44%] 6573s tests/test_client.py::test_dump_cluster_state_write_from_scheduler <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 44%] 6575s tests/test_client.py::test_dump_cluster_state_sync[msgpack-True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 44%] 6577s tests/test_client.py::test_dump_cluster_state_sync[msgpack-False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 44%] 6579s tests/test_client.py::test_dump_cluster_state_sync[yaml-True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 44%] 6581s tests/test_client.py::test_dump_cluster_state_sync[yaml-False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 44%] 6581s tests/test_client.py::test_dump_cluster_state_async[msgpack-True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 44%] 6581s tests/test_client.py::test_dump_cluster_state_async[msgpack-False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 44%] 6582s tests/test_client.py::test_dump_cluster_state_async[yaml-True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 44%] 6582s tests/test_client.py::test_dump_cluster_state_async[yaml-False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 44%] 6583s tests/test_client.py::test_dump_cluster_state_json[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 44%] 6583s tests/test_client.py::test_dump_cluster_state_json[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 44%] 6584s tests/test_client.py::test_dump_cluster_state_exclude_default <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 45%] 6584s tests/test_client.py::test_benchmark_hardware_no_workers <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 45%] 6585s tests/test_client.py::test_wait_for_workers_updates_info <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 45%] 6585s tests/test_client.py::test_quiet_close_process[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py SKIPPED [ 45%] 6585s tests/test_client.py::test_quiet_close_process[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py SKIPPED [ 45%] 6585s tests/test_client.py::test_deprecated_loop_properties <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 45%] 6585s tests/test_client.py::test_fast_close_on_aexit_failure <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 45%] 6585s tests/test_client.py::test_wait_for_workers_n_workers_value_check[None-ValueError] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 45%] 6585s tests/test_client.py::test_wait_for_workers_n_workers_value_check[0-ValueError] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 45%] 6585s tests/test_client.py::test_wait_for_workers_n_workers_value_check[1.0-ValueError] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 45%] 6586s tests/test_client.py::test_wait_for_workers_n_workers_value_check[1-None] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 45%] 6586s tests/test_client.py::test_wait_for_workers_n_workers_value_check[2-None] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 45%] 6586s tests/test_client.py::test_unpacks_remotedata_namedtuple[PlainNamedTuple-args0-kwargs0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 45%] 6587s tests/test_client.py::test_unpacks_remotedata_namedtuple[NewArgsNamedTuple-args1-kwargs1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 45%] 6587s tests/test_client.py::test_unpacks_remotedata_namedtuple[NewArgsExNamedTuple-args2-kwargs2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 45%] 6587s tests/test_client.py::test_resolves_future_in_namedtuple[PlainNamedTuple-args0-kwargs0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 45%] 6587s tests/test_client.py::test_resolves_future_in_namedtuple[NewArgsNamedTuple-args1-kwargs1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 45%] 6588s tests/test_client.py::test_resolves_future_in_namedtuple[NewArgsExNamedTuple-args2-kwargs2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 45%] 6588s tests/test_client.py::test_resolves_future_in_dict <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 45%] 6588s tests/test_client.py::test_gather_race_vs_AMM[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 45%] 6589s tests/test_client.py::test_gather_race_vs_AMM[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 45%] 6591s tests/test_client.py::test_client_disconnect_exception_on_cancelled_futures <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 45%] 6591s tests/test_client.py::test_scheduler_restart_exception_on_cancelled_futures <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py SKIPPED [ 45%] 6591s tests/test_client.py::test_release_persisted_collection <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 45%] 6593s tests/test_client.py::test_release_persisted_collection_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py PASSED [ 45%] 6593s tests/test_client.py::test_worker_clients_do_not_claim_ownership_of_serialize_futures[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py SKIPPED [ 45%] 6593s tests/test_client.py::test_worker_clients_do_not_claim_ownership_of_serialize_futures[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py SKIPPED [ 45%] 6595s tests/test_client_executor.py::test_submit <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client_executor.py PASSED [ 45%] 6597s tests/test_client_executor.py::test_as_completed <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client_executor.py PASSED [ 45%] 6599s tests/test_client_executor.py::test_wait <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client_executor.py PASSED [ 45%] 6601s tests/test_client_executor.py::test_cancellation <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client_executor.py PASSED [ 45%] 6604s tests/test_client_executor.py::test_cancellation_wait <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client_executor.py PASSED [ 45%] 6607s tests/test_client_executor.py::test_cancellation_as_completed <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client_executor.py PASSED [ 46%] 6607s tests/test_client_executor.py::test_map <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client_executor.py SKIPPED [ 46%] 6609s tests/test_client_executor.py::test_pure <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client_executor.py PASSED [ 46%] 6611s tests/test_client_executor.py::test_workers <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client_executor.py PASSED [ 46%] 6612s tests/test_client_executor.py::test_unsupported_arguments <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client_executor.py PASSED [ 46%] 6615s tests/test_client_executor.py::test_retries <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client_executor.py PASSED [ 46%] 6618s tests/test_client_executor.py::test_shutdown_wait <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client_executor.py PASSED [ 46%] 6620s tests/test_client_executor.py::test_shutdown_nowait <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client_executor.py PASSED [ 46%] 6620s tests/test_cluster_dump.py::test_tuple_to_list[input0-expected0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cluster_dump.py PASSED [ 46%] 6620s tests/test_cluster_dump.py::test_tuple_to_list[input1-expected1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cluster_dump.py PASSED [ 46%] 6620s tests/test_cluster_dump.py::test_tuple_to_list[input2-expected2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cluster_dump.py PASSED [ 46%] 6620s tests/test_cluster_dump.py::test_tuple_to_list[foo-foo] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cluster_dump.py PASSED [ 46%] 6620s tests/test_cluster_dump.py::test_write_state_msgpack <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cluster_dump.py PASSED [ 46%] 6620s tests/test_cluster_dump.py::test_write_state_yaml <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cluster_dump.py PASSED [ 46%] 6620s tests/test_cluster_dump.py::test_cluster_dump_state <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cluster_dump.py PASSED [ 46%] 6621s tests/test_cluster_dump.py::test_cluster_dump_story <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cluster_dump.py PASSED [ 46%] 6621s tests/test_cluster_dump.py::test_cluster_dump_to_yamls <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_cluster_dump.py PASSED [ 46%] 6621s tests/test_collections.py::test_lru <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_collections.py PASSED [ 46%] 6621s tests/test_collections.py::test_heapset <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_collections.py PASSED [ 46%] 6621s tests/test_collections.py::test_heapset_sorted_flag_left <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_collections.py PASSED [ 46%] 6621s tests/test_collections.py::test_heapset_sorted_flag_right <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_collections.py PASSED [ 46%] 6621s tests/test_collections.py::test_heapset_popright[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_collections.py PASSED [ 46%] 6621s tests/test_collections.py::test_heapset_popright[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_collections.py PASSED [ 46%] 6621s tests/test_collections.py::test_heapset_pickle <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_collections.py PASSED [ 46%] 6621s tests/test_collections.py::test_heapset_sort_duplicate <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_collections.py PASSED [ 46%] 6621s tests/test_collections.py::test_sum_mappings <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_collections.py PASSED [ 46%] 6621s tests/test_compatibility.py::test_randbytes <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_compatibility.py PASSED [ 46%] 6621s tests/test_compatibility.py::test_randbytes_seed <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_compatibility.py PASSED [ 46%] 6621s tests/test_computations.py::test_computations <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_computations.py PASSED [ 46%] 6621s tests/test_computations.py::test_computations_futures <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_computations.py PASSED [ 46%] 6622s tests/test_computations.py::test_computations_no_workers <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_computations.py PASSED [ 46%] 6622s tests/test_computations.py::test_computations_no_resources <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_computations.py PASSED [ 46%] 6622s tests/test_computations.py::test_computations_long_running <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_computations.py PASSED [ 46%] 6622s tests/test_config.py::test_logging_default[config0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_config.py PASSED [ 47%] 6622s tests/test_config.py::test_logging_default[None] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_config.py PASSED [ 47%] 6623s tests/test_config.py::test_logging_simple_under_distributed <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_config.py PASSED [ 47%] 6624s tests/test_config.py::test_logging_simple <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_config.py PASSED [ 47%] 6626s tests/test_config.py::test_logging_extended <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_config.py PASSED [ 47%] 6626s tests/test_config.py::test_default_logging_does_not_override_basic_config <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_config.py PASSED [ 47%] 6627s tests/test_config.py::test_basic_config_does_not_override_default_logging <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_config.py PASSED [ 47%] 6627s tests/test_config.py::test_logging_mutual_exclusive <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_config.py PASSED [ 47%] 6628s tests/test_config.py::test_logging_file_config <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_config.py PASSED [ 47%] 6629s tests/test_config.py::test_schema <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_config.py PASSED [ 47%] 6629s tests/test_config.py::test_schema_is_complete <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_config.py PASSED [ 47%] 6629s tests/test_config.py::test_uvloop_event_loop <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_config.py SKIPPED [ 47%] 6629s tests/test_config.py::test_deprecations_on_set[args0-kwargs0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_config.py PASSED [ 47%] 6629s tests/test_config.py::test_deprecations_on_set[args1-kwargs1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_config.py PASSED [ 47%] 6629s tests/test_config.py::test_deprecations_on_set[args2-kwargs2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_config.py PASSED [ 47%] 6629s tests/test_config.py::test_deprecations_on_env_variables <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_config.py PASSED [ 47%] 6629s tests/test_config.py::test_deprecations_on_yaml[allowed-failures] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_config.py PASSED [ 47%] 6629s tests/test_config.py::test_deprecations_on_yaml[allowed_failures] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_config.py PASSED [ 47%] 6629s tests/test_core.py::test_rpc_inputs <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_core.py PASSED [ 47%] 6629s tests/test_core.py::test_large_packets_tcp <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_core.py SKIPPED [ 47%] 6629s tests/test_core.py::test_connect_raises <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_core.py PASSED [ 47%] 6629s tests/test_core.py::test_coerce_to_address <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_core.py PASSED [ 47%] 6629s tests/test_core.py::test_remove_cancels_connect_attempts <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_core.py PASSED [ 47%] 6629s tests/test_core.py::test_remove_cancels_connect_before_task_running <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_core.py PASSED [ 47%] 6629s tests/test_core.py::test_ticks <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_core.py SKIPPED [ 47%] 6629s tests/test_core.py::test_tick_logging <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_core.py SKIPPED [ 47%] 6629s tests/test_core.py::test_rpc_closed_exception <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_core.py PASSED [ 47%] 6630s tests/test_core.py::test_thread_id <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_core.py PASSED [ 47%] 6630s tests/test_core.py::test_expects_comm <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_core.py PASSED [ 47%] 6630s tests/test_core.py::test_async_listener_stop <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_core.py PASSED [ 47%] 6630s tests/test_core.py::test_large_payload <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_core.py SKIPPED [ 47%] 6630s tests/test_counter.py::test_digest[Counter-] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_counter.py PASSED [ 47%] 6630s tests/test_counter.py::test_digest[None-] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_counter.py SKIPPED [ 48%] 6630s tests/test_counter.py::test_counter <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_counter.py PASSED [ 48%] 6631s tests/test_dask_collections.py::test_dataframes <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_dask_collections.py PASSED [ 48%] 6632s tests/test_dask_collections.py::test_dask_array_collections <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_dask_collections.py PASSED [ 48%] 6632s tests/test_dask_collections.py::test_bag_groupby_tasks_default <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_dask_collections.py PASSED [ 48%] 6634s tests/test_dask_collections.py::test_bag_groupby_key_hashing <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_dask_collections.py PASSED [ 48%] 6637s tests/test_dask_collections.py::test_dataframe_set_index_sync[wait] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_dask_collections.py PASSED [ 48%] 6640s tests/test_dask_collections.py::test_dataframe_set_index_sync[] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_dask_collections.py PASSED [ 48%] 6643s tests/test_dask_collections.py::test_loc_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_dask_collections.py PASSED [ 48%] 6645s tests/test_dask_collections.py::test_rolling_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_dask_collections.py PASSED [ 48%] 6645s tests/test_dask_collections.py::test_loc <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_dask_collections.py PASSED [ 48%] 6650s tests/test_dask_collections.py::test_dataframe_groupby_tasks <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_dask_collections.py PASSED [ 48%] 6651s tests/test_dask_collections.py::test_sparse_arrays <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_dask_collections.py SKIPPED [ 48%] 6651s tests/test_dask_collections.py::test_delayed_none <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_dask_collections.py PASSED [ 48%] 6653s tests/test_dask_collections.py::test_tuple_futures_arg[tuple] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_dask_collections.py PASSED [ 48%] 6655s tests/test_dask_collections.py::test_tuple_futures_arg[list] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_dask_collections.py PASSED [ 48%] 6655s tests/test_deadline.py::test_deadline <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_deadline.py PASSED [ 48%] 6655s tests/test_deadline.py::test_infinite_deadline <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_deadline.py PASSED [ 48%] 6655s tests/test_deadline.py::test_deadline_progress <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_deadline.py PASSED [ 48%] 6656s tests/test_deadline.py::test_deadline_expiration <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_deadline.py PASSED [ 48%] 6656s tests/test_deadline.py::test_deadline_expiration_async <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_deadline.py PASSED [ 48%] 6657s tests/test_diskutils.py::test_workdir_simple <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_diskutils.py PASSED [ 48%] 6658s tests/test_diskutils.py::test_two_workspaces_in_same_directory <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_diskutils.py PASSED [ 48%] 6659s tests/test_diskutils.py::test_workspace_process_crash <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_diskutils.py PASSED [ 48%] 6659s tests/test_diskutils.py::test_workspace_rmtree_failure <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_diskutils.py PASSED [ 48%] 6660s tests/test_diskutils.py::test_locking_disabled <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_diskutils.py PASSED [ 48%] 6660s tests/test_diskutils.py::test_workspace_concurrency <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_diskutils.py SKIPPED [ 48%] 6660s tests/test_diskutils.py::test_unwritable_base_dir <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_diskutils.py PASSED [ 48%] 6660s tests/test_event_logging.py::test_log_event <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_event_logging.py PASSED [ 48%] 6660s tests/test_event_logging.py::test_log_events <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_event_logging.py PASSED [ 48%] 6660s tests/test_event_logging.py::test_log_event_e2e <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_event_logging.py PASSED [ 48%] 6660s tests/test_event_logging.py::test_log_event_multiple_clients <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_event_logging.py PASSED [ 48%] 6660s tests/test_event_logging.py::test_events_subscribe_topic <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_event_logging.py PASSED [ 49%] 6661s tests/test_event_logging.py::test_events_subscribe_topic_cancelled <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_event_logging.py PASSED [ 49%] 6661s tests/test_event_logging.py::test_topic_subscribe_unsubscribe <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_event_logging.py PASSED [ 49%] 6662s tests/test_event_logging.py::test_events_all_servers_use_same_channel <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_event_logging.py PASSED [ 49%] 6662s tests/test_event_logging.py::test_events_unsubscribe_raises_if_unknown <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_event_logging.py PASSED [ 49%] 6664s tests/test_event_logging.py::test_log_event_msgpack <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_event_logging.py PASSED [ 49%] 6664s tests/test_event_logging.py::test_configurable_events_log_length <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_event_logging.py PASSED [ 49%] 6666s tests/test_event_logging.py::test_log_event_on_nanny <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_event_logging.py PASSED [ 49%] 6666s tests/test_event_logging.py::test_log_event_on_worker <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_event_logging.py PASSED [ 49%] 6667s tests/test_event_logging.py::test_log_event_plugin <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_event_logging.py PASSED [ 49%] 6667s tests/test_event_logging.py::test_log_event_plugin_multiple_topics <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_event_logging.py PASSED [ 49%] 6668s tests/test_events.py::test_event_on_workers <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_events.py PASSED [ 49%] 6668s tests/test_events.py::test_default_event <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_events.py PASSED [ 49%] 6668s tests/test_events.py::test_set_not_set <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_events.py PASSED [ 49%] 6669s tests/test_events.py::test_set_not_set_many_events <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_events.py PASSED [ 49%] 6669s tests/test_events.py::test_timeout <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_events.py PASSED [ 49%] 6672s tests/test_events.py::test_event_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_events.py PASSED [ 49%] 6672s tests/test_events.py::test_event_types <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_events.py PASSED [ 49%] 6672s tests/test_events.py::test_serializable <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_events.py PASSED [ 49%] 6673s tests/test_events.py::test_two_events_on_workers <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_events.py PASSED [ 49%] 6673s tests/test_events.py::test_unpickle_without_client <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_events.py PASSED [ 49%] 6673s tests/test_failed_workers.py::test_submit_after_failed_worker_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_failed_workers.py SKIPPED [ 49%] 6673s tests/test_failed_workers.py::test_submit_after_failed_worker_async[False-False-closing] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_failed_workers.py PASSED [ 49%] 6674s tests/test_failed_workers.py::test_submit_after_failed_worker_async[False-False-closed] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_failed_workers.py PASSED [ 49%] 6674s tests/test_failed_workers.py::test_submit_after_failed_worker_async[False-True-closing] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_failed_workers.py PASSED [ 49%] 6674s tests/test_failed_workers.py::test_submit_after_failed_worker_async[False-True-closed] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_failed_workers.py PASSED [ 49%] 6674s tests/test_failed_workers.py::test_submit_after_failed_worker_async[True-False-closing] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_failed_workers.py PASSED [ 49%] 6675s tests/test_failed_workers.py::test_submit_after_failed_worker_async[True-False-closed] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_failed_workers.py PASSED [ 49%] 6675s tests/test_failed_workers.py::test_submit_after_failed_worker_async[True-True-closing] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_failed_workers.py PASSED [ 49%] 6675s tests/test_failed_workers.py::test_submit_after_failed_worker_async[True-True-closed] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_failed_workers.py PASSED [ 49%] 6676s tests/test_failed_workers.py::test_submit_after_failed_worker <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_failed_workers.py PASSED [ 49%] 6676s tests/test_failed_workers.py::test_gather_after_failed_worker <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_failed_workers.py SKIPPED [ 49%] 6676s tests/test_failed_workers.py::test_gather_then_submit_after_failed_workers <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_failed_workers.py SKIPPED [ 50%] 6679s tests/test_failed_workers.py::test_restart <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_failed_workers.py PASSED [ 50%] 6682s tests/test_failed_workers.py::test_restart_cleared <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_failed_workers.py PASSED [ 50%] 6687s tests/test_failed_workers.py::test_restart_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_failed_workers.py PASSED [ 50%] 6693s tests/test_failed_workers.py::test_worker_doesnt_await_task_completion <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_failed_workers.py PASSED [ 50%] 6697s tests/test_failed_workers.py::test_multiple_clients_restart <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_failed_workers.py PASSED [ 50%] 6700s tests/test_failed_workers.py::test_restart_scheduler <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_failed_workers.py PASSED [ 50%] 6703s tests/test_failed_workers.py::test_forgotten_futures_dont_clean_up_new_futures <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_failed_workers.py PASSED [ 50%] 6703s tests/test_failed_workers.py::test_broken_worker_during_computation <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_failed_workers.py SKIPPED [ 50%] 6707s tests/test_failed_workers.py::test_restart_during_computation <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_failed_workers.py PASSED [ 50%] 6707s tests/test_failed_workers.py::test_worker_who_has_clears_after_failed_connection <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_failed_workers.py SKIPPED [ 50%] 6708s tests/test_failed_workers.py::test_worker_same_host_replicas_missing <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_failed_workers.py PASSED [ 50%] 6708s tests/test_failed_workers.py::test_restart_timeout_on_long_running_task <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_failed_workers.py SKIPPED [ 50%] 6708s tests/test_failed_workers.py::test_worker_time_to_live <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_failed_workers.py SKIPPED [ 50%] 6708s tests/test_failed_workers.py::test_worker_ttl_restarts_worker[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_failed_workers.py SKIPPED [ 50%] 6708s tests/test_failed_workers.py::test_worker_ttl_restarts_worker[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_failed_workers.py SKIPPED [ 50%] 6708s tests/test_failed_workers.py::test_restart_hung_worker <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_failed_workers.py SKIPPED [ 50%] 6708s tests/test_failed_workers.py::test_forget_data_not_supposed_to_have <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_failed_workers.py PASSED [ 50%] 6711s tests/test_failed_workers.py::test_failing_worker_with_additional_replicas_on_cluster <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_failed_workers.py PASSED [ 50%] 6711s tests/test_gc.py::test_fractional_timer <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_gc.py PASSED [ 50%] 6725s tests/test_gc.py::test_gc_diagnosis_cpu_time <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_gc.py PASSED [ 50%] 6727s tests/test_gc.py::test_gc_diagnosis_rss_win <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_gc.py XFAIL [ 50%] 6729s tests/test_imports.py::test_can_import_distributed_in_background_thread <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_imports.py PASSED [ 50%] 6729s tests/test_init.py::test_version <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_init.py PASSED [ 50%] 6729s tests/test_itertools.py::test_ffill <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_itertools.py PASSED [ 50%] 6729s tests/test_jupyter.py::test_jupyter_cli <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_jupyter.py SKIPPED [ 50%] 6729s tests/test_locks.py::test_lock <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_locks.py PASSED [ 50%] 6730s tests/test_locks.py::test_timeout <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_locks.py PASSED [ 50%] 6730s tests/test_locks.py::test_acquires_with_zero_timeout <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_locks.py PASSED [ 50%] 6730s tests/test_locks.py::test_acquires_blocking <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_locks.py PASSED [ 50%] 6732s tests/test_locks.py::test_timeout_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_locks.py PASSED [ 50%] 6734s tests/test_locks.py::test_lock_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_locks.py PASSED [ 50%] 6735s tests/test_locks.py::test_lock_types <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_locks.py PASSED [ 50%] 6735s tests/test_locks.py::test_serializable <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_locks.py PASSED [ 51%] 6735s tests/test_locks.py::test_serializable_no_ctx <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_locks.py PASSED [ 51%] 6735s tests/test_locks.py::test_locks <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_locks.py PASSED [ 51%] 6735s tests/test_locks.py::test_locks_inf_lease_timeout <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_locks.py PASSED [ 51%] 6735s tests/test_metrics.py::test_wall_clock[time] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_metrics.py PASSED [ 51%] 6735s tests/test_metrics.py::test_wall_clock[monotonic] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_metrics.py PASSED [ 51%] 6735s tests/test_metrics.py::test_monotonic <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_metrics.py SKIPPED [ 51%] 6735s tests/test_metrics.py::test_meter <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_metrics.py PASSED [ 51%] 6735s tests/test_metrics.py::test_meter_raise <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_metrics.py PASSED [ 51%] 6735s tests/test_metrics.py::test_meter_floor[kwargs0-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_metrics.py PASSED [ 51%] 6735s tests/test_metrics.py::test_meter_floor[kwargs1-0.1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_metrics.py PASSED [ 51%] 6735s tests/test_metrics.py::test_meter_floor[kwargs2--1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_metrics.py PASSED [ 51%] 6735s tests/test_metrics.py::test_context_meter <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_metrics.py PASSED [ 51%] 6735s tests/test_metrics.py::test_context_meter_raise <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_metrics.py PASSED [ 51%] 6735s tests/test_metrics.py::test_context_meter_nested <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_metrics.py PASSED [ 51%] 6735s tests/test_metrics.py::test_context_meter_decorator <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_metrics.py PASSED [ 51%] 6735s tests/test_metrics.py::test_context_meter_nested_floor <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_metrics.py PASSED [ 51%] 6735s tests/test_metrics.py::test_context_meter_pickle <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_metrics.py PASSED [ 51%] 6735s tests/test_metrics.py::test_context_meter_clear_callbacks <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_metrics.py PASSED [ 51%] 6735s tests/test_metrics.py::test_context_meter_clear_callbacks_raises <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_metrics.py PASSED [ 51%] 6735s tests/test_metrics.py::test_context_meter_allow_offload <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_metrics.py PASSED [ 51%] 6735s tests/test_metrics.py::test_delayed_metrics_ledger <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_metrics.py PASSED [ 51%] 6735s tests/test_metrics.py::test_context_meter_keyed <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_metrics.py PASSED [ 51%] 6735s tests/test_metrics.py::test_delayed_metrics_ledger_keyed <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_metrics.py PASSED [ 51%] 6737s tests/test_multi_locks.py::test_single_lock <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_multi_locks.py PASSED [ 51%] 6737s tests/test_multi_locks.py::test_timeout <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_multi_locks.py PASSED [ 51%] 6738s tests/test_multi_locks.py::test_timeout_wake_waiter <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_multi_locks.py PASSED [ 51%] 6738s tests/test_multi_locks.py::test_multiple_locks <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_multi_locks.py PASSED [ 51%] 6739s tests/test_multi_locks.py::test_num_locks <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_multi_locks.py PASSED [ 51%] 6741s tests/test_nanny.py::test_str <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 51%] 6743s tests/test_nanny.py::test_nanny_process_failure <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 51%] 6745s tests/test_nanny.py::test_run <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 51%] 6745s tests/test_nanny.py::test_no_hang_when_scheduler_closes <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py SKIPPED [ 52%] 6745s tests/test_nanny.py::test_close_on_disconnect <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py SKIPPED [ 52%] 6747s tests/test_nanny.py::test_nanny_worker_class <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 52%] 6749s tests/test_nanny.py::test_nanny_alt_worker_class <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 52%] 6749s tests/test_nanny.py::test_nanny_death_timeout <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py SKIPPED [ 52%] 6751s tests/test_nanny.py::test_random_seed <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 52%] 6758s tests/test_nanny.py::test_num_fds <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 52%] 6762s tests/test_nanny.py::test_nanny_restart <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 52%] 6765s tests/test_nanny.py::test_nanny_restart_timeout <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 52%] 6768s tests/test_nanny.py::test_nanny_restart_timeout_stress <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 52%] 6769s tests/test_nanny.py::test_throttle_outgoing_transfers <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 52%] 6770s tests/test_nanny.py::test_scheduler_address_config <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 52%] 6770s tests/test_nanny.py::test_wait_for_scheduler <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py SKIPPED [ 52%] 6772s tests/test_nanny.py::test_environment_variable <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 52%] 6773s tests/test_nanny.py::test_environment_variable_by_config <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 52%] 6775s tests/test_nanny.py::test_environment_variable_config <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 52%] 6776s tests/test_nanny.py::test_environment_variable_pre_post_spawn <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 52%] 6778s tests/test_nanny.py::test_environment_variable_overlay <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 52%] 6780s tests/test_nanny.py::test_config_param_overlays <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 52%] 6781s tests/test_nanny.py::test_local_directory <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 52%] 6783s tests/test_nanny.py::test_unwriteable_dask_worker_space <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 52%] 6786s tests/test_nanny.py::test_mp_process_worker_no_daemon <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 52%] 6790s tests/test_nanny.py::test_mp_pool_worker_no_daemon <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 52%] 6792s tests/test_nanny.py::test_nanny_closes_cleanly <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 52%] 6792s tests/test_nanny.py::test_lifetime <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py SKIPPED [ 52%] 6795s tests/test_nanny.py::test_nanny_closes_cleanly_if_worker_is_terminated <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 52%] 6797s tests/test_nanny.py::test_config <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 52%] 6800s tests/test_nanny.py::test_nanny_port_range <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 52%] 6800s tests/test_nanny.py::test_nanny_closed_by_keyboard_interrupt[tcp] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py SKIPPED [ 52%] 6800s tests/test_nanny.py::test_nanny_closed_by_keyboard_interrupt[ucx] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py SKIPPED [ 52%] 6801s tests/test_nanny.py::test_worker_start_exception <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 52%] 6802s tests/test_nanny.py::test_worker_start_exception_while_killing <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 52%] 6803s tests/test_nanny.py::test_failure_during_worker_initialization <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 53%] 6808s tests/test_nanny.py::test_environ_plugin <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 53%] 6810s tests/test_nanny.py::test_no_unnecessary_imports_on_worker[scipy] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 53%] 6812s tests/test_nanny.py::test_no_unnecessary_imports_on_worker[pandas] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py XFAIL [ 53%] 6812s tests/test_nanny.py::test_repeated_restarts <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py SKIPPED [ 53%] 6812s tests/test_nanny.py::test_restart_memory <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py SKIPPED [ 53%] 6812s tests/test_nanny.py::test_close_joins <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py SKIPPED [ 53%] 6815s tests/test_nanny.py::test_scheduler_crash_doesnt_restart <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 53%] 6815s tests/test_nanny.py::test_malloc_trim_threshold <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py SKIPPED [ 53%] 6817s tests/test_nanny.py::test_default_client_does_not_propagate_to_subprocess <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 53%] 6818s tests/test_nanny.py::test_worker_inherits_temp_config <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 53%] 6822s tests/test_nanny.py::test_nanny_plugin_simple <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 53%] 6825s tests/test_nanny.py::test_nanny_plugin_register_during_start_success[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 53%] 6827s tests/test_nanny.py::test_nanny_plugin_register_during_start_success[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 53%] 6828s tests/test_nanny.py::test_nanny_plugin_register_during_start_failure[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 53%] 6828s tests/test_nanny.py::test_nanny_plugin_register_during_start_failure[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 53%] 6829s tests/test_nanny.py::test_nanny_plugin_register_nanny_killed[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 53%] 6830s tests/test_nanny.py::test_nanny_plugin_register_nanny_killed[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py PASSED [ 53%] 6833s tests/test_preload.py::test_worker_preload_file <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_preload.py PASSED [ 53%] 6834s tests/test_preload.py::test_worker_preload_config <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_preload.py PASSED [ 53%] 6836s tests/test_preload.py::test_worker_preload_module <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_preload.py PASSED [ 53%] 6836s tests/test_preload.py::test_worker_preload_click <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_preload.py PASSED [ 53%] 6836s tests/test_preload.py::test_worker_preload_click_async <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_preload.py PASSED [ 53%] 6836s tests/test_preload.py::test_web_preload <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_preload.py PASSED [ 53%] 6836s tests/test_preload.py::test_scheduler_startup <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_preload.py PASSED [ 53%] 6838s tests/test_preload.py::test_scheduler_startup_nanny <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_preload.py PASSED [ 53%] 6839s tests/test_preload.py::test_web_preload_worker <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_preload.py PASSED [ 53%] 6839s tests/test_preload.py::test_client_preload_text <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_preload.py XFAIL [ 53%] 6840s tests/test_preload.py::test_client_preload_config <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_preload.py PASSED [ 53%] 6840s tests/test_preload.py::test_client_preload_click <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_preload.py XFAIL [ 53%] 6840s tests/test_preload.py::test_failure_doesnt_crash_worker <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_preload.py PASSED [ 53%] 6841s tests/test_preload.py::test_failure_doesnt_crash_nanny <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_preload.py PASSED [ 53%] 6841s tests/test_preload.py::test_failure_doesnt_crash_client <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_preload.py PASSED [ 53%] 6842s tests/test_preload.py::test_client_preload_config_click <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_preload.py PASSED [ 54%] 6842s tests/test_priorities.py::test_submit[queue on worker] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_priorities.py PASSED [ 54%] 6842s tests/test_priorities.py::test_submit[queue on scheduler] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_priorities.py PASSED [ 54%] 6842s tests/test_priorities.py::test_map[queue on worker] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_priorities.py PASSED [ 54%] 6842s tests/test_priorities.py::test_map[queue on scheduler] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_priorities.py PASSED [ 54%] 6843s tests/test_priorities.py::test_compute[queue on worker] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_priorities.py PASSED [ 54%] 6843s tests/test_priorities.py::test_compute[queue on scheduler] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_priorities.py PASSED [ 54%] 6843s tests/test_priorities.py::test_persist[queue on worker] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_priorities.py PASSED [ 54%] 6843s tests/test_priorities.py::test_persist[queue on scheduler] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_priorities.py PASSED [ 54%] 6843s tests/test_priorities.py::test_annotate_compute[queue on worker] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_priorities.py PASSED [ 54%] 6844s tests/test_priorities.py::test_annotate_compute[queue on scheduler] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_priorities.py PASSED [ 54%] 6844s tests/test_priorities.py::test_annotate_persist[queue on worker] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_priorities.py PASSED [ 54%] 6844s tests/test_priorities.py::test_annotate_persist[queue on scheduler] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_priorities.py PASSED [ 54%] 6845s tests/test_priorities.py::test_repeated_persists_same_priority[queue on worker] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_priorities.py PASSED [ 54%] 6845s tests/test_priorities.py::test_repeated_persists_same_priority[queue on scheduler] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_priorities.py PASSED [ 54%] 6846s tests/test_priorities.py::test_last_in_first_out[queue on worker] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_priorities.py PASSED [ 54%] 6846s tests/test_priorities.py::test_last_in_first_out[queue on scheduler] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_priorities.py PASSED [ 54%] 6848s tests/test_profile.py::test_basic <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py PASSED [ 54%] 6848s tests/test_profile.py::test_basic_low_level <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py SKIPPED [ 54%] 6848s tests/test_profile.py::test_merge <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py PASSED [ 54%] 6848s tests/test_profile.py::test_merge_empty <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py PASSED [ 54%] 6848s tests/test_profile.py::test_call_stack <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py PASSED [ 54%] 6848s tests/test_profile.py::test_identifier <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py PASSED [ 54%] 6849s tests/test_profile.py::test_watch <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py PASSED [ 54%] 6849s tests/test_profile.py::test_watch_requires_lock_to_run <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py PASSED [ 54%] 6849s tests/test_profile.py::test_info_frame_f_lineno[-1-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py PASSED [ 54%] 6849s tests/test_profile.py::test_info_frame_f_lineno[0-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py PASSED [ 54%] 6849s tests/test_profile.py::test_info_frame_f_lineno[1-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py PASSED [ 54%] 6849s tests/test_profile.py::test_info_frame_f_lineno[11-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py PASSED [ 54%] 6849s tests/test_profile.py::test_info_frame_f_lineno[12-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py PASSED [ 54%] 6849s tests/test_profile.py::test_info_frame_f_lineno[21-4] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py PASSED [ 54%] 6849s tests/test_profile.py::test_info_frame_f_lineno[22-4] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py PASSED [ 54%] 6849s tests/test_profile.py::test_info_frame_f_lineno[23-4] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py PASSED [ 55%] 6849s tests/test_profile.py::test_info_frame_f_lineno[24-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py PASSED [ 55%] 6849s tests/test_profile.py::test_info_frame_f_lineno[25-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py PASSED [ 55%] 6849s tests/test_profile.py::test_info_frame_f_lineno[26-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py PASSED [ 55%] 6849s tests/test_profile.py::test_info_frame_f_lineno[27-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py PASSED [ 55%] 6849s tests/test_profile.py::test_info_frame_f_lineno[100-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py PASSED [ 55%] 6849s tests/test_profile.py::test_call_stack_f_lineno[-1-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py PASSED [ 55%] 6849s tests/test_profile.py::test_call_stack_f_lineno[0-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py PASSED [ 55%] 6849s tests/test_profile.py::test_call_stack_f_lineno[1-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py PASSED [ 55%] 6849s tests/test_profile.py::test_call_stack_f_lineno[11-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py PASSED [ 55%] 6849s tests/test_profile.py::test_call_stack_f_lineno[12-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py PASSED [ 55%] 6849s tests/test_profile.py::test_call_stack_f_lineno[21-4] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py PASSED [ 55%] 6849s tests/test_profile.py::test_call_stack_f_lineno[22-4] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py PASSED [ 55%] 6849s tests/test_profile.py::test_call_stack_f_lineno[23-4] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py PASSED [ 55%] 6849s tests/test_profile.py::test_call_stack_f_lineno[24-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py PASSED [ 55%] 6849s tests/test_profile.py::test_call_stack_f_lineno[25-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py PASSED [ 55%] 6849s tests/test_profile.py::test_call_stack_f_lineno[26-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py PASSED [ 55%] 6849s tests/test_profile.py::test_call_stack_f_lineno[27-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py PASSED [ 55%] 6849s tests/test_profile.py::test_call_stack_f_lineno[100-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py PASSED [ 55%] 6849s tests/test_profile.py::test_builtin <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py PASSED [ 55%] 6850s tests/test_publish.py::test_publish_simple <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_publish.py PASSED [ 55%] 6850s tests/test_publish.py::test_publish_non_string_key <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_publish.py PASSED [ 55%] 6850s tests/test_publish.py::test_publish_roundtrip <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_publish.py PASSED [ 55%] 6850s tests/test_publish.py::test_unpublish <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_publish.py PASSED [ 55%] 6853s tests/test_publish.py::test_unpublish_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_publish.py PASSED [ 55%] 6853s tests/test_publish.py::test_publish_multiple_datasets <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_publish.py PASSED [ 55%] 6855s tests/test_publish.py::test_unpublish_multiple_datasets_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_publish.py PASSED [ 55%] 6855s tests/test_publish.py::test_publish_bag <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_publish.py PASSED [ 55%] 6857s tests/test_publish.py::test_datasets_setitem <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_publish.py PASSED [ 55%] 6859s tests/test_publish.py::test_datasets_getitem <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_publish.py PASSED [ 55%] 6861s tests/test_publish.py::test_datasets_getitem_default <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_publish.py PASSED [ 55%] 6864s tests/test_publish.py::test_datasets_delitem <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_publish.py PASSED [ 55%] 6866s tests/test_publish.py::test_datasets_keys <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_publish.py PASSED [ 56%] 6868s tests/test_publish.py::test_datasets_contains <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_publish.py PASSED [ 56%] 6870s tests/test_publish.py::test_datasets_republish <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_publish.py PASSED [ 56%] 6872s tests/test_publish.py::test_datasets_iter <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_publish.py PASSED [ 56%] 6872s tests/test_publish.py::test_datasets_async <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_publish.py PASSED [ 56%] 6873s tests/test_publish.py::test_pickle_safe <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_publish.py PASSED [ 56%] 6873s tests/test_publish.py::test_deserialize_client <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_publish.py PASSED [ 56%] 6873s tests/test_publish.py::test_publish_submit_ordering <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_publish.py PASSED [ 56%] 6874s tests/test_pubsub.py::test_speed <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_pubsub.py PASSED [ 56%] 6874s tests/test_pubsub.py::test_client <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_pubsub.py PASSED [ 56%] 6874s tests/test_pubsub.py::test_timeouts <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_pubsub.py PASSED [ 56%] 6874s tests/test_pubsub.py::test_repr <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_pubsub.py PASSED [ 56%] 6875s tests/test_pubsub.py::test_basic <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_pubsub.py XPASS [ 56%] 6875s tests/test_queues.py::test_queue <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_queues.py PASSED [ 56%] 6875s tests/test_queues.py::test_queue_with_data <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_queues.py PASSED [ 56%] 6877s tests/test_queues.py::test_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_queues.py PASSED [ 56%] 6878s tests/test_queues.py::test_hold_futures <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_queues.py PASSED [ 56%] 6878s tests/test_queues.py::test_picklability <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_queues.py PASSED [ 56%] 6880s tests/test_queues.py::test_picklability_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_queues.py PASSED [ 56%] 6880s tests/test_queues.py::test_race <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_queues.py SKIPPED [ 56%] 6880s tests/test_queues.py::test_same_futures <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_queues.py PASSED [ 56%] 6881s tests/test_queues.py::test_get_many <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_queues.py PASSED [ 56%] 6881s tests/test_queues.py::test_Future_knows_status_immediately <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_queues.py PASSED [ 56%] 6881s tests/test_queues.py::test_erred_future <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_queues.py PASSED [ 56%] 6881s tests/test_queues.py::test_close <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_queues.py PASSED [ 56%] 6882s tests/test_queues.py::test_timeout <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_queues.py PASSED [ 56%] 6883s tests/test_queues.py::test_2220 <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_queues.py PASSED [ 56%] 6883s tests/test_queues.py::test_unpickle_without_client <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_queues.py PASSED [ 56%] 6883s tests/test_queues.py::test_set_cancelled_future <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_queues.py PASSED [ 56%] 6883s tests/test_reschedule.py::test_scheduler_reschedule_warns <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_reschedule.py PASSED [ 56%] 6884s tests/test_reschedule.py::test_raise_reschedule[executing] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_reschedule.py PASSED [ 56%] 6885s tests/test_reschedule.py::test_raise_reschedule[long-running] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_reschedule.py PASSED [ 56%] 6885s tests/test_reschedule.py::test_cancelled_reschedule[executing] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_reschedule.py PASSED [ 56%] 6885s tests/test_reschedule.py::test_cancelled_reschedule[long-running] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_reschedule.py PASSED [ 57%] 6885s tests/test_reschedule.py::test_cancelled_reschedule_worker_state[executing] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_reschedule.py PASSED [ 57%] 6885s tests/test_reschedule.py::test_cancelled_reschedule_worker_state[long-running] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_reschedule.py PASSED [ 57%] 6885s tests/test_reschedule.py::test_reschedule_releases[executing] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_reschedule.py PASSED [ 57%] 6885s tests/test_reschedule.py::test_reschedule_releases[long-running] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_reschedule.py PASSED [ 57%] 6885s tests/test_reschedule.py::test_reschedule_cancelled[executing] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_reschedule.py PASSED [ 57%] 6885s tests/test_reschedule.py::test_reschedule_cancelled[long-running] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_reschedule.py PASSED [ 57%] 6885s tests/test_reschedule.py::test_reschedule_resumed[executing] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_reschedule.py PASSED [ 57%] 6885s tests/test_reschedule.py::test_reschedule_resumed[long-running] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_reschedule.py PASSED [ 57%] 6885s tests/test_resources.py::test_resource_submit <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 57%] 6886s tests/test_resources.py::test_submit_many_non_overlapping <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 57%] 6887s tests/test_resources.py::test_submit_many_non_overlapping_2 <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 57%] 6887s tests/test_resources.py::test_move <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 57%] 6888s tests/test_resources.py::test_dont_work_steal <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 57%] 6888s tests/test_resources.py::test_map <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 57%] 6888s tests/test_resources.py::test_persist <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 57%] 6889s tests/test_resources.py::test_compute <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 57%] 6889s tests/test_resources.py::test_get <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 57%] 6889s tests/test_resources.py::test_persist_multiple_collections <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 57%] 6889s tests/test_resources.py::test_resources_str <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 57%] 6890s tests/test_resources.py::test_minimum_resource <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 57%] 6890s tests/test_resources.py::test_constrained_vs_ready_priority_1[1-0-y-False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 57%] 6890s tests/test_resources.py::test_constrained_vs_ready_priority_1[1-0-y-True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 57%] 6890s tests/test_resources.py::test_constrained_vs_ready_priority_1[0-1-x-False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 57%] 6890s tests/test_resources.py::test_constrained_vs_ready_priority_1[0-1-x-True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 57%] 6890s tests/test_resources.py::test_constrained_vs_ready_priority_2[1-0-y-False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 57%] 6890s tests/test_resources.py::test_constrained_vs_ready_priority_2[1-0-y-True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 57%] 6890s tests/test_resources.py::test_constrained_vs_ready_priority_2[0-1-x-False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 57%] 6890s tests/test_resources.py::test_constrained_vs_ready_priority_2[0-1-x-True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 57%] 6890s tests/test_resources.py::test_constrained_tasks_respect_priority <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 57%] 6890s tests/test_resources.py::test_task_cancelled_and_readded_with_resources <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 57%] 6890s tests/test_resources.py::test_balance_resources <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py SKIPPED [ 57%] 6890s tests/test_resources.py::test_set_resources <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 58%] 6891s tests/test_resources.py::test_persist_collections <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 58%] 6891s tests/test_resources.py::test_dont_optimize_out <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py SKIPPED [ 58%] 6891s tests/test_resources.py::test_full_collections <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py SKIPPED [ 58%] 6893s tests/test_resources.py::test_collections_get[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py XFAIL [ 58%] 6895s tests/test_resources.py::test_collections_get[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 58%] 6895s tests/test_resources.py::test_resources_from_config <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 58%] 6895s tests/test_resources.py::test_resources_from_python_override_config <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 58%] 6895s tests/test_resources.py::test_cancelled_with_resources[executing-ExecuteSuccessEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 58%] 6895s tests/test_resources.py::test_cancelled_with_resources[executing-ExecuteFailureEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 58%] 6895s tests/test_resources.py::test_cancelled_with_resources[executing-RescheduleEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 58%] 6895s tests/test_resources.py::test_cancelled_with_resources[long-running-ExecuteSuccessEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 58%] 6895s tests/test_resources.py::test_cancelled_with_resources[long-running-ExecuteFailureEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 58%] 6895s tests/test_resources.py::test_cancelled_with_resources[long-running-RescheduleEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 58%] 6895s tests/test_resources.py::test_resumed_with_resources[executing-ExecuteSuccessEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 58%] 6895s tests/test_resources.py::test_resumed_with_resources[executing-ExecuteFailureEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 58%] 6895s tests/test_resources.py::test_resumed_with_resources[executing-RescheduleEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 58%] 6895s tests/test_resources.py::test_resumed_with_resources[long-running-ExecuteSuccessEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 58%] 6895s tests/test_resources.py::test_resumed_with_resources[long-running-ExecuteFailureEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 58%] 6895s tests/test_resources.py::test_resumed_with_resources[long-running-RescheduleEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 58%] 6895s tests/test_resources.py::test_resumed_with_different_resources[executing-ExecuteSuccessEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 58%] 6895s tests/test_resources.py::test_resumed_with_different_resources[executing-ExecuteFailureEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 58%] 6895s tests/test_resources.py::test_resumed_with_different_resources[executing-RescheduleEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 58%] 6895s tests/test_resources.py::test_resumed_with_different_resources[long-running-ExecuteSuccessEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 58%] 6895s tests/test_resources.py::test_resumed_with_different_resources[long-running-ExecuteFailureEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 58%] 6895s tests/test_resources.py::test_resumed_with_different_resources[long-running-RescheduleEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py PASSED [ 58%] 6895s tests/test_scheduler.py::test_administration <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 58%] 6895s tests/test_scheduler.py::test_respect_data_in_memory <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 58%] 6896s tests/test_scheduler.py::test_recompute_released_results <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 58%] 6896s tests/test_scheduler.py::test_decide_worker_with_many_independent_leaves <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 58%] 6896s tests/test_scheduler.py::test_decide_worker_with_restrictions <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 58%] 6897s tests/test_scheduler.py::test_decide_worker_coschedule_order_neighbors[nthreads0-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 58%] 6898s tests/test_scheduler.py::test_decide_worker_coschedule_order_neighbors[nthreads0-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 59%] 6900s tests/test_scheduler.py::test_decide_worker_coschedule_order_neighbors[nthreads0-4] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 59%] 6901s tests/test_scheduler.py::test_decide_worker_coschedule_order_neighbors[nthreads1-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 59%] 6902s tests/test_scheduler.py::test_decide_worker_coschedule_order_neighbors[nthreads1-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 59%] 6903s tests/test_scheduler.py::test_decide_worker_coschedule_order_neighbors[nthreads1-4] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 59%] 6903s tests/test_scheduler.py::test_decide_worker_rootish_while_last_worker_is_retiring <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py SKIPPED [ 59%] 6904s tests/test_scheduler.py::test_graph_execution_width <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 59%] 6906s tests/test_scheduler.py::test_forget_tasks_while_processing <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 59%] 6906s tests/test_scheduler.py::test_restart_while_processing <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py SKIPPED [ 59%] 6906s tests/test_scheduler.py::test_queued_release_multiple_workers <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 59%] 6907s tests/test_scheduler.py::test_queued_paused_new_worker <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 59%] 6907s tests/test_scheduler.py::test_queued_paused_unpaused[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 59%] 6908s tests/test_scheduler.py::test_queued_paused_unpaused[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 59%] 6909s tests/test_scheduler.py::test_queued_remove_add_worker <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 59%] 6909s tests/test_scheduler.py::test_secede_opens_slot <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 59%] 6909s tests/test_scheduler.py::test_saturation_factor[2.5-expected_task_counts0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 59%] 6909s tests/test_scheduler.py::test_saturation_factor[2.0-expected_task_counts1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 59%] 6910s tests/test_scheduler.py::test_saturation_factor[1.1-expected_task_counts2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 59%] 6910s tests/test_scheduler.py::test_saturation_factor[1.0-expected_task_counts3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 59%] 6910s tests/test_scheduler.py::test_saturation_factor[0.1-expected_task_counts4] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 59%] 6911s tests/test_scheduler.py::test_saturation_factor[inf-expected_task_counts5] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 59%] 6911s tests/test_scheduler.py::test_saturation_factor[inf-expected_task_counts6] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 59%] 6911s tests/test_scheduler.py::test_bad_saturation_factor <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 59%] 6911s tests/test_scheduler.py::test_move_data_over_break_restrictions <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 59%] 6912s tests/test_scheduler.py::test_balance_with_restrictions <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 59%] 6912s tests/test_scheduler.py::test_no_valid_workers <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 59%] 6913s tests/test_scheduler.py::test_no_valid_workers_loose_restrictions <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 59%] 6913s tests/test_scheduler.py::test_no_workers[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 59%] 6913s tests/test_scheduler.py::test_no_workers[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 59%] 6913s tests/test_scheduler.py::test_retire_workers_empty <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 59%] 6914s tests/test_scheduler.py::test_retire_workers_lock <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 59%] 6914s tests/test_scheduler.py::test_retire_workers_concurrently <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 59%] 6914s tests/test_scheduler.py::test_server_listens_to_other_ops <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 59%] 6915s tests/test_scheduler.py::test_remove_worker_from_scheduler <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 60%] 6915s tests/test_scheduler.py::test_remove_worker_from_scheduler_warns_on_safe <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 60%] 6915s tests/test_scheduler.py::test_remove_worker_by_name_from_scheduler <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 60%] 6916s tests/test_scheduler.py::test_clear_events_worker_removal <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 60%] 6916s tests/test_scheduler.py::test_clear_events_client_removal <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 60%] 6916s tests/test_scheduler.py::test_add_worker <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 60%] 6916s tests/test_scheduler.py::test_blocked_handlers_are_respected <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 60%] 6916s tests/test_scheduler.py::test_scheduler_init_pulls_blocked_handlers_from_config <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 60%] 6917s tests/test_scheduler.py::test_feed <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 60%] 6917s tests/test_scheduler.py::test_feed_setup_teardown <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 60%] 6918s tests/test_scheduler.py::test_feed_large_bytestring <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 60%] 6918s tests/test_scheduler.py::test_delete_data <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 60%] 6918s tests/test_scheduler.py::test_delete <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 60%] 6918s tests/test_scheduler.py::test_dumps_function <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 60%] 6918s tests/test_scheduler.py::test_ready_remove_worker[1.0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 60%] 6919s tests/test_scheduler.py::test_ready_remove_worker[inf] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 60%] 6919s tests/test_scheduler.py::test_restart <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py SKIPPED [ 60%] 6919s tests/test_scheduler.py::test_restart_waits_for_new_workers <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py SKIPPED [ 60%] 6919s tests/test_scheduler.py::test_restart_nanny_timeout_exceeded <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py SKIPPED [ 60%] 6920s tests/test_scheduler.py::test_restart_not_all_workers_return <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 60%] 6920s tests/test_scheduler.py::test_restart_worker_rejoins_after_timeout_expired <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 60%] 6921s tests/test_scheduler.py::test_restart_no_wait_for_workers <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 60%] 6921s tests/test_scheduler.py::test_restart_some_nannies_some_not <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py SKIPPED [ 60%] 6921s tests/test_scheduler.py::test_restart_heartbeat_before_closing <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py SKIPPED [ 60%] 6921s tests/test_scheduler.py::test_broadcast <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 60%] 6921s tests/test_scheduler.py::test_broadcast_tls <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 60%] 6923s tests/test_scheduler.py::test_broadcast_nanny <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 60%] 6924s tests/test_scheduler.py::test_broadcast_on_error <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 60%] 6924s tests/test_scheduler.py::test_broadcast_deprecation <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 60%] 6924s tests/test_scheduler.py::test_worker_name <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 60%] 6924s tests/test_scheduler.py::test_coerce_address <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 60%] 6924s tests/test_scheduler.py::test_config_stealing <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 60%] 6924s tests/test_scheduler.py::test_config_no_stealing <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 61%] 6925s tests/test_scheduler.py::test_update_graph_culls <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 61%] 6925s tests/test_scheduler.py::test_io_loop <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 61%] 6925s tests/test_scheduler.py::test_story <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 61%] 6925s tests/test_scheduler.py::test_scatter_no_workers[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 61%] 6926s tests/test_scheduler.py::test_scatter_no_workers[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 61%] 6926s tests/test_scheduler.py::test_scheduler_sees_memory_limits <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 61%] 6927s tests/test_scheduler.py::test_retire_workers <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 61%] 6927s tests/test_scheduler.py::test_retire_workers_n <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 61%] 6927s tests/test_scheduler.py::test_workers_to_close <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 61%] 6928s tests/test_scheduler.py::test_workers_to_close_grouped <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 61%] 6928s tests/test_scheduler.py::test_workers_to_close_never_close_long_running[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 61%] 6928s tests/test_scheduler.py::test_workers_to_close_never_close_long_running[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 61%] 6929s tests/test_scheduler.py::test_retire_workers_no_suspicious_tasks <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 61%] 6929s tests/test_scheduler.py::test_file_descriptors <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py SKIPPED [ 61%] 6929s tests/test_scheduler.py::test_learn_occupancy <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py SKIPPED [ 61%] 6929s tests/test_scheduler.py::test_learn_occupancy_2 <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py SKIPPED [ 61%] 6932s tests/test_scheduler.py::test_balance_many_workers <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 61%] 6935s tests/test_scheduler.py::test_balance_many_workers_2 <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 61%] 6938s tests/test_scheduler.py::test_include_communication_in_occupancy <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 61%] 6938s tests/test_scheduler.py::test_nonempty_data_is_rejected <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 61%] 6940s tests/test_scheduler.py::test_worker_arrives_with_data_is_rejected <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 61%] 6941s tests/test_scheduler.py::test_run_on_scheduler_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 61%] 6942s tests/test_scheduler.py::test_run_on_scheduler <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 61%] 6942s tests/test_scheduler.py::test_allow_pickle_false <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 61%] 6942s tests/test_scheduler.py::test_close_worker <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 61%] 6942s tests/test_scheduler.py::test_close_nanny <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py SKIPPED [ 61%] 6942s tests/test_scheduler.py::test_retire_workers_close <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 61%] 6942s tests/test_scheduler.py::test_retire_nannies_close <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py SKIPPED [ 61%] 6944s tests/test_scheduler.py::test_fifo_submission <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 61%] 6945s tests/test_scheduler.py::test_profile_metadata <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 61%] 6946s tests/test_scheduler.py::test_profile_metadata_timeout <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 61%] 6946s tests/test_scheduler.py::test_profile_metadata_keys <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 62%] 6947s tests/test_scheduler.py::test_statistical_profiling <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 62%] 6948s tests/test_scheduler.py::test_statistical_profiling_failure <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 62%] 6948s tests/test_scheduler.py::test_cancel_fire_and_forget <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 62%] 6948s tests/test_scheduler.py::test_log_tasks_during_restart <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py SKIPPED [ 62%] 6949s tests/test_scheduler.py::test_get_task_status <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 62%] 6949s tests/test_scheduler.py::test_deque_handler <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 62%] 6949s tests/test_scheduler.py::test_retries <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 62%] 6950s tests/test_scheduler.py::test_missing_data_errant_worker <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 62%] 6950s tests/test_scheduler.py::test_dont_recompute_if_persisted <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 62%] 6951s tests/test_scheduler.py::test_dont_recompute_if_persisted_2 <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 62%] 6951s tests/test_scheduler.py::test_dont_recompute_if_persisted_3 <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 62%] 6952s tests/test_scheduler.py::test_dont_recompute_if_persisted_4 <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 62%] 6952s tests/test_scheduler.py::test_dont_forget_released_keys <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 62%] 6953s tests/test_scheduler.py::test_dont_recompute_if_erred <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 62%] 6953s tests/test_scheduler.py::test_closing_scheduler_closes_workers <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 62%] 6953s tests/test_scheduler.py::test_resources_reset_after_cancelled_task <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 62%] 6954s tests/test_scheduler.py::test_gh2187 <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 62%] 6954s tests/test_scheduler.py::test_collect_versions <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 62%] 6954s tests/test_scheduler.py::test_idle_timeout <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py SKIPPED [ 62%] 6954s tests/test_scheduler.py::test_idle_during_update_graph <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 62%] 6955s tests/test_scheduler.py::test_idle_timeout_no_workers <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 62%] 6955s tests/test_scheduler.py::test_no_workers_timeout_disabled <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 62%] 6955s tests/test_scheduler.py::test_no_workers_timeout_without_workers <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py SKIPPED [ 62%] 6955s tests/test_scheduler.py::test_no_workers_timeout_bad_restrictions <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py SKIPPED [ 62%] 6956s tests/test_scheduler.py::test_no_workers_timeout_queued <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 62%] 6956s tests/test_scheduler.py::test_no_workers_timeout_processing <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py SKIPPED [ 62%] 6956s tests/test_scheduler.py::test_bandwidth <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 62%] 6956s tests/test_scheduler.py::test_bandwidth_clear <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py SKIPPED [ 62%] 6956s tests/test_scheduler.py::test_workerstate_clean <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 62%] 6957s tests/test_scheduler.py::test_result_type <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 62%] 6957s tests/test_scheduler.py::test_close_workers <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 62%] 6957s tests/test_scheduler.py::test_host_address <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 62%] 6957s tests/test_scheduler.py::test_dashboard_address <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py SKIPPED [ 63%] 6958s tests/test_scheduler.py::test_adaptive_target <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 63%] 6958s tests/test_scheduler.py::test_adaptive_target_empty_cluster[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 63%] 6958s tests/test_scheduler.py::test_adaptive_target_empty_cluster[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 63%] 6958s tests/test_scheduler.py::test_retire_names_str <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 63%] 6959s tests/test_scheduler.py::test_retire_workers_bad_params <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 63%] 6959s tests/test_scheduler.py::test_get_task_duration <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 63%] 6961s tests/test_scheduler.py::test_default_task_duration_splits <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 63%] 6961s tests/test_scheduler.py::test_task_group_and_prefix_statistics <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 63%] 6962s tests/test_scheduler.py::test_task_groups_update_start_stop <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 63%] 6962s tests/test_scheduler.py::test_task_group_done <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 63%] 6962s tests/test_scheduler.py::test_task_group_not_done_waiting <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 63%] 6963s tests/test_scheduler.py::test_task_group_not_done_noworker <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 63%] 6963s tests/test_scheduler.py::test_task_group_not_done_queued <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 63%] 6963s tests/test_scheduler.py::test_task_group_not_done_processing <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 63%] 6963s tests/test_scheduler.py::test_task_prefix <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 63%] 6963s tests/test_scheduler.py::test_failing_task_increments_suspicious <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py SKIPPED [ 63%] 6964s tests/test_scheduler.py::test_task_group_non_tuple_key <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 63%] 6964s tests/test_scheduler.py::test_task_unique_groups <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 63%] 6965s tests/test_scheduler.py::test_task_group_on_fire_and_forget <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 63%] 6965s tests/test_scheduler.py::test_gather_failing_can_recover <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 63%] 6966s tests/test_scheduler.py::test_gather_failing_cnn_error <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 63%] 6967s tests/test_scheduler.py::test_gather_no_workers <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 63%] 6967s tests/test_scheduler.py::test_gather_bad_worker[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 63%] 6967s tests/test_scheduler.py::test_gather_bad_worker[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 63%] 6968s tests/test_scheduler.py::test_too_many_groups <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 63%] 6968s tests/test_scheduler.py::test_worker_name_collision <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 63%] 6968s tests/test_scheduler.py::test_unknown_task_duration_config <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 63%] 6968s tests/test_scheduler.py::test_unknown_task_duration_config_2 <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 63%] 6969s tests/test_scheduler.py::test_retire_state_change <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 63%] 6969s tests/test_scheduler.py::test_get_worker_monitor_info <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 63%] 6969s tests/test_scheduler.py::test_quiet_cluster_round_robin <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 63%] 6969s tests/test_scheduler.py::test_memorystate <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 64%] 6969s tests/test_scheduler.py::test_memorystate_sum <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 64%] 6969s tests/test_scheduler.py::test_memorystate_adds_up[0-0-0-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 64%] 6969s tests/test_scheduler.py::test_memorystate_adds_up[0-0-0-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 64%] 6969s tests/test_scheduler.py::test_memorystate_adds_up[0-0-0-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 64%] 6969s tests/test_scheduler.py::test_memorystate_adds_up[0-0-0-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 64%] 6969s tests/test_scheduler.py::test_memorystate_adds_up[0-0-1-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 64%] 6969s tests/test_scheduler.py::test_memorystate_adds_up[0-0-1-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 64%] 6969s tests/test_scheduler.py::test_memorystate_adds_up[0-0-1-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 64%] 6969s tests/test_scheduler.py::test_memorystate_adds_up[0-0-1-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 64%] 6969s tests/test_scheduler.py::test_memorystate_adds_up[0-0-2-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 64%] 6969s tests/test_scheduler.py::test_memorystate_adds_up[0-0-2-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 64%] 6969s tests/test_scheduler.py::test_memorystate_adds_up[0-0-2-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 64%] 6969s tests/test_scheduler.py::test_memorystate_adds_up[0-0-2-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 64%] 6969s tests/test_scheduler.py::test_memorystate_adds_up[0-0-3-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 64%] 6969s tests/test_scheduler.py::test_memorystate_adds_up[0-0-3-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 64%] 6969s tests/test_scheduler.py::test_memorystate_adds_up[0-0-3-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 64%] 6969s tests/test_scheduler.py::test_memorystate_adds_up[0-0-3-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 64%] 6969s tests/test_scheduler.py::test_memorystate_adds_up[0-1-0-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 64%] 6969s tests/test_scheduler.py::test_memorystate_adds_up[0-1-0-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 64%] 6969s tests/test_scheduler.py::test_memorystate_adds_up[0-1-0-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 64%] 6969s tests/test_scheduler.py::test_memorystate_adds_up[0-1-0-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 64%] 6969s tests/test_scheduler.py::test_memorystate_adds_up[0-1-1-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 64%] 6969s tests/test_scheduler.py::test_memorystate_adds_up[0-1-1-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 64%] 6969s tests/test_scheduler.py::test_memorystate_adds_up[0-1-1-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 64%] 6969s tests/test_scheduler.py::test_memorystate_adds_up[0-1-1-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 64%] 6969s tests/test_scheduler.py::test_memorystate_adds_up[0-1-2-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 64%] 6969s tests/test_scheduler.py::test_memorystate_adds_up[0-1-2-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 64%] 6969s tests/test_scheduler.py::test_memorystate_adds_up[0-1-2-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 64%] 6969s tests/test_scheduler.py::test_memorystate_adds_up[0-1-2-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 64%] 6969s tests/test_scheduler.py::test_memorystate_adds_up[0-1-3-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 64%] 6969s tests/test_scheduler.py::test_memorystate_adds_up[0-1-3-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 64%] 6969s tests/test_scheduler.py::test_memorystate_adds_up[0-1-3-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 65%] 6969s tests/test_scheduler.py::test_memorystate_adds_up[0-1-3-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 65%] 6969s tests/test_scheduler.py::test_memorystate_adds_up[0-2-0-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 65%] 6969s tests/test_scheduler.py::test_memorystate_adds_up[0-2-0-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 65%] 6969s tests/test_scheduler.py::test_memorystate_adds_up[0-2-0-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 65%] 6969s tests/test_scheduler.py::test_memorystate_adds_up[0-2-0-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 65%] 6969s tests/test_scheduler.py::test_memorystate_adds_up[0-2-1-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 65%] 6969s tests/test_scheduler.py::test_memorystate_adds_up[0-2-1-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 65%] 6969s tests/test_scheduler.py::test_memorystate_adds_up[0-2-1-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 65%] 6969s tests/test_scheduler.py::test_memorystate_adds_up[0-2-1-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 65%] 6969s tests/test_scheduler.py::test_memorystate_adds_up[0-2-2-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 65%] 6969s tests/test_scheduler.py::test_memorystate_adds_up[0-2-2-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 65%] 6969s tests/test_scheduler.py::test_memorystate_adds_up[0-2-2-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 65%] 6969s tests/test_scheduler.py::test_memorystate_adds_up[0-2-2-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 65%] 6969s tests/test_scheduler.py::test_memorystate_adds_up[0-2-3-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 65%] 6969s tests/test_scheduler.py::test_memorystate_adds_up[0-2-3-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 65%] 6969s tests/test_scheduler.py::test_memorystate_adds_up[0-2-3-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 65%] 6969s tests/test_scheduler.py::test_memorystate_adds_up[0-2-3-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 65%] 6969s tests/test_scheduler.py::test_memorystate_adds_up[0-3-0-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 65%] 6969s tests/test_scheduler.py::test_memorystate_adds_up[0-3-0-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 65%] 6969s tests/test_scheduler.py::test_memorystate_adds_up[0-3-0-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 65%] 6969s tests/test_scheduler.py::test_memorystate_adds_up[0-3-0-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 65%] 6969s tests/test_scheduler.py::test_memorystate_adds_up[0-3-1-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 65%] 6969s tests/test_scheduler.py::test_memorystate_adds_up[0-3-1-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 65%] 6969s tests/test_scheduler.py::test_memorystate_adds_up[0-3-1-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 65%] 6969s tests/test_scheduler.py::test_memorystate_adds_up[0-3-1-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 65%] 6969s tests/test_scheduler.py::test_memorystate_adds_up[0-3-2-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 65%] 6969s tests/test_scheduler.py::test_memorystate_adds_up[0-3-2-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 65%] 6969s tests/test_scheduler.py::test_memorystate_adds_up[0-3-2-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 65%] 6969s tests/test_scheduler.py::test_memorystate_adds_up[0-3-2-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 65%] 6969s tests/test_scheduler.py::test_memorystate_adds_up[0-3-3-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 65%] 6969s tests/test_scheduler.py::test_memorystate_adds_up[0-3-3-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 65%] 6969s tests/test_scheduler.py::test_memorystate_adds_up[0-3-3-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 65%] 6969s tests/test_scheduler.py::test_memorystate_adds_up[0-3-3-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 66%] 6969s tests/test_scheduler.py::test_memorystate_adds_up[1-0-0-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 66%] 6969s tests/test_scheduler.py::test_memorystate_adds_up[1-0-0-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 66%] 6969s tests/test_scheduler.py::test_memorystate_adds_up[1-0-0-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 66%] 6969s tests/test_scheduler.py::test_memorystate_adds_up[1-0-0-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 66%] 6969s tests/test_scheduler.py::test_memorystate_adds_up[1-0-1-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 66%] 6969s tests/test_scheduler.py::test_memorystate_adds_up[1-0-1-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 66%] 6969s tests/test_scheduler.py::test_memorystate_adds_up[1-0-1-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 66%] 6969s tests/test_scheduler.py::test_memorystate_adds_up[1-0-1-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 66%] 6969s tests/test_scheduler.py::test_memorystate_adds_up[1-0-2-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 66%] 6969s tests/test_scheduler.py::test_memorystate_adds_up[1-0-2-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 66%] 6969s tests/test_scheduler.py::test_memorystate_adds_up[1-0-2-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 66%] 6969s tests/test_scheduler.py::test_memorystate_adds_up[1-0-2-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 66%] 6969s tests/test_scheduler.py::test_memorystate_adds_up[1-0-3-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 66%] 6969s tests/test_scheduler.py::test_memorystate_adds_up[1-0-3-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 66%] 6969s tests/test_scheduler.py::test_memorystate_adds_up[1-0-3-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 66%] 6969s tests/test_scheduler.py::test_memorystate_adds_up[1-0-3-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 66%] 6969s tests/test_scheduler.py::test_memorystate_adds_up[1-1-0-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 66%] 6969s tests/test_scheduler.py::test_memorystate_adds_up[1-1-0-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 66%] 6969s tests/test_scheduler.py::test_memorystate_adds_up[1-1-0-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 66%] 6969s tests/test_scheduler.py::test_memorystate_adds_up[1-1-0-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 66%] 6969s tests/test_scheduler.py::test_memorystate_adds_up[1-1-1-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 66%] 6969s tests/test_scheduler.py::test_memorystate_adds_up[1-1-1-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 66%] 6969s tests/test_scheduler.py::test_memorystate_adds_up[1-1-1-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 66%] 6969s tests/test_scheduler.py::test_memorystate_adds_up[1-1-1-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 66%] 6969s tests/test_scheduler.py::test_memorystate_adds_up[1-1-2-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 66%] 6969s tests/test_scheduler.py::test_memorystate_adds_up[1-1-2-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 66%] 6969s tests/test_scheduler.py::test_memorystate_adds_up[1-1-2-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 66%] 6969s tests/test_scheduler.py::test_memorystate_adds_up[1-1-2-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 66%] 6969s tests/test_scheduler.py::test_memorystate_adds_up[1-1-3-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 66%] 6969s tests/test_scheduler.py::test_memorystate_adds_up[1-1-3-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 66%] 6969s tests/test_scheduler.py::test_memorystate_adds_up[1-1-3-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 66%] 6969s tests/test_scheduler.py::test_memorystate_adds_up[1-1-3-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 67%] 6969s tests/test_scheduler.py::test_memorystate_adds_up[1-2-0-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 67%] 6969s tests/test_scheduler.py::test_memorystate_adds_up[1-2-0-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 67%] 6969s tests/test_scheduler.py::test_memorystate_adds_up[1-2-0-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 67%] 6969s tests/test_scheduler.py::test_memorystate_adds_up[1-2-0-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 67%] 6969s tests/test_scheduler.py::test_memorystate_adds_up[1-2-1-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 67%] 6969s tests/test_scheduler.py::test_memorystate_adds_up[1-2-1-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 67%] 6969s tests/test_scheduler.py::test_memorystate_adds_up[1-2-1-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 67%] 6969s tests/test_scheduler.py::test_memorystate_adds_up[1-2-1-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 67%] 6969s tests/test_scheduler.py::test_memorystate_adds_up[1-2-2-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 67%] 6969s tests/test_scheduler.py::test_memorystate_adds_up[1-2-2-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 67%] 6969s tests/test_scheduler.py::test_memorystate_adds_up[1-2-2-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 67%] 6969s tests/test_scheduler.py::test_memorystate_adds_up[1-2-2-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 67%] 6969s tests/test_scheduler.py::test_memorystate_adds_up[1-2-3-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 67%] 6969s tests/test_scheduler.py::test_memorystate_adds_up[1-2-3-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 67%] 6969s tests/test_scheduler.py::test_memorystate_adds_up[1-2-3-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 67%] 6969s tests/test_scheduler.py::test_memorystate_adds_up[1-2-3-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 67%] 6969s tests/test_scheduler.py::test_memorystate_adds_up[1-3-0-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 67%] 6969s tests/test_scheduler.py::test_memorystate_adds_up[1-3-0-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 67%] 6969s tests/test_scheduler.py::test_memorystate_adds_up[1-3-0-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 67%] 6969s tests/test_scheduler.py::test_memorystate_adds_up[1-3-0-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 67%] 6969s tests/test_scheduler.py::test_memorystate_adds_up[1-3-1-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 67%] 6969s tests/test_scheduler.py::test_memorystate_adds_up[1-3-1-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 67%] 6969s tests/test_scheduler.py::test_memorystate_adds_up[1-3-1-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 67%] 6969s tests/test_scheduler.py::test_memorystate_adds_up[1-3-1-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 67%] 6969s tests/test_scheduler.py::test_memorystate_adds_up[1-3-2-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 67%] 6969s tests/test_scheduler.py::test_memorystate_adds_up[1-3-2-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 67%] 6969s tests/test_scheduler.py::test_memorystate_adds_up[1-3-2-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 67%] 6969s tests/test_scheduler.py::test_memorystate_adds_up[1-3-2-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 67%] 6969s tests/test_scheduler.py::test_memorystate_adds_up[1-3-3-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 67%] 6969s tests/test_scheduler.py::test_memorystate_adds_up[1-3-3-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 67%] 6969s tests/test_scheduler.py::test_memorystate_adds_up[1-3-3-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 67%] 6969s tests/test_scheduler.py::test_memorystate_adds_up[1-3-3-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 68%] 6969s tests/test_scheduler.py::test_memorystate_adds_up[2-0-0-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 68%] 6969s tests/test_scheduler.py::test_memorystate_adds_up[2-0-0-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 68%] 6969s tests/test_scheduler.py::test_memorystate_adds_up[2-0-0-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 68%] 6969s tests/test_scheduler.py::test_memorystate_adds_up[2-0-0-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 68%] 6969s tests/test_scheduler.py::test_memorystate_adds_up[2-0-1-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 68%] 6969s tests/test_scheduler.py::test_memorystate_adds_up[2-0-1-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 68%] 6969s tests/test_scheduler.py::test_memorystate_adds_up[2-0-1-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 68%] 6969s tests/test_scheduler.py::test_memorystate_adds_up[2-0-1-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 68%] 6969s tests/test_scheduler.py::test_memorystate_adds_up[2-0-2-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 68%] 6969s tests/test_scheduler.py::test_memorystate_adds_up[2-0-2-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 68%] 6969s tests/test_scheduler.py::test_memorystate_adds_up[2-0-2-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 68%] 6969s tests/test_scheduler.py::test_memorystate_adds_up[2-0-2-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 68%] 6969s tests/test_scheduler.py::test_memorystate_adds_up[2-0-3-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 68%] 6969s tests/test_scheduler.py::test_memorystate_adds_up[2-0-3-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 68%] 6969s tests/test_scheduler.py::test_memorystate_adds_up[2-0-3-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 68%] 6969s tests/test_scheduler.py::test_memorystate_adds_up[2-0-3-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 68%] 6969s tests/test_scheduler.py::test_memorystate_adds_up[2-1-0-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 68%] 6969s tests/test_scheduler.py::test_memorystate_adds_up[2-1-0-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 68%] 6970s tests/test_scheduler.py::test_memorystate_adds_up[2-1-0-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 68%] 6970s tests/test_scheduler.py::test_memorystate_adds_up[2-1-0-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 68%] 6970s tests/test_scheduler.py::test_memorystate_adds_up[2-1-1-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 68%] 6970s tests/test_scheduler.py::test_memorystate_adds_up[2-1-1-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 68%] 6970s tests/test_scheduler.py::test_memorystate_adds_up[2-1-1-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 68%] 6970s tests/test_scheduler.py::test_memorystate_adds_up[2-1-1-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 68%] 6970s tests/test_scheduler.py::test_memorystate_adds_up[2-1-2-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 68%] 6970s tests/test_scheduler.py::test_memorystate_adds_up[2-1-2-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 68%] 6970s tests/test_scheduler.py::test_memorystate_adds_up[2-1-2-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 68%] 6970s tests/test_scheduler.py::test_memorystate_adds_up[2-1-2-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 68%] 6970s tests/test_scheduler.py::test_memorystate_adds_up[2-1-3-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 68%] 6970s tests/test_scheduler.py::test_memorystate_adds_up[2-1-3-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 68%] 6970s tests/test_scheduler.py::test_memorystate_adds_up[2-1-3-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 68%] 6970s tests/test_scheduler.py::test_memorystate_adds_up[2-1-3-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 68%] 6970s tests/test_scheduler.py::test_memorystate_adds_up[2-2-0-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 69%] 6970s tests/test_scheduler.py::test_memorystate_adds_up[2-2-0-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 69%] 6970s tests/test_scheduler.py::test_memorystate_adds_up[2-2-0-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 69%] 6970s tests/test_scheduler.py::test_memorystate_adds_up[2-2-0-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 69%] 6970s tests/test_scheduler.py::test_memorystate_adds_up[2-2-1-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 69%] 6970s tests/test_scheduler.py::test_memorystate_adds_up[2-2-1-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 69%] 6970s tests/test_scheduler.py::test_memorystate_adds_up[2-2-1-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 69%] 6970s tests/test_scheduler.py::test_memorystate_adds_up[2-2-1-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 69%] 6970s tests/test_scheduler.py::test_memorystate_adds_up[2-2-2-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 69%] 6970s tests/test_scheduler.py::test_memorystate_adds_up[2-2-2-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 69%] 6970s tests/test_scheduler.py::test_memorystate_adds_up[2-2-2-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 69%] 6970s tests/test_scheduler.py::test_memorystate_adds_up[2-2-2-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 69%] 6970s tests/test_scheduler.py::test_memorystate_adds_up[2-2-3-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 69%] 6970s tests/test_scheduler.py::test_memorystate_adds_up[2-2-3-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 69%] 6970s tests/test_scheduler.py::test_memorystate_adds_up[2-2-3-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 69%] 6970s tests/test_scheduler.py::test_memorystate_adds_up[2-2-3-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 69%] 6970s tests/test_scheduler.py::test_memorystate_adds_up[2-3-0-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 69%] 6970s tests/test_scheduler.py::test_memorystate_adds_up[2-3-0-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 69%] 6970s tests/test_scheduler.py::test_memorystate_adds_up[2-3-0-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 69%] 6970s tests/test_scheduler.py::test_memorystate_adds_up[2-3-0-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 69%] 6970s tests/test_scheduler.py::test_memorystate_adds_up[2-3-1-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 69%] 6970s tests/test_scheduler.py::test_memorystate_adds_up[2-3-1-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 69%] 6970s tests/test_scheduler.py::test_memorystate_adds_up[2-3-1-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 69%] 6970s tests/test_scheduler.py::test_memorystate_adds_up[2-3-1-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 69%] 6970s tests/test_scheduler.py::test_memorystate_adds_up[2-3-2-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 69%] 6970s tests/test_scheduler.py::test_memorystate_adds_up[2-3-2-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 69%] 6970s tests/test_scheduler.py::test_memorystate_adds_up[2-3-2-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 69%] 6970s tests/test_scheduler.py::test_memorystate_adds_up[2-3-2-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 69%] 6970s tests/test_scheduler.py::test_memorystate_adds_up[2-3-3-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 69%] 6970s tests/test_scheduler.py::test_memorystate_adds_up[2-3-3-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 69%] 6970s tests/test_scheduler.py::test_memorystate_adds_up[2-3-3-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 69%] 6970s tests/test_scheduler.py::test_memorystate_adds_up[2-3-3-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 69%] 6970s tests/test_scheduler.py::test_memorystate_adds_up[3-0-0-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 70%] 6970s tests/test_scheduler.py::test_memorystate_adds_up[3-0-0-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 70%] 6970s tests/test_scheduler.py::test_memorystate_adds_up[3-0-0-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 70%] 6970s tests/test_scheduler.py::test_memorystate_adds_up[3-0-0-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 70%] 6970s tests/test_scheduler.py::test_memorystate_adds_up[3-0-1-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 70%] 6970s tests/test_scheduler.py::test_memorystate_adds_up[3-0-1-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 70%] 6970s tests/test_scheduler.py::test_memorystate_adds_up[3-0-1-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 70%] 6970s tests/test_scheduler.py::test_memorystate_adds_up[3-0-1-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 70%] 6970s tests/test_scheduler.py::test_memorystate_adds_up[3-0-2-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 70%] 6970s tests/test_scheduler.py::test_memorystate_adds_up[3-0-2-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 70%] 6970s tests/test_scheduler.py::test_memorystate_adds_up[3-0-2-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 70%] 6970s tests/test_scheduler.py::test_memorystate_adds_up[3-0-2-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 70%] 6970s tests/test_scheduler.py::test_memorystate_adds_up[3-0-3-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 70%] 6970s tests/test_scheduler.py::test_memorystate_adds_up[3-0-3-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 70%] 6970s tests/test_scheduler.py::test_memorystate_adds_up[3-0-3-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 70%] 6970s tests/test_scheduler.py::test_memorystate_adds_up[3-0-3-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 70%] 6970s tests/test_scheduler.py::test_memorystate_adds_up[3-1-0-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 70%] 6970s tests/test_scheduler.py::test_memorystate_adds_up[3-1-0-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 70%] 6970s tests/test_scheduler.py::test_memorystate_adds_up[3-1-0-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 70%] 6970s tests/test_scheduler.py::test_memorystate_adds_up[3-1-0-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 70%] 6970s tests/test_scheduler.py::test_memorystate_adds_up[3-1-1-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 70%] 6970s tests/test_scheduler.py::test_memorystate_adds_up[3-1-1-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 70%] 6970s tests/test_scheduler.py::test_memorystate_adds_up[3-1-1-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 70%] 6970s tests/test_scheduler.py::test_memorystate_adds_up[3-1-1-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 70%] 6970s tests/test_scheduler.py::test_memorystate_adds_up[3-1-2-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 70%] 6970s tests/test_scheduler.py::test_memorystate_adds_up[3-1-2-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 70%] 6970s tests/test_scheduler.py::test_memorystate_adds_up[3-1-2-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 70%] 6970s tests/test_scheduler.py::test_memorystate_adds_up[3-1-2-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 70%] 6970s tests/test_scheduler.py::test_memorystate_adds_up[3-1-3-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 70%] 6970s tests/test_scheduler.py::test_memorystate_adds_up[3-1-3-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 70%] 6970s tests/test_scheduler.py::test_memorystate_adds_up[3-1-3-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 70%] 6970s tests/test_scheduler.py::test_memorystate_adds_up[3-1-3-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 70%] 6970s tests/test_scheduler.py::test_memorystate_adds_up[3-2-0-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 71%] 6970s tests/test_scheduler.py::test_memorystate_adds_up[3-2-0-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 71%] 6970s tests/test_scheduler.py::test_memorystate_adds_up[3-2-0-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 71%] 6970s tests/test_scheduler.py::test_memorystate_adds_up[3-2-0-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 71%] 6970s tests/test_scheduler.py::test_memorystate_adds_up[3-2-1-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 71%] 6970s tests/test_scheduler.py::test_memorystate_adds_up[3-2-1-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 71%] 6970s tests/test_scheduler.py::test_memorystate_adds_up[3-2-1-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 71%] 6970s tests/test_scheduler.py::test_memorystate_adds_up[3-2-1-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 71%] 6970s tests/test_scheduler.py::test_memorystate_adds_up[3-2-2-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 71%] 6970s tests/test_scheduler.py::test_memorystate_adds_up[3-2-2-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 71%] 6970s tests/test_scheduler.py::test_memorystate_adds_up[3-2-2-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 71%] 6970s tests/test_scheduler.py::test_memorystate_adds_up[3-2-2-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 71%] 6970s tests/test_scheduler.py::test_memorystate_adds_up[3-2-3-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 71%] 6970s tests/test_scheduler.py::test_memorystate_adds_up[3-2-3-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 71%] 6970s tests/test_scheduler.py::test_memorystate_adds_up[3-2-3-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 71%] 6970s tests/test_scheduler.py::test_memorystate_adds_up[3-2-3-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 71%] 6970s tests/test_scheduler.py::test_memorystate_adds_up[3-3-0-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 71%] 6970s tests/test_scheduler.py::test_memorystate_adds_up[3-3-0-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 71%] 6970s tests/test_scheduler.py::test_memorystate_adds_up[3-3-0-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 71%] 6970s tests/test_scheduler.py::test_memorystate_adds_up[3-3-0-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 71%] 6970s tests/test_scheduler.py::test_memorystate_adds_up[3-3-1-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 71%] 6970s tests/test_scheduler.py::test_memorystate_adds_up[3-3-1-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 71%] 6970s tests/test_scheduler.py::test_memorystate_adds_up[3-3-1-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 71%] 6970s tests/test_scheduler.py::test_memorystate_adds_up[3-3-1-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 71%] 6970s tests/test_scheduler.py::test_memorystate_adds_up[3-3-2-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 71%] 6970s tests/test_scheduler.py::test_memorystate_adds_up[3-3-2-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 71%] 6970s tests/test_scheduler.py::test_memorystate_adds_up[3-3-2-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 71%] 6970s tests/test_scheduler.py::test_memorystate_adds_up[3-3-2-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 71%] 6970s tests/test_scheduler.py::test_memorystate_adds_up[3-3-3-0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 71%] 6970s tests/test_scheduler.py::test_memorystate_adds_up[3-3-3-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 71%] 6970s tests/test_scheduler.py::test_memorystate_adds_up[3-3-3-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 71%] 6970s tests/test_scheduler.py::test_memorystate_adds_up[3-3-3-3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 71%] 6970s tests/test_scheduler.py::test_memorystate__to_dict <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 71%] 6970s tests/test_scheduler.py::test_memory <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py SKIPPED [ 72%] 6970s tests/test_scheduler.py::test_memory_no_zict <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 72%] 6970s tests/test_scheduler.py::test_memory_no_workers <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 72%] 6970s tests/test_scheduler.py::test_infrequent_sysmon <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 72%] 6970s tests/test_scheduler.py::test_close_scheduler__close_workers_Worker <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 72%] 6970s tests/test_scheduler.py::test_close_scheduler__close_workers_Nanny <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py SKIPPED [ 72%] 6970s tests/test_scheduler.py::test_rebalance <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py SKIPPED [ 72%] 6971s tests/test_scheduler.py::test_rebalance_managed_memory <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 72%] 6971s tests/test_scheduler.py::test_rebalance_workers_and_keys <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 72%] 6971s tests/test_scheduler.py::test_rebalance_missing_data1 <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 72%] 6972s tests/test_scheduler.py::test_rebalance_missing_data2 <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 72%] 6972s tests/test_scheduler.py::test_rebalance_raises_missing_data3[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 72%] 6973s tests/test_scheduler.py::test_rebalance_raises_missing_data3[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py XFAIL subject to a race 6973s condition. This test assumes that the data is freed before 6973s the rebalance get_data requests come in but merely deleting 6973s the futures is not sufficient to guarantee this) [ 72%] 6973s tests/test_scheduler.py::test_rebalance_no_workers <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 72%] 6973s tests/test_scheduler.py::test_rebalance_no_limit <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 72%] 6973s tests/test_scheduler.py::test_rebalance_no_recipients <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py SKIPPED [ 72%] 6973s tests/test_scheduler.py::test_rebalance_skip_recipient <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 72%] 6974s tests/test_scheduler.py::test_rebalance_skip_all_recipients <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 72%] 6974s tests/test_scheduler.py::test_rebalance_sender_below_mean <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py SKIPPED [ 72%] 6974s tests/test_scheduler.py::test_rebalance_least_recently_inserted_sender_min <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py SKIPPED [ 72%] 6974s tests/test_scheduler.py::test_gather_on_worker <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 72%] 6974s tests/test_scheduler.py::test_gather_on_worker_bad_recipient <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 72%] 6974s tests/test_scheduler.py::test_gather_on_worker_bad_sender <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 72%] 6975s tests/test_scheduler.py::test_gather_on_worker_bad_sender_replicated[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 72%] 6975s tests/test_scheduler.py::test_gather_on_worker_bad_sender_replicated[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 72%] 6975s tests/test_scheduler.py::test_gather_on_worker_key_not_on_sender <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 72%] 6976s tests/test_scheduler.py::test_gather_on_worker_key_not_on_sender_replicated[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 72%] 6976s tests/test_scheduler.py::test_gather_on_worker_key_not_on_sender_replicated[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 72%] 6976s tests/test_scheduler.py::test_gather_on_worker_duplicate_task <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 72%] 6977s tests/test_scheduler.py::test_rebalance_dead_recipient <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 72%] 6977s tests/test_scheduler.py::test_delete_worker_data <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 72%] 6977s tests/test_scheduler.py::test_delete_worker_data_double_delete <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 72%] 6978s tests/test_scheduler.py::test_delete_worker_data_bad_worker <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 73%] 6978s tests/test_scheduler.py::test_delete_worker_data_bad_task[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 73%] 6978s tests/test_scheduler.py::test_delete_worker_data_bad_task[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 73%] 6978s tests/test_scheduler.py::test_transition_counter <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 73%] 6978s tests/test_scheduler.py::test_transition_counter_max_scheduler <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 73%] 6979s tests/test_scheduler.py::test_transition_counter_max_worker <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 73%] 6981s tests/test_scheduler.py::test_disable_transition_counter_max <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 73%] 6982s tests/test_scheduler.py::test_worker_heartbeat_after_cancel <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 73%] 6983s tests/test_scheduler.py::test_set_restrictions <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 73%] 6984s tests/test_scheduler.py::test_avoid_paused_workers <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 73%] 6984s tests/test_scheduler.py::test_Scheduler__to_dict <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 73%] 6984s tests/test_scheduler.py::test_TaskState__to_dict <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 73%] 6984s tests/test_scheduler.py::test_get_cluster_state <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 73%] 6985s tests/test_scheduler.py::test_get_cluster_state_worker_error <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 73%] 6985s tests/test_scheduler.py::test_dump_cluster_state[msgpack] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 73%] 6986s tests/test_scheduler.py::test_dump_cluster_state[yaml] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 73%] 6986s tests/test_scheduler.py::test_repr <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 73%] 6987s tests/test_scheduler.py::test_ensure_events_dont_include_taskstate_objects <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 73%] 6987s tests/test_scheduler.py::test_worker_state_unique_regardless_of_address <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 73%] 6987s tests/test_scheduler.py::test_scheduler_close_fast_deprecated <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 73%] 6990s tests/test_scheduler.py::test_runspec_regression_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 73%] 6990s tests/test_scheduler.py::test_KilledWorker_informative_message <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 73%] 6991s tests/test_scheduler.py::test_count_task_prefix <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 73%] 6991s tests/test_scheduler.py::test_transition_waiting_memory <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 73%] 6992s tests/test_scheduler.py::test_deadlock_resubmit_queued_tasks_fast[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 73%] 6992s tests/test_scheduler.py::test_deadlock_resubmit_queued_tasks_fast[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 73%] 6992s tests/test_scheduler.py::test_transition_failure_triggers_log_event <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 73%] 6993s tests/test_scheduler.py::test_deadlock_dependency_of_queued_released_when_worker_replaced[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 73%] 6993s tests/test_scheduler.py::test_deadlock_dependency_of_queued_released_when_worker_replaced[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 73%] 6994s tests/test_scheduler.py::test_deadlock_dependency_of_queued_released_when_worker_removed[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 73%] 6994s tests/test_scheduler.py::test_deadlock_dependency_of_queued_released_when_worker_removed[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 73%] 6994s tests/test_scheduler.py::test_submit_dependency_of_erred_task <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 73%] 6995s tests/test_scheduler.py::test_tell_workers_when_peers_have_left <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 74%] 6995s tests/test_scheduler.py::test_scatter_creates_ts <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 74%] 6996s tests/test_scheduler.py::test_refuse_to_schedule_huge_task[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 74%] 6996s tests/test_scheduler.py::test_refuse_to_schedule_huge_task[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 74%] 6997s tests/test_scheduler.py::test_html_repr <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 74%] 6997s tests/test_scheduler.py::test_resubmit_different_task_same_key_before_previous_is_done[same] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 74%] 6998s tests/test_scheduler.py::test_resubmit_different_task_same_key_before_previous_is_done[less] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 74%] 6998s tests/test_scheduler.py::test_resubmit_different_task_same_key_before_previous_is_done[more] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 74%] 6998s tests/test_scheduler.py::test_resubmit_different_task_same_key_after_previous_is_done[False-same] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 74%] 6998s tests/test_scheduler.py::test_resubmit_different_task_same_key_after_previous_is_done[False-less] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 74%] 6999s tests/test_scheduler.py::test_resubmit_different_task_same_key_after_previous_is_done[False-more] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 74%] 6999s tests/test_scheduler.py::test_resubmit_different_task_same_key_after_previous_is_done[True-same] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 74%] 7000s tests/test_scheduler.py::test_resubmit_different_task_same_key_after_previous_is_done[True-less] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 74%] 7000s tests/test_scheduler.py::test_resubmit_different_task_same_key_after_previous_is_done[True-more] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 74%] 7000s tests/test_scheduler.py::test_resubmit_different_task_same_key_many_clients <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 74%] 7001s tests/test_scheduler.py::test_resubmit_nondeterministic_task_same_deps[before0-123-True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 74%] 7001s tests/test_scheduler.py::test_resubmit_nondeterministic_task_same_deps[123-after1-True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 74%] 7001s tests/test_scheduler.py::test_resubmit_nondeterministic_task_same_deps[before2-after2-False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 74%] 7001s tests/test_scheduler.py::test_resubmit_nondeterministic_task_different_deps[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 74%] 7002s tests/test_scheduler.py::test_resubmit_nondeterministic_task_different_deps[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 74%] 7002s tests/test_scheduler.py::test_resubmit_different_task_same_key_warns_only_once[10-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 74%] 7002s tests/test_scheduler.py::test_resubmit_different_task_same_key_warns_only_once[30-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 74%] 7003s tests/test_scheduler.py::test_fan_out_pattern_deadlock <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 74%] 7003s tests/test_scheduler.py::test_stimulus_from_erred_task <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 74%] 7006s tests/test_scheduler.py::test_concurrent_close_requests <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 74%] 7006s tests/test_scheduler.py::test_rootish_taskgroup_configuration <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 74%] 7006s tests/test_scheduler.py::test_alias_resolving_break_queuing <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py PASSED [ 74%] 7006s tests/test_security.py::test_defaults <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_security.py PASSED [ 74%] 7006s tests/test_security.py::test_constructor_errors <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_security.py PASSED [ 74%] 7006s tests/test_security.py::test_attribute_error <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_security.py PASSED [ 74%] 7006s tests/test_security.py::test_from_config <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_security.py PASSED [ 74%] 7006s tests/test_security.py::test_min_max_version_from_config[None-None] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_security.py PASSED [ 74%] 7006s tests/test_security.py::test_min_max_version_from_config[None-1.2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_security.py PASSED [ 75%] 7006s tests/test_security.py::test_min_max_version_from_config[None-1.3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_security.py PASSED [ 75%] 7006s tests/test_security.py::test_min_max_version_from_config[1.2-None] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_security.py PASSED [ 75%] 7006s tests/test_security.py::test_min_max_version_from_config[1.2-1.2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_security.py PASSED [ 75%] 7006s tests/test_security.py::test_min_max_version_from_config[1.2-1.3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_security.py PASSED [ 75%] 7006s tests/test_security.py::test_min_max_version_from_config[1.3-None] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_security.py PASSED [ 75%] 7006s tests/test_security.py::test_min_max_version_from_config[1.3-1.2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_security.py PASSED [ 75%] 7006s tests/test_security.py::test_min_max_version_from_config[1.3-1.3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_security.py PASSED [ 75%] 7006s tests/test_security.py::test_min_max_version_config_errors[min-version] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_security.py PASSED [ 75%] 7006s tests/test_security.py::test_min_max_version_config_errors[max-version] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_security.py PASSED [ 75%] 7006s tests/test_security.py::test_invalid_min_version_from_config_errors <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_security.py PASSED [ 75%] 7006s tests/test_security.py::test_kwargs <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_security.py PASSED [ 75%] 7006s tests/test_security.py::test_min_max_version_kwarg_errors[tls_min_version] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_security.py PASSED [ 75%] 7006s tests/test_security.py::test_min_max_version_kwarg_errors[tls_max_version] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_security.py PASSED [ 75%] 7007s tests/test_security.py::test_repr_temp_keys <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_security.py PASSED [ 75%] 7007s tests/test_security.py::test_repr_local_keys <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_security.py PASSED [ 75%] 7007s tests/test_security.py::test_tls_config_for_role <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_security.py PASSED [ 75%] 7007s tests/test_security.py::test_connection_args <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_security.py PASSED [ 75%] 7007s tests/test_security.py::test_extra_conn_args_connection_args <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_security.py PASSED [ 75%] 7007s tests/test_security.py::test_listen_args <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_security.py PASSED [ 75%] 7007s tests/test_security.py::test_temporary_credentials <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_security.py PASSED [ 75%] 7007s tests/test_security.py::test_extra_conn_args_in_temporary_credentials <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_security.py PASSED [ 75%] 7007s tests/test_semaphore.py::test_semaphore_trivial <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_semaphore.py PASSED [ 75%] 7008s tests/test_semaphore.py::test_serializable <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_semaphore.py PASSED [ 75%] 7008s tests/test_semaphore.py::test_release_simple <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_semaphore.py PASSED [ 75%] 7008s tests/test_semaphore.py::test_acquires_with_timeout <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_semaphore.py PASSED [ 75%] 7011s tests/test_semaphore.py::test_timeout_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_semaphore.py PASSED [ 75%] 7011s tests/test_semaphore.py::test_release_semaphore_after_timeout <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_semaphore.py PASSED [ 75%] 7012s tests/test_semaphore.py::test_async_ctx <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_semaphore.py PASSED [ 75%] 7014s tests/test_semaphore.py::test_worker_dies <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_semaphore.py PASSED [ 75%] 7015s tests/test_semaphore.py::test_access_semaphore_by_name <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_semaphore.py PASSED [ 75%] 7015s tests/test_semaphore.py::test_close_async <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_semaphore.py PASSED [ 75%] 7016s tests/test_semaphore.py::test_release_once_too_many <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_semaphore.py PASSED [ 75%] 7016s tests/test_semaphore.py::test_release_once_too_many_resilience <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_semaphore.py PASSED [ 76%] 7016s tests/test_semaphore.py::test_retry_acquire <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_semaphore.py PASSED [ 76%] 7017s tests/test_semaphore.py::test_oversubscribing_leases <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_semaphore.py PASSED [ 76%] 7018s tests/test_semaphore.py::test_timeout_zero <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_semaphore.py PASSED [ 76%] 7018s tests/test_semaphore.py::test_getvalue <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_semaphore.py PASSED [ 76%] 7018s tests/test_semaphore.py::test_metrics <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_semaphore.py PASSED [ 76%] 7019s tests/test_semaphore.py::test_release_retry <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_semaphore.py PASSED [ 76%] 7019s tests/test_semaphore.py::test_release_failure <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_semaphore.py PASSED [ 76%] 7019s tests/test_semaphore.py::test_unpickle_without_client <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_semaphore.py PASSED [ 76%] 7019s tests/test_sizeof.py::test_safe_sizeof[obj0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_sizeof.py PASSED [ 76%] 7019s tests/test_sizeof.py::test_safe_sizeof[obj1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_sizeof.py PASSED [ 76%] 7019s tests/test_sizeof.py::test_safe_sizeof[obj2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_sizeof.py PASSED [ 76%] 7019s tests/test_sizeof.py::test_safe_sizeof_logs_on_failure <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_sizeof.py PASSED [ 76%] 7019s tests/test_spans.py::test_spans <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_spans.py PASSED [ 76%] 7020s tests/test_spans.py::test_submit <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_spans.py PASSED [ 76%] 7020s tests/test_spans.py::test_multiple_tags <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_spans.py PASSED [ 76%] 7020s tests/test_spans.py::test_repeat_span <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_spans.py PASSED [ 76%] 7021s tests/test_spans.py::test_default_span <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_spans.py PASSED [ 76%] 7023s tests/test_spans.py::test_no_extension <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_spans.py PASSED [ 76%] 7024s tests/test_spans.py::test_task_groups[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_spans.py PASSED [ 76%] 7024s tests/test_spans.py::test_task_groups[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_spans.py PASSED [ 76%] 7025s tests/test_spans.py::test_before_first_task_finished <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_spans.py PASSED [ 76%] 7025s tests/test_spans.py::test_duplicate_task_group <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_spans.py PASSED [ 76%] 7026s tests/test_spans.py::test_mismatched_span[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_spans.py PASSED [ 76%] 7026s tests/test_spans.py::test_mismatched_span[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_spans.py PASSED [ 76%] 7026s tests/test_spans.py::test_no_tags <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_spans.py PASSED [ 76%] 7026s tests/test_spans.py::test_scatter_creates_ts <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_spans.py PASSED [ 76%] 7027s tests/test_spans.py::test_scatter_creates_tg <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_spans.py PASSED [ 76%] 7027s tests/test_spans.py::test_worker_metrics <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_spans.py PASSED [ 76%] 7028s tests/test_spans.py::test_merge_by_tags <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_spans.py PASSED [ 76%] 7029s tests/test_spans.py::test_merge_by_tags_metrics <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_spans.py PASSED [ 76%] 7029s tests/test_spans.py::test_code <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_spans.py PASSED [ 76%] 7030s tests/test_spans.py::test_no_code_by_default <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_spans.py PASSED [ 77%] 7030s tests/test_spans.py::test_merge_all <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_spans.py PASSED [ 77%] 7030s tests/test_spans.py::test_merge_nothing <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_spans.py PASSED [ 77%] 7031s tests/test_spans.py::test_active_cpu_seconds_trivial <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_spans.py PASSED [ 77%] 7031s tests/test_spans.py::test_active_cpu_seconds_not_done[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_spans.py PASSED [ 77%] 7032s tests/test_spans.py::test_active_cpu_seconds_not_done[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_spans.py PASSED [ 77%] 7032s tests/test_spans.py::test_active_cpu_seconds_change_nthreads <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_spans.py PASSED [ 77%] 7033s tests/test_spans.py::test_active_cpu_seconds_merged <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_spans.py PASSED [ 77%] 7034s tests/test_spans.py::test_spans_are_visible_from_tasks <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_spans.py PASSED [ 77%] 7034s tests/test_spans.py::test_span_on_persist <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_spans.py PASSED [ 77%] 7035s tests/test_spans.py::test_collections_metadata <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_spans.py XPASS [ 77%] 7035s tests/test_spec.py::test_address_default_none <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_spec.py PASSED [ 77%] 7035s tests/test_spec.py::test_child_address_persists <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_spec.py PASSED [ 77%] 7035s tests/test_spill.py::test_psize <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_spill.py PASSED [ 77%] 7035s tests/test_spill.py::test_spillbuffer <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_spill.py PASSED [ 77%] 7035s tests/test_spill.py::test_disk_size_calculation <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_spill.py PASSED [ 77%] 7035s tests/test_spill.py::test_spillbuffer_maxlim <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_spill.py PASSED [ 77%] 7035s tests/test_spill.py::test_spillbuffer_fail_to_serialize <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_spill.py PASSED [ 77%] 7035s tests/test_spill.py::test_spillbuffer_evict <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_spill.py PASSED [ 77%] 7035s tests/test_spill.py::test_no_pop <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_spill.py PASSED [ 77%] 7035s tests/test_spill.py::test_weakref_cache[60-SupportsWeakRef-True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_spill.py PASSED [ 77%] 7035s tests/test_spill.py::test_weakref_cache[60-NoWeakRef-False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_spill.py PASSED [ 77%] 7035s tests/test_spill.py::test_weakref_cache[110-SupportsWeakRef-True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_spill.py PASSED [ 77%] 7035s tests/test_spill.py::test_weakref_cache[110-NoWeakRef-False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_spill.py PASSED [ 77%] 7035s tests/test_spill.py::test_metrics <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_spill.py PASSED [ 77%] 7035s tests/test_spill.py::test_compression_settings[zlib-100-500] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_spill.py PASSED [ 77%] 7035s tests/test_spill.py::test_compression_settings[None-20000-20500] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_spill.py PASSED [ 77%] 7035s tests/test_spill.py::test_str_collision <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_spill.py PASSED [ 77%] 7035s tests/test_steal.py::test_work_stealing <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 77%] 7036s tests/test_steal.py::test_dont_steal_expensive_data_fast_computation <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 77%] 7037s tests/test_steal.py::test_steal_cheap_data_slow_computation <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 77%] 7037s tests/test_steal.py::test_steal_expensive_data_slow_computation <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py SKIPPED [ 77%] 7040s tests/test_steal.py::test_worksteal_many_thieves <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 78%] 7040s tests/test_steal.py::test_stop_plugin <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 78%] 7041s tests/test_steal.py::test_stop_in_flight <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 78%] 7043s tests/test_steal.py::test_allow_tasks_stolen_before_first_completes <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 78%] 7044s tests/test_steal.py::test_eventually_steal_unknown_functions <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 78%] 7044s tests/test_steal.py::test_steal_related_tasks <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py SKIPPED [ 78%] 7046s tests/test_steal.py::test_dont_steal_fast_tasks_compute_time <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 78%] 7048s tests/test_steal.py::test_dont_steal_fast_tasks_blocklist <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 78%] 7050s tests/test_steal.py::test_new_worker_steals <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 78%] 7052s tests/test_steal.py::test_work_steal_allow_other_workers <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 78%] 7053s tests/test_steal.py::test_dont_steal_worker_restrictions <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 78%] 7054s tests/test_steal.py::test_steal_worker_restrictions <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 78%] 7054s tests/test_steal.py::test_dont_steal_host_restrictions <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 78%] 7055s tests/test_steal.py::test_steal_host_restrictions <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 78%] 7055s tests/test_steal.py::test_dont_steal_resource_restrictions <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 78%] 7056s tests/test_steal.py::test_steal_resource_restrictions <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 78%] 7057s tests/test_steal.py::test_steal_resource_restrictions_asym_diff <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 78%] 7060s tests/test_steal.py::test_balance_without_dependencies <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 78%] 7061s tests/test_steal.py::test_dont_steal_executing_tasks <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 78%] 7062s tests/test_steal.py::test_dont_steal_executing_tasks_2 <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 78%] 7063s tests/test_steal.py::test_dont_steal_few_saturated_tasks_many_workers <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 78%] 7065s tests/test_steal.py::test_steal_when_more_tasks <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 78%] 7067s tests/test_steal.py::test_steal_more_attractive_tasks <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 78%] 7067s tests/test_steal.py::test_balance[don't move unnecessarily] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 78%] 7068s tests/test_steal.py::test_balance[balance] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 78%] 7068s tests/test_steal.py::test_balance[balance even if results in even] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 78%] 7068s tests/test_steal.py::test_balance[don't over balance] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 78%] 7069s tests/test_steal.py::test_balance[move from larger] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 78%] 7070s tests/test_steal.py::test_balance[move to smaller] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 78%] 7070s tests/test_steal.py::test_balance[choose easier first] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 78%] 7070s tests/test_steal.py::test_balance[spread evenly] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 78%] 7071s tests/test_steal.py::test_balance[move easier] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 78%] 7071s tests/test_steal.py::test_balance[be willing to move costly items] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 78%] 7072s tests/test_steal.py::test_balance[but don't move too many] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 79%] 7073s tests/test_steal.py::test_balance[no one clearly saturated] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 79%] 7073s tests/test_steal.py::test_balance[balance multiple saturated workers] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 79%] 7077s tests/test_steal.py::test_restart <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 79%] 7079s tests/test_steal.py::test_paused_workers_must_not_steal <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 79%] 7079s tests/test_steal.py::test_dont_steal_already_released <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 79%] 7080s tests/test_steal.py::test_dont_steal_long_running_tasks <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 79%] 7081s tests/test_steal.py::test_cleanup_repeated_tasks <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 79%] 7083s tests/test_steal.py::test_lose_task <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 79%] 7083s tests/test_steal.py::test_parse_stealing_interval[None-100] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 79%] 7083s tests/test_steal.py::test_parse_stealing_interval[500ms-500] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 79%] 7083s tests/test_steal.py::test_parse_stealing_interval[2-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 79%] 7089s tests/test_steal.py::test_balance_with_longer_task <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 79%] 7090s tests/test_steal.py::test_blocklist_shuffle_split <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 79%] 7091s tests/test_steal.py::test_steal_concurrent_simple <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 79%] 7091s tests/test_steal.py::test_steal_reschedule_reset_in_flight_occupancy <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 79%] 7093s tests/test_steal.py::test_get_story <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 79%] 7093s tests/test_steal.py::test_steal_worker_dies_same_ip <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 79%] 7094s tests/test_steal.py::test_reschedule_concurrent_requests_deadlock <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 79%] 7094s tests/test_steal.py::test_correct_bad_time_estimate <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py SKIPPED [ 79%] 7097s tests/test_steal.py::test_steal_stimulus_id_unique <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 79%] 7097s tests/test_steal.py::test_steal_worker_state[executing] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 79%] 7097s tests/test_steal.py::test_steal_worker_state[long-running] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 79%] 7097s tests/test_steal.py::test_steal_very_fast_tasks <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py SKIPPED [ 79%] 7098s tests/test_steal.py::test_balance_expensive_tasks[not enough work to steal] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 79%] 7099s tests/test_steal.py::test_balance_expensive_tasks[enough work to steal] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 79%] 7100s tests/test_steal.py::test_balance_expensive_tasks[not enough work for increased cost] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 79%] 7100s tests/test_steal.py::test_balance_uneven_without_replica <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 79%] 7102s tests/test_steal.py::test_balance_eventually_steals_large_dependency_without_replica <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 79%] 7102s tests/test_steal.py::test_balance_even_with_replica <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 79%] 7106s tests/test_steal.py::test_balance_to_replica <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 79%] 7110s tests/test_steal.py::test_balance_multiple_to_replica <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 79%] 7113s tests/test_steal.py::test_balance_to_larger_dependency <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 80%] 7116s tests/test_steal.py::test_balance_prefers_busier_with_dependency <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 80%] 7120s tests/test_steal.py::test_trivial_workload_should_not_cause_work_stealing <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py PASSED [ 80%] 7120s tests/test_stories.py::test_scheduler_story_stimulus_success <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_stories.py PASSED [ 80%] 7120s tests/test_stories.py::test_scheduler_story_stimulus_retry <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_stories.py PASSED [ 80%] 7121s tests/test_stories.py::test_client_story <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_stories.py PASSED [ 80%] 7121s tests/test_stories.py::test_client_story_failed_worker[ignore] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_stories.py PASSED [ 80%] 7121s tests/test_stories.py::test_client_story_failed_worker[raise] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_stories.py PASSED [ 80%] 7122s tests/test_stories.py::test_worker_story_with_deps <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_stories.py PASSED [ 80%] 7123s tests/test_stress.py::test_stress_1 <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_stress.py PASSED [ 80%] 7123s tests/test_stress.py::test_stress_gc[slowinc-100] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_stress.py SKIPPED [ 80%] 7123s tests/test_stress.py::test_stress_gc[inc-1000] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_stress.py SKIPPED [ 80%] 7132s tests/test_stress.py::test_cancel_stress <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_stress.py PASSED [ 80%] 7139s tests/test_stress.py::test_cancel_stress_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_stress.py PASSED [ 80%] 7139s tests/test_stress.py::test_stress_creation_and_deletion <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_stress.py SKIPPED [ 80%] 7141s tests/test_stress.py::test_stress_scatter_death <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_stress.py PASSED [ 80%] 7141s tests/test_stress.py::test_stress_steal <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_stress.py SKIPPED [ 80%] 7141s tests/test_stress.py::test_close_connections <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_stress.py SKIPPED [ 80%] 7141s tests/test_stress.py::test_no_delay_during_large_transfer <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_stress.py SKIPPED [ 80%] 7141s tests/test_stress.py::test_chaos_rechunk <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_stress.py SKIPPED [ 80%] 7141s tests/test_system.py::test_memory_limit <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_system.py PASSED [ 80%] 7141s tests/test_system.py::test_hard_memory_limit_cgroups <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_system.py PASSED [ 80%] 7141s tests/test_system.py::test_soft_memory_limit_cgroups <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_system.py PASSED [ 80%] 7141s tests/test_system.py::test_hard_memory_limit_cgroups2 <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_system.py PASSED [ 80%] 7141s tests/test_system.py::test_soft_memory_limit_cgroups2 <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_system.py PASSED [ 80%] 7141s tests/test_system.py::test_softest_memory_limit_cgroups2 <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_system.py PASSED [ 80%] 7141s tests/test_system.py::test_rlimit <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_system.py PASSED [ 80%] 7141s tests/test_system_monitor.py::test_SystemMonitor <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_system_monitor.py PASSED [ 80%] 7141s tests/test_system_monitor.py::test_maxlen_zero <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_system_monitor.py PASSED [ 80%] 7142s tests/test_system_monitor.py::test_count <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_system_monitor.py PASSED [ 80%] 7142s tests/test_system_monitor.py::test_range_query <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_system_monitor.py PASSED [ 80%] 7142s tests/test_system_monitor.py::test_disk_config <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_system_monitor.py PASSED [ 80%] 7142s tests/test_system_monitor.py::test_host_cpu <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_system_monitor.py PASSED [ 81%] 7142s tests/test_system_monitor.py::test_gil_contention <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_system_monitor.py SKIPPED [ 81%] 7142s tests/test_threadpoolexecutor.py::test_tpe <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_threadpoolexecutor.py PASSED [ 81%] 7142s tests/test_threadpoolexecutor.py::test_shutdown_timeout <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_threadpoolexecutor.py PASSED [ 81%] 7142s tests/test_threadpoolexecutor.py::test_shutdown_timeout_raises <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_threadpoolexecutor.py PASSED [ 81%] 7142s tests/test_threadpoolexecutor.py::test_shutdown_wait <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_threadpoolexecutor.py PASSED [ 81%] 7144s tests/test_threadpoolexecutor.py::test_secede_rejoin_busy <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_threadpoolexecutor.py PASSED [ 81%] 7144s tests/test_threadpoolexecutor.py::test_secede_rejoin_quiet <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_threadpoolexecutor.py PASSED [ 81%] 7144s tests/test_threadpoolexecutor.py::test_rejoin_idempotent <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_threadpoolexecutor.py PASSED [ 81%] 7144s tests/test_threadpoolexecutor.py::test_thread_name <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_threadpoolexecutor.py PASSED [ 81%] 7144s tests/test_tls_functional.py::test_basic <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_tls_functional.py PASSED [ 81%] 7145s tests/test_tls_functional.py::test_Queue <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_tls_functional.py PASSED [ 81%] 7145s tests/test_tls_functional.py::test_client_submit <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_tls_functional.py PASSED [ 81%] 7146s tests/test_tls_functional.py::test_gather <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_tls_functional.py PASSED [ 81%] 7146s tests/test_tls_functional.py::test_scatter <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_tls_functional.py PASSED [ 81%] 7149s tests/test_tls_functional.py::test_nanny <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_tls_functional.py PASSED [ 81%] 7149s tests/test_tls_functional.py::test_rebalance <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_tls_functional.py PASSED [ 81%] 7151s tests/test_tls_functional.py::test_work_stealing <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_tls_functional.py PASSED [ 81%] 7152s tests/test_tls_functional.py::test_worker_client <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_tls_functional.py PASSED [ 81%] 7152s tests/test_tls_functional.py::test_worker_client_gather <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_tls_functional.py PASSED [ 81%] 7153s tests/test_tls_functional.py::test_worker_client_executor <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_tls_functional.py PASSED [ 81%] 7213s tests/test_tls_functional.py::test_retire_workers <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_tls_functional.py FAILED [ 81%] 7214s tests/test_tls_functional.py::test_security_dict_input <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_tls_functional.py PASSED [ 81%] 7214s tests/test_utils.py::test_All <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 81%] 7214s tests/test_utils.py::test_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 81%] 7214s tests/test_utils.py::test_sync_error <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 81%] 7214s tests/test_utils.py::test_sync_timeout <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 81%] 7214s tests/test_utils.py::test_sync_closed_loop <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 81%] 7214s tests/test_utils.py::test_sync_contextvars <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 81%] 7214s tests/test_utils.py::test_is_kernel <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py SKIPPED [ 81%] 7214s tests/test_utils.py::test_ensure_ip <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 81%] 7214s tests/test_utils.py::test_get_ip_interface <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 81%] 7214s tests/test_utils.py::test_get_mp_context <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 81%] 7214s tests/test_utils.py::test_truncate_exception <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 82%] 7214s tests/test_utils.py::test_get_traceback <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 82%] 7214s tests/test_utils.py::test_read_block <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 82%] 7214s tests/test_utils.py::test_seek_delimiter_endline <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 82%] 7214s tests/test_utils.py::test_ensure_memoryview[] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 82%] 7214s tests/test_utils.py::test_ensure_memoryview[data1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 82%] 7214s tests/test_utils.py::test_ensure_memoryview[1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 82%] 7214s tests/test_utils.py::test_ensure_memoryview[data3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 82%] 7214s tests/test_utils.py::test_ensure_memoryview[data4] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 82%] 7214s tests/test_utils.py::test_ensure_memoryview[data5] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 82%] 7214s tests/test_utils.py::test_ensure_memoryview[data6] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 82%] 7214s tests/test_utils.py::test_ensure_memoryview[data7] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 82%] 7214s tests/test_utils.py::test_ensure_memoryview[data8] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 82%] 7214s tests/test_utils.py::test_ensure_memoryview[data9] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 82%] 7214s tests/test_utils.py::test_ensure_memoryview[data10] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 82%] 7214s tests/test_utils.py::test_ensure_memoryview[data11] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 82%] 7214s tests/test_utils.py::test_ensure_memoryview[data12] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 82%] 7214s tests/test_utils.py::test_ensure_memoryview[data13] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 82%] 7214s tests/test_utils.py::test_ensure_memoryview[data14] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 82%] 7214s tests/test_utils.py::test_ensure_memoryview_ndarray[i8-12-shape0-strides0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 82%] 7214s tests/test_utils.py::test_ensure_memoryview_ndarray[i8-12-shape1-strides1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 82%] 7214s tests/test_utils.py::test_ensure_memoryview_ndarray[i8-12-shape2-strides2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 82%] 7214s tests/test_utils.py::test_ensure_memoryview_ndarray[i8-12-shape3-strides3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 82%] 7214s tests/test_utils.py::test_ensure_memoryview_ndarray[i8-12-shape4-strides4] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 82%] 7214s tests/test_utils.py::test_ensure_memoryview_pyarrow_buffer <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py SKIPPED [ 82%] 7214s tests/test_utils.py::test_nbytes <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 82%] 7214s tests/test_utils.py::test_open_port <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 82%] 7214s tests/test_utils.py::test_set_thread_state <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 82%] 7214s tests/test_utils.py::test_loop_runner <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 82%] 7214s tests/test_utils.py::test_two_loop_runners <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 82%] 7214s tests/test_utils.py::test_loop_runner_gen <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 82%] 7214s tests/test_utils.py::test_loop_runner_exception_in_start <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 82%] 7214s tests/test_utils.py::test_loop_runner_exception_in_teardown <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 83%] 7214s tests/test_utils.py::test_all_quiet_exceptions <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 83%] 7214s tests/test_utils.py::test_warn_on_duration <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 83%] 7214s tests/test_utils.py::test_logs <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 83%] 7214s tests/test_utils.py::test_is_valid_xml <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 83%] 7214s tests/test_utils.py::test_format_dashboard_link <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 83%] 7214s tests/test_utils.py::test_parse_ports <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 83%] 7214s tests/test_utils.py::test_run_in_executor_with_context <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 83%] 7214s tests/test_utils.py::test_run_in_executor_with_context_preserves_contextvars <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 83%] 7214s tests/test_utils.py::test_offload <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 83%] 7214s tests/test_utils.py::test_offload_preserves_contextvars <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 83%] 7214s tests/test_utils.py::test_no_default_deprecated <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 83%] 7214s tests/test_utils.py::test_iscoroutinefunction_unhashable_input <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 83%] 7214s tests/test_utils.py::test_iscoroutinefunction_nested_partial <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 83%] 7214s tests/test_utils.py::test_recursive_to_dict <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 83%] 7214s tests/test_utils.py::test_recursive_to_dict_no_nest <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 83%] 7214s tests/test_utils.py::test_log_errors <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 83%] 7214s tests/test_utils.py::test_log_errors_unroll_stack[0-test_utils] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 83%] 7214s tests/test_utils.py::test_log_errors_unroll_stack[1-a.b.c] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 83%] 7215s tests/test_utils.py::test_load_json_robust_timeout <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 83%] 7215s tests/test_utils.py::test_rate_limiter_filter <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 83%] 7215s tests/test_utils.py::test_tuple_comparable_lt[obj10-obj20-False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 83%] 7215s tests/test_utils.py::test_tuple_comparable_lt[obj11-obj21-True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 83%] 7215s tests/test_utils.py::test_tuple_comparable_lt[1-1-False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 83%] 7215s tests/test_utils.py::test_tuple_comparable_lt[1-2-True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 83%] 7215s tests/test_utils.py::test_tuple_comparable_lt[None-0-False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 83%] 7215s tests/test_utils.py::test_tuple_comparable_lt[None-obj25-True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 83%] 7215s tests/test_utils.py::test_tuple_comparable_eq[obj10-obj20-True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 83%] 7215s tests/test_utils.py::test_tuple_comparable_eq[obj11-obj21-False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 83%] 7215s tests/test_utils.py::test_tuple_comparable_eq[1-1-True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 83%] 7215s tests/test_utils.py::test_tuple_comparable_eq[1-2-False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 83%] 7215s tests/test_utils.py::test_tuple_comparable_eq[None-0-True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 83%] 7215s tests/test_utils.py::test_tuple_comparable_eq[None-obj25-False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 84%] 7215s tests/test_utils.py::test_tuple_comparable_error <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py PASSED [ 84%] 7215s tests/test_utils_comm.py::test_pack_data <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_comm.py PASSED [ 84%] 7215s tests/test_utils_comm.py::test_subs_multiple <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_comm.py PASSED [ 84%] 7216s tests/test_utils_comm.py::test_gather_from_workers_missing_replicas <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_comm.py PASSED [ 84%] 7216s tests/test_utils_comm.py::test_gather_from_workers_permissive <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_comm.py PASSED [ 84%] 7217s tests/test_utils_comm.py::test_gather_from_workers_permissive_flaky <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_comm.py PASSED [ 84%] 7217s tests/test_utils_comm.py::test_gather_from_workers_busy <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_comm.py PASSED [ 84%] 7217s tests/test_utils_comm.py::test_gather_from_workers_serialization_error[pickle] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_comm.py PASSED [ 84%] 7218s tests/test_utils_comm.py::test_gather_from_workers_serialization_error[unpickle] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_comm.py PASSED [ 84%] 7218s tests/test_utils_comm.py::test_retry_no_exception <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_comm.py PASSED [ 84%] 7218s tests/test_utils_comm.py::test_retry0_raises_immediately <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_comm.py PASSED [ 84%] 7218s tests/test_utils_comm.py::test_retry_does_retry_and_sleep <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_comm.py PASSED [ 84%] 7218s tests/test_utils_comm.py::test_unpack_remotedata <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_comm.py PASSED [ 84%] 7223s tests/test_utils_test.py::test_bare_cluster <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 84%] 7224s tests/test_utils_test.py::test_gen_cluster <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 84%] 7224s tests/test_utils_test.py::test_gen_cluster_pytest_fixture <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 84%] 7225s tests/test_utils_test.py::test_gen_cluster_parametrized[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 84%] 7225s tests/test_utils_test.py::test_gen_cluster_multi_parametrized[a-True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 84%] 7226s tests/test_utils_test.py::test_gen_cluster_multi_parametrized[b-True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 84%] 7226s tests/test_utils_test.py::test_gen_cluster_parametrized_variadic_workers[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 84%] 7228s tests/test_utils_test.py::test_gen_cluster_set_config_nanny <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 84%] 7228s tests/test_utils_test.py::test_gen_cluster_cleans_up_client <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py SKIPPED [ 84%] 7228s tests/test_utils_test.py::test_gen_cluster_without_client <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 84%] 7229s tests/test_utils_test.py::test_gen_cluster_tls <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 84%] 7229s tests/test_utils_test.py::test_gen_cluster_validate <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 84%] 7229s tests/test_utils_test.py::test_gen_cluster_validate_override <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 84%] 7229s tests/test_utils_test.py::test_gen_test <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py XFAILn) [ 84%] 7230s tests/test_utils_test.py::test_gen_test_legacy_implicit <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py XFAIL [ 84%] 7230s tests/test_utils_test.py::test_gen_test_legacy_explicit <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py XFAIL [ 84%] 7230s tests/test_utils_test.py::test_gen_test_parametrized[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 84%] 7230s tests/test_utils_test.py::test_gen_test_double_parametrized[False-True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 84%] 7230s tests/test_utils_test.py::test_gen_test_pytest_fixture <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 84%] 7230s tests/test_utils_test.py::test_gen_test_config <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 85%] 7230s tests/test_utils_test.py::test_gen_test_config_default <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 85%] 7230s tests/test_utils_test.py::test_new_config <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 85%] 7230s tests/test_utils_test.py::test_lingering_client <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 85%] 7233s tests/test_utils_test.py::test_lingering_client_2 <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 85%] 7235s tests/test_utils_test.py::test_tls_cluster <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 85%] 7235s tests/test_utils_test.py::test_tls_scheduler <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 85%] 7235s tests/test_utils_test.py::test__UnhashableCallable <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 85%] 7235s tests/test_utils_test.py::test_assert_story <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 85%] 7235s tests/test_utils_test.py::test_assert_story_malformed_story[Missing payload, stimulus_id, ts] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 85%] 7235s tests/test_utils_test.py::test_assert_story_malformed_story[Missing (stimulus_id, ts)] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 85%] 7235s tests/test_utils_test.py::test_assert_story_malformed_story[Missing ts] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 85%] 7235s tests/test_utils_test.py::test_assert_story_malformed_story[ts is not a float] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 85%] 7235s tests/test_utils_test.py::test_assert_story_malformed_story[ts is in the future] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 85%] 7235s tests/test_utils_test.py::test_assert_story_malformed_story[ts is too old] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 85%] 7235s tests/test_utils_test.py::test_assert_story_malformed_story[stimulus_id is not a str] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 85%] 7235s tests/test_utils_test.py::test_assert_story_malformed_story[stimulus_id is an empty str] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 85%] 7235s tests/test_utils_test.py::test_assert_story_malformed_story[no payload] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 85%] 7235s tests/test_utils_test.py::test_assert_story_malformed_story[timestamps out of order] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 85%] 7236s tests/test_utils_test.py::test_assert_story_identity[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 85%] 7236s tests/test_utils_test.py::test_assert_story_identity[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 85%] 7237s tests/test_utils_test.py::test_check_process_leak <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 85%] 7239s tests/test_utils_test.py::test_check_process_leak_slow_cleanup <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 85%] 7240s tests/test_utils_test.py::test_check_process_leak_pre_cleanup[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 85%] 7242s tests/test_utils_test.py::test_check_process_leak_pre_cleanup[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 85%] 7243s tests/test_utils_test.py::test_check_process_leak_post_cleanup[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 85%] 7244s tests/test_utils_test.py::test_check_process_leak_post_cleanup[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 85%] 7247s tests/test_utils_test.py::test_start_failure_worker[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 85%] 7248s tests/test_utils_test.py::test_start_failure_worker[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 85%] 7251s tests/test_utils_test.py::test_start_failure_scheduler <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 85%] 7251s tests/test_utils_test.py::test_invalid_transitions <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 85%] 7251s tests/test_utils_test.py::test_invalid_worker_state <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 85%] 7251s tests/test_utils_test.py::test_raises_with_cause <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 86%] 7251s tests/test_utils_test.py::test_check_thread_leak <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py SKIPPED [ 86%] 7251s tests/test_utils_test.py::test_fail_hard[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 86%] 7251s tests/test_utils_test.py::test_fail_hard[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 86%] 7251s tests/test_utils_test.py::test_popen_write_during_terminate_deadlock <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 86%] 7260s tests/test_utils_test.py::test_popen_timeout <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 86%] 7260s tests/test_utils_test.py::test_popen_always_prints_output <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 86%] 7261s tests/test_utils_test.py::test_wait_for_state <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 86%] 7261s tests/test_utils_test.py::test_wait_for_stimulus <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 86%] 7261s tests/test_utils_test.py::test_ws_with_running_task[executing] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 86%] 7261s tests/test_utils_test.py::test_ws_with_running_task[long-running] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 86%] 7261s tests/test_utils_test.py::test_sizeof <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 86%] 7261s tests/test_utils_test.py::test_sizeof_error[12345.0-TypeError-Expected integer] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 86%] 7261s tests/test_utils_test.py::test_sizeof_error[-1-ValueError-larger than] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 86%] 7261s tests/test_utils_test.py::test_sizeof_error[0-ValueError-larger than] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 86%] 7261s tests/test_utils_test.py::test_sizeof_error[10-ValueError-larger than] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 86%] 7261s tests/test_utils_test.py::test_captured_logger <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 86%] 7261s tests/test_utils_test.py::test_captured_context_meter <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py PASSED [ 86%] 7262s tests/test_variable.py::test_variable <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_variable.py PASSED [ 86%] 7262s tests/test_variable.py::test_delete_unset_variable <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_variable.py PASSED [ 86%] 7262s tests/test_variable.py::test_queue_with_data <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_variable.py PASSED [ 86%] 7264s tests/test_variable.py::test_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_variable.py PASSED [ 86%] 7265s tests/test_variable.py::test_hold_futures <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_variable.py PASSED [ 86%] 7265s tests/test_variable.py::test_timeout <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_variable.py PASSED [ 86%] 7268s tests/test_variable.py::test_timeout_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_variable.py PASSED [ 86%] 7268s tests/test_variable.py::test_cleanup <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_variable.py PASSED [ 86%] 7271s tests/test_variable.py::test_pickleable <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_variable.py PASSED [ 86%] 7271s tests/test_variable.py::test_timeout_get <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_variable.py PASSED [ 86%] 7271s tests/test_variable.py::test_race <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_variable.py SKIPPED [ 86%] 7272s tests/test_variable.py::test_Future_knows_status_immediately <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_variable.py PASSED [ 86%] 7272s tests/test_variable.py::test_erred_future <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_variable.py PASSED [ 86%] 7275s tests/test_variable.py::test_future_erred_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_variable.py PASSED [ 86%] 7276s tests/test_variable.py::test_variables_do_not_leak_client <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_variable.py PASSED [ 87%] 7276s tests/test_variable.py::test_unpickle_without_client <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_variable.py PASSED [ 87%] 7276s tests/test_variable.py::test_set_cancelled_future <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_variable.py PASSED [ 87%] 7276s tests/test_versions.py::test_versions_match <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_versions.py PASSED [ 87%] 7276s tests/test_versions.py::test_version_mismatch[source-MISMATCHED] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_versions.py PASSED [ 87%] 7276s tests/test_versions.py::test_version_mismatch[source-MISSING] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_versions.py PASSED [ 87%] 7277s tests/test_versions.py::test_version_mismatch[source-KEY_ERROR] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_versions.py PASSED [ 87%] 7277s tests/test_versions.py::test_version_mismatch[source-NONE] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_versions.py PASSED [ 87%] 7277s tests/test_versions.py::test_version_mismatch[scheduler-MISMATCHED] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_versions.py PASSED [ 87%] 7277s tests/test_versions.py::test_version_mismatch[scheduler-MISSING] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_versions.py PASSED [ 87%] 7277s tests/test_versions.py::test_version_mismatch[scheduler-KEY_ERROR] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_versions.py PASSED [ 87%] 7277s tests/test_versions.py::test_version_mismatch[scheduler-NONE] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_versions.py PASSED [ 87%] 7277s tests/test_versions.py::test_version_mismatch[worker-1-MISMATCHED] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_versions.py PASSED [ 87%] 7278s tests/test_versions.py::test_version_mismatch[worker-1-MISSING] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_versions.py PASSED [ 87%] 7278s tests/test_versions.py::test_version_mismatch[worker-1-KEY_ERROR] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_versions.py PASSED [ 87%] 7278s tests/test_versions.py::test_version_mismatch[worker-1-NONE] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_versions.py PASSED [ 87%] 7278s tests/test_versions.py::test_scheduler_mismatched_irrelevant_package <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_versions.py PASSED [ 87%] 7278s tests/test_versions.py::test_scheduler_additional_irrelevant_package <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_versions.py PASSED [ 87%] 7278s tests/test_versions.py::test_python_mismatch[source] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_versions.py PASSED [ 87%] 7278s tests/test_versions.py::test_python_mismatch[scheduler] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_versions.py PASSED [ 87%] 7279s tests/test_versions.py::test_python_mismatch[worker-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_versions.py PASSED [ 87%] 7279s tests/test_versions.py::test_version_warning_in_cluster <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_versions.py PASSED [ 87%] 7279s tests/test_versions.py::test_python_version <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_versions.py PASSED [ 87%] 7279s tests/test_versions.py::test_version_custom_pkgs <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_versions.py PASSED [ 87%] 7279s tests/test_worker.py::test_worker_nthreads <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 87%] 7280s tests/test_worker.py::test_str <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 87%] 7280s tests/test_worker.py::test_identity <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 87%] 7280s tests/test_worker.py::test_worker_bad_args <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 87%] 7283s tests/test_worker.py::test_upload_file <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 87%] 7283s tests/test_worker.py::test_upload_file_pyc <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py SKIPPED [ 87%] 7283s tests/test_worker.py::test_upload_egg <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 87%] 7283s tests/test_worker.py::test_upload_pyz <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 87%] 7284s tests/test_worker.py::test_upload_large_file <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py SKIPPED [ 87%] 7284s tests/test_worker.py::test_broadcast <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 88%] 7284s tests/test_worker.py::test_worker_with_port_zero <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 88%] 7284s tests/test_worker.py::test_worker_port_range <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 88%] 7284s tests/test_worker.py::test_worker_waits_for_scheduler <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py SKIPPED [ 88%] 7285s tests/test_worker.py::test_worker_task_data <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 88%] 7285s tests/test_worker.py::test_error_message <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 88%] 7285s tests/test_worker.py::test_chained_error_message <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 88%] 7285s tests/test_worker.py::test_base_exception_in_task[BaseException-True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py SKIPPED [ 88%] 7285s tests/test_worker.py::test_base_exception_in_task[BaseException-False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py SKIPPED [ 88%] 7285s tests/test_worker.py::test_base_exception_in_task[SystemExit-True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py SKIPPED [ 88%] 7285s tests/test_worker.py::test_base_exception_in_task[SystemExit-False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py SKIPPED [ 88%] 7285s tests/test_worker.py::test_base_exception_in_task[KeyboardInterrupt-True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py SKIPPED [ 88%] 7285s tests/test_worker.py::test_base_exception_in_task[KeyboardInterrupt-False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py SKIPPED [ 88%] 7285s tests/test_worker.py::test_base_exception_in_task[CancelledError-True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py SKIPPED [ 88%] 7285s tests/test_worker.py::test_base_exception_in_task[CancelledError-False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py SKIPPED [ 88%] 7285s tests/test_worker.py::test_gather <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 88%] 7286s tests/test_worker.py::test_gather_missing_keys <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 88%] 7286s tests/test_worker.py::test_gather_missing_workers <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 88%] 7286s tests/test_worker.py::test_gather_missing_workers_replicated[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py SKIPPED [ 88%] 7286s tests/test_worker.py::test_gather_missing_workers_replicated[True0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py SKIPPED [ 88%] 7286s tests/test_worker.py::test_gather_missing_workers_replicated[True1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py SKIPPED [ 88%] 7286s tests/test_worker.py::test_gather_missing_workers_replicated[True2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py SKIPPED [ 88%] 7286s tests/test_worker.py::test_gather_missing_workers_replicated[True3] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py SKIPPED [ 88%] 7286s tests/test_worker.py::test_io_loop <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 88%] 7286s tests/test_worker.py::test_io_loop_alternate_loop <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 88%] 7287s tests/test_worker.py::test_access_key <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 88%] 7287s tests/test_worker.py::test_run_dask_worker <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 88%] 7288s tests/test_worker.py::test_run_dask_worker_kwonlyarg <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 88%] 7288s tests/test_worker.py::test_run_coroutine_dask_worker <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 88%] 7288s tests/test_worker.py::test_Executor <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 88%] 7288s tests/test_worker.py::test_close_on_disconnect <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 88%] 7289s tests/test_worker.py::test_memory_limit_auto <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 88%] 7289s tests/test_worker.py::test_inter_worker_communication <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 89%] 7290s tests/test_worker.py::test_clean <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 89%] 7290s tests/test_worker.py::test_message_breakup <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 89%] 7290s tests/test_worker.py::test_types <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 89%] 7291s tests/test_worker.py::test_system_monitor <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 89%] 7291s tests/test_worker.py::test_restrictions <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 89%] 7293s tests/test_worker.py::test_clean_nbytes <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 89%] 7297s tests/test_worker.py::test_gather_many_small[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 89%] 7299s tests/test_worker.py::test_gather_many_small[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 89%] 7300s tests/test_worker.py::test_multiple_transfers <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 89%] 7300s tests/test_worker.py::test_share_communication <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py XFAIL [ 89%] 7301s tests/test_worker.py::test_dont_overlap_communications_to_same_worker <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py XFAIL [ 89%] 7301s tests/test_worker.py::test_log_exception_on_failed_task <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 89%] 7302s tests/test_worker.py::test_clean_up_dependencies <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 89%] 7302s tests/test_worker.py::test_hold_onto_dependents <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 89%] 7302s tests/test_worker.py::test_worker_death_timeout <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py XPASS [ 89%] 7303s tests/test_worker.py::test_stop_doing_unnecessary_work <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 89%] 7303s tests/test_worker.py::test_priorities <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 89%] 7305s tests/test_worker.py::test_heartbeats <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 89%] 7305s tests/test_worker.py::test_worker_dir[Worker] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 89%] 7306s tests/test_worker.py::test_worker_dir[Nanny] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 89%] 7307s tests/test_worker.py::test_default_worker_dir <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 89%] 7308s tests/test_worker.py::test_dataframe_attribute_error <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 89%] 7308s tests/test_worker.py::test_pid <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 89%] 7309s tests/test_worker.py::test_get_client <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 89%] 7311s tests/test_worker.py::test_get_client_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 89%] 7312s tests/test_worker.py::test_get_client_coroutine <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 89%] 7314s tests/test_worker.py::test_get_client_coroutine_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py XFAIL/distributed/pull/7339) [ 89%] 7315s tests/test_worker.py::test_global_workers <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 89%] 7315s tests/test_worker.py::test_worker_fds <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 89%] 7315s tests/test_worker.py::test_service_hosts_match_worker <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 89%] 7315s tests/test_worker.py::test_start_services <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 89%] 7317s tests/test_worker.py::test_scheduler_delay <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 90%] 7318s tests/test_worker.py::test_statistical_profiling <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 90%] 7318s tests/test_worker.py::test_statistical_profiling_2 <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py SKIPPED [ 90%] 7319s tests/test_worker.py::test_statistical_profiling_cycle <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 90%] 7320s tests/test_worker.py::test_get_current_task <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 90%] 7320s tests/test_worker.py::test_deque_handler <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 90%] 7320s tests/test_worker.py::test_scheduler_address_config <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 90%] 7320s tests/test_worker.py::test_wait_for_outgoing <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py SKIPPED [ 90%] 7320s tests/test_worker.py::test_prefer_gather_from_local_address <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 90%] 7323s tests/test_worker.py::test_avoid_oversubscription <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 90%] 7323s tests/test_worker.py::test_custom_metrics <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 90%] 7324s tests/test_worker.py::test_register_worker_callbacks <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 90%] 7325s tests/test_worker.py::test_register_worker_callbacks_err <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 90%] 7325s tests/test_worker.py::test_local_directory <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 90%] 7325s tests/test_worker.py::test_local_directory_make_new_directory <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 90%] 7327s tests/test_worker.py::test_host_address <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 90%] 7327s tests/test_worker.py::test_interface_async[Worker] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 90%] 7329s tests/test_worker.py::test_interface_async[Nanny] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 90%] 7329s tests/test_worker.py::test_protocol_from_scheduler_address[Worker] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py SKIPPED [ 90%] 7329s tests/test_worker.py::test_protocol_from_scheduler_address[Nanny] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py SKIPPED [ 90%] 7329s tests/test_worker.py::test_worker_listens_on_same_interface_by_default[Worker] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 90%] 7331s tests/test_worker.py::test_worker_listens_on_same_interface_by_default[Nanny] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 90%] 7331s tests/test_worker.py::test_close_gracefully <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py SKIPPED [ 90%] 7331s tests/test_worker.py::test_close_gracefully_no_suspicious_tasks <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py SKIPPED [ 90%] 7332s tests/test_worker.py::test_close_while_executing[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 90%] 7332s tests/test_worker.py::test_close_while_executing[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py SKIPPED [ 90%] 7332s tests/test_worker.py::test_close_async_task_handles_cancellation <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py SKIPPED [ 90%] 7332s tests/test_worker.py::test_lifetime <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py SKIPPED [ 90%] 7332s tests/test_worker.py::test_lifetime_stagger <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 90%] 7332s tests/test_worker.py::test_bad_metrics <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 90%] 7332s tests/test_worker.py::test_bad_startup <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 90%] 7332s tests/test_worker.py::test_update_latency <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 90%] 7332s tests/test_worker.py::test_workerstate_executing <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py SKIPPED [ 90%] 7333s tests/test_worker.py::test_shutdown_on_scheduler_comm_closed <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 91%] 7333s tests/test_worker.py::test_heartbeat_comm_closed <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 91%] 7333s tests/test_worker.py::test_heartbeat_missing <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 91%] 7333s tests/test_worker.py::test_heartbeat_missing_real_cluster <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 91%] 7333s tests/test_worker.py::test_heartbeat_missing_doesnt_restart <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py SKIPPED [ 91%] 7333s tests/test_worker.py::test_bad_local_directory <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 91%] 7333s tests/test_worker.py::test_taskstate_metadata <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 91%] 7334s tests/test_worker.py::test_executor_offload <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 91%] 7334s tests/test_worker.py::test_story <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 91%] 7334s tests/test_worker.py::test_stimulus_story <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 91%] 7336s tests/test_worker.py::test_worker_descopes_data <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 91%] 7338s tests/test_worker.py::test_gather_dep_one_worker_always_busy <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 91%] 7340s tests/test_worker.py::test_gather_dep_local_workers_first <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 91%] 7342s tests/test_worker.py::test_gather_dep_from_remote_workers_if_all_local_workers_are_busy <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 91%] 7342s tests/test_worker.py::test_worker_client_uses_default_no_close <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 91%] 7342s tests/test_worker.py::test_worker_client_closes_if_created_on_worker_one_worker <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 91%] 7343s tests/test_worker.py::test_worker_client_closes_if_created_on_worker_last_worker_alive <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 91%] 7343s tests/test_worker.py::test_multiple_executors <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 91%] 7344s tests/test_worker.py::test_bad_executor_annotation <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 91%] 7345s tests/test_worker.py::test_process_executor <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 91%] 7347s tests/test_worker.py::test_process_executor_raise_exception <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 91%] 7348s tests/test_worker.py::test_worker_state_error_release_error_last <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 91%] 7348s tests/test_worker.py::test_worker_state_error_release_error_first <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 91%] 7348s tests/test_worker.py::test_worker_state_error_release_error_int <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 91%] 7349s tests/test_worker.py::test_worker_state_error_long_chain <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 91%] 7350s tests/test_worker.py::test_hold_on_to_replicas <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 91%] 7351s tests/test_worker.py::test_forget_dependents_after_release <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 91%] 7351s tests/test_worker.py::test_acquire_replicas <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 91%] 7351s tests/test_worker.py::test_acquire_replicas_same_channel <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 91%] 7352s tests/test_worker.py::test_acquire_replicas_many <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 91%] 7353s tests/test_worker.py::test_acquire_replicas_already_in_flight <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 91%] 7353s tests/test_worker.py::test_forget_acquire_replicas <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py SKIPPED [ 91%] 7353s tests/test_worker.py::test_remove_replicas_simple <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 92%] 7354s tests/test_worker.py::test_who_has_consistent_remove_replicas <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 92%] 7354s tests/test_worker.py::test_acquire_replicas_with_no_priority <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 92%] 7355s tests/test_worker.py::test_acquire_replicas_large_data <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 92%] 7355s tests/test_worker.py::test_missing_released_zombie_tasks <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 92%] 7356s tests/test_worker.py::test_missing_released_zombie_tasks_2 <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 92%] 7356s tests/test_worker.py::test_worker_status_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 92%] 7357s tests/test_worker.py::test_log_remove_worker <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 92%] 7357s tests/test_worker.py::test_task_flight_compute_oserror <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 92%] 7358s tests/test_worker.py::test_gather_dep_cancelled_rescheduled <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 92%] 7358s tests/test_worker.py::test_gather_dep_do_not_handle_response_of_not_requested_tasks <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 92%] 7359s tests/test_worker.py::test_gather_dep_no_longer_in_flight_tasks <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 92%] 7361s tests/test_worker.py::test_get_data_cancelled_error <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 92%] 7361s tests/test_worker.py::test_Worker__to_dict <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 92%] 7361s tests/test_worker.py::test_extension_methods <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 92%] 7362s tests/test_worker.py::test_benchmark_hardware <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 92%] 7362s tests/test_worker.py::test_tick_interval <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py SKIPPED [ 92%] 7362s tests/test_worker.py::test_broken_comm <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py SKIPPED [ 92%] 7362s tests/test_worker.py::test_do_not_block_event_loop_during_shutdown <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 92%] 7362s tests/test_worker.py::test_reconnect_argument_deprecated <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 92%] 7363s tests/test_worker.py::test_worker_running_before_running_plugins <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 92%] 7363s tests/test_worker.py::test_execute_preamble_abort_retirement <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 92%] 7363s tests/test_worker.py::test_deprecation_of_renamed_worker_attributes <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 92%] 7366s tests/test_worker.py::test_forward_output <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 92%] 7366s tests/test_worker.py::test_offload_getdata <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 92%] 7367s tests/test_worker.py::test_startstops <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 92%] 7367s tests/test_worker.py::test_suppress_keyerror_for_cancelled_tasks[cancelled] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 92%] 7368s tests/test_worker.py::test_suppress_keyerror_for_cancelled_tasks[resumed] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 92%] 7368s tests/test_worker.py::test_suppress_compute_failure_for_cancelled_tasks <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py PASSED [ 92%] 7369s tests/test_worker_client.py::test_submit_from_worker <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_client.py PASSED [ 92%] 7369s tests/test_worker_client.py::test_submit_from_worker_async <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_client.py PASSED [ 92%] 7370s tests/test_worker_client.py::test_scatter_from_worker <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_client.py PASSED [ 92%] 7370s tests/test_worker_client.py::test_scatter_singleton <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_client.py PASSED [ 93%] 7371s tests/test_worker_client.py::test_gather_multi_machine <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_client.py PASSED [ 93%] 7371s tests/test_worker_client.py::test_same_loop <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_client.py PASSED [ 93%] 7374s tests/test_worker_client.py::test_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_client.py PASSED [ 93%] 7375s tests/test_worker_client.py::test_async <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_client.py PASSED [ 93%] 7375s tests/test_worker_client.py::test_separate_thread_false <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_client.py PASSED [ 93%] 7376s tests/test_worker_client.py::test_client_executor <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_client.py PASSED [ 93%] 7376s tests/test_worker_client.py::test_local_client_warning <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_client.py PASSED [ 93%] 7377s tests/test_worker_client.py::test_closing_worker_doesnt_close_client <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_client.py PASSED [ 93%] 7380s tests/test_worker_client.py::test_timeout <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_client.py PASSED [ 93%] 7380s tests/test_worker_client.py::test_secede_without_stealing_issue_1262 <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_client.py PASSED [ 93%] 7380s tests/test_worker_client.py::test_compute_within_worker_client <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_client.py PASSED [ 93%] 7381s tests/test_worker_client.py::test_worker_client_rejoins <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_client.py PASSED [ 93%] 7382s tests/test_worker_client.py::test_submit_different_names <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_client.py XPASS [ 93%] 7383s tests/test_worker_client.py::test_secede_does_not_claim_worker <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_client.py PASSED [ 93%] 7383s tests/test_worker_client.py::test_log_event <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_client.py PASSED [ 93%] 7384s tests/test_worker_client.py::test_log_event_implicit <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_client.py PASSED [ 93%] 7384s tests/test_worker_memory.py::test_parse_memory_limit_zero <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 93%] 7384s tests/test_worker_memory.py::test_resource_limit <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 93%] 7384s tests/test_worker_memory.py::test_parse_memory_limit_worker <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 93%] 7384s tests/test_worker_memory.py::test_parse_memory_limit_worker_relative <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 93%] 7386s tests/test_worker_memory.py::test_parse_memory_limit_nanny <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 93%] 7386s tests/test_worker_memory.py::test_dict_data_if_no_spill_to_disk <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 93%] 7386s tests/test_worker_memory.py::test_worker_data_callable_local_directory <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 93%] 7387s tests/test_worker_memory.py::test_worker_data_callable_local_directory_kwargs <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 93%] 7387s tests/test_worker_memory.py::test_worker_data_callable_kwargs <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 93%] 7387s tests/test_worker_memory.py::test_workerstate_fail_to_pickle_execute_1[executing] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 93%] 7387s tests/test_worker_memory.py::test_workerstate_fail_to_pickle_execute_1[long-running] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 93%] 7387s tests/test_worker_memory.py::test_workerstate_fail_to_pickle_flight <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 93%] 7387s tests/test_worker_memory.py::test_fail_to_pickle_execute_2 <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 93%] 7388s tests/test_worker_memory.py::test_fail_to_pickle_spill <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 93%] 7388s tests/test_worker_memory.py::test_spill_target_threshold <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 93%] 7389s tests/test_worker_memory.py::test_spill_constrained <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 93%] 7389s tests/test_worker_memory.py::test_spill_spill_threshold <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 94%] 7389s tests/test_worker_memory.py::test_spill_hysteresis[False-10000000000-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 94%] 7390s tests/test_worker_memory.py::test_spill_hysteresis[0.7-0-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 94%] 7390s tests/test_worker_memory.py::test_spill_hysteresis[0.4-0-7] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 94%] 7391s tests/test_worker_memory.py::test_pause_executor_manual <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 94%] 7393s tests/test_worker_memory.py::test_pause_executor_with_memory_monitor <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 94%] 7394s tests/test_worker_memory.py::test_pause_prevents_deps_fetch <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 94%] 7394s tests/test_worker_memory.py::test_avoid_memory_monitor_if_zero_limit_worker <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 94%] 7397s tests/test_worker_memory.py::test_avoid_memory_monitor_if_zero_limit_nanny <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 94%] 7397s tests/test_worker_memory.py::test_override_data_worker <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 94%] 7400s tests/test_worker_memory.py::test_override_data_nanny <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 94%] 7402s tests/test_worker_memory.py::test_override_data_vs_memory_monitor <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 94%] 7402s tests/test_worker_memory.py::test_manual_evict_proto <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 94%] 7402s tests/test_worker_memory.py::test_nanny_terminate <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py SKIPPED [ 94%] 7402s tests/test_worker_memory.py::test_disk_cleanup_on_terminate[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py SKIPPED [ 94%] 7402s tests/test_worker_memory.py::test_disk_cleanup_on_terminate[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py SKIPPED [ 94%] 7404s tests/test_worker_memory.py::test_pause_while_spilling <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 94%] 7404s tests/test_worker_memory.py::test_release_evloop_while_spilling <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py SKIPPED [ 94%] 7404s tests/test_worker_memory.py::test_deprecated_attributes[Worker-memory_limit-123000000000.0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 94%] 7405s tests/test_worker_memory.py::test_deprecated_attributes[Worker-memory_target_fraction-0.789] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 94%] 7405s tests/test_worker_memory.py::test_deprecated_attributes[Worker-memory_spill_fraction-0.789] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 94%] 7405s tests/test_worker_memory.py::test_deprecated_attributes[Worker-memory_pause_fraction-0.789] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 94%] 7408s tests/test_worker_memory.py::test_deprecated_attributes[Nanny-memory_limit-123000000000.0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 94%] 7410s tests/test_worker_memory.py::test_deprecated_attributes[Nanny-memory_terminate_fraction-0.789] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 94%] 7410s tests/test_worker_memory.py::test_deprecated_memory_monitor_method_worker <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 94%] 7412s tests/test_worker_memory.py::test_deprecated_memory_monitor_method_nanny <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 94%] 7412s tests/test_worker_memory.py::test_deprecated_params[memory_target_fraction] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 94%] 7412s tests/test_worker_memory.py::test_deprecated_params[memory_spill_fraction] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 94%] 7413s tests/test_worker_memory.py::test_deprecated_params[memory_pause_fraction] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 94%] 7415s tests/test_worker_memory.py::test_pause_while_idle <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 94%] 7418s tests/test_worker_memory.py::test_pause_while_saturated <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 94%] 7418s tests/test_worker_memory.py::test_worker_log_memory_limit_too_high <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 94%] 7418s tests/test_worker_memory.py::test_high_unmanaged_memory_warning <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 95%] 7418s tests/test_worker_memory.py::test_delete_spilled_keys <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py PASSED [ 95%] 7419s tests/test_worker_metrics.py::test_task_lifecycle <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_metrics.py PASSED [ 95%] 7419s tests/test_worker_metrics.py::test_async_task <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_metrics.py PASSED [ 95%] 7421s tests/test_worker_metrics.py::test_custom_executor <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_metrics.py PASSED [ 95%] 7422s tests/test_worker_metrics.py::test_offload <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_metrics.py PASSED [ 95%] 7422s tests/test_worker_metrics.py::test_execute_failed <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_metrics.py PASSED [ 95%] 7423s tests/test_worker_metrics.py::test_cancelled_execute <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_metrics.py PASSED [ 95%] 7423s tests/test_worker_metrics.py::test_cancelled_flight <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_metrics.py PASSED [ 95%] 7424s tests/test_worker_metrics.py::test_gather_dep_busy <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_metrics.py PASSED [ 95%] 7426s tests/test_worker_metrics.py::test_gather_dep_no_task <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_metrics.py PASSED [ 95%] 7426s tests/test_worker_metrics.py::test_gather_dep_failed <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_metrics.py PASSED [ 95%] 7427s tests/test_worker_metrics.py::test_gather_dep_network_error <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_metrics.py PASSED [ 95%] 7428s tests/test_worker_metrics.py::test_memory_monitor <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_metrics.py PASSED [ 95%] 7428s tests/test_worker_metrics.py::test_user_metrics_sync <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_metrics.py PASSED [ 95%] 7429s tests/test_worker_metrics.py::test_user_metrics_async <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_metrics.py PASSED [ 95%] 7429s tests/test_worker_metrics.py::test_user_metrics_fail <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_metrics.py PASSED [ 95%] 7429s tests/test_worker_metrics.py::test_user_metrics_weird <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_metrics.py PASSED [ 95%] 7433s tests/test_worker_metrics.py::test_do_not_leak_metrics <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_metrics.py PASSED [ 95%] 7434s tests/test_worker_metrics.py::test_reschedule <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_metrics.py PASSED [ 95%] 7435s tests/test_worker_metrics.py::test_send_metrics_to_scheduler <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_metrics.py PASSED [ 95%] 7435s tests/test_worker_metrics.py::test_no_spans_extension <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_metrics.py PASSED [ 95%] 7435s tests/test_worker_metrics.py::test_new_metrics_during_heartbeat <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_metrics.py PASSED [ 95%] 7439s tests/test_worker_metrics.py::test_delayed_ledger_is_not_reentrant <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_metrics.py PASSED [ 95%] 7439s tests/test_worker_metrics.py::test_int_metrics <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_metrics.py PASSED [ 95%] 7439s tests/test_worker_state_machine.py::test_instruction_match <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 95%] 7441s tests/test_worker_state_machine.py::test_TaskState_tracking <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 95%] 7441s tests/test_worker_state_machine.py::test_TaskState_get_nbytes <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 95%] 7441s tests/test_worker_state_machine.py::test_TaskState_eq <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 95%] 7441s tests/test_worker_state_machine.py::test_TaskState__to_dict <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 95%] 7441s tests/test_worker_state_machine.py::test_TaskState_repr <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 95%] 7441s tests/test_worker_state_machine.py::test_WorkerState__to_dict <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 95%] 7441s tests/test_worker_state_machine.py::test_WorkerState_pickle <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 96%] 7441s tests/test_worker_state_machine.py::test_pickle_exceptions[False-InvalidTransition-kwargs0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 96%] 7441s tests/test_worker_state_machine.py::test_pickle_exceptions[False-TransitionCounterMaxExceeded-kwargs1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 96%] 7441s tests/test_worker_state_machine.py::test_pickle_exceptions[False-InvalidTaskState-kwargs2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 96%] 7441s tests/test_worker_state_machine.py::test_pickle_exceptions[True-InvalidTransition-kwargs0] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 96%] 7441s tests/test_worker_state_machine.py::test_pickle_exceptions[True-TransitionCounterMaxExceeded-kwargs1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 96%] 7441s tests/test_worker_state_machine.py::test_pickle_exceptions[True-InvalidTaskState-kwargs2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 96%] 7441s tests/test_worker_state_machine.py::test_slots[TaskState] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 96%] 7441s tests/test_worker_state_machine.py::test_slots[Instruction] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 96%] 7441s tests/test_worker_state_machine.py::test_slots[GatherDep] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 96%] 7441s tests/test_worker_state_machine.py::test_slots[Execute] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 96%] 7441s tests/test_worker_state_machine.py::test_slots[RetryBusyWorkerLater] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 96%] 7441s tests/test_worker_state_machine.py::test_slots[SendMessageToScheduler] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 96%] 7441s tests/test_worker_state_machine.py::test_slots[TaskFinishedMsg] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 96%] 7441s tests/test_worker_state_machine.py::test_slots[TaskErredMsg] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 96%] 7441s tests/test_worker_state_machine.py::test_slots[ReleaseWorkerDataMsg] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 96%] 7441s tests/test_worker_state_machine.py::test_slots[RescheduleMsg] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 96%] 7441s tests/test_worker_state_machine.py::test_slots[LongRunningMsg] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 96%] 7441s tests/test_worker_state_machine.py::test_slots[AddKeysMsg] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 96%] 7441s tests/test_worker_state_machine.py::test_slots[RequestRefreshWhoHasMsg] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 96%] 7441s tests/test_worker_state_machine.py::test_slots[StealResponseMsg] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 96%] 7441s tests/test_worker_state_machine.py::test_slots[StateMachineEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 96%] 7441s tests/test_worker_state_machine.py::test_slots[PauseEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 96%] 7441s tests/test_worker_state_machine.py::test_slots[UnpauseEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 96%] 7441s tests/test_worker_state_machine.py::test_slots[RetryBusyWorkerEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 96%] 7441s tests/test_worker_state_machine.py::test_slots[GatherDepDoneEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 96%] 7441s tests/test_worker_state_machine.py::test_slots[GatherDepSuccessEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 96%] 7441s tests/test_worker_state_machine.py::test_slots[GatherDepBusyEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 96%] 7441s tests/test_worker_state_machine.py::test_slots[GatherDepNetworkFailureEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 96%] 7441s tests/test_worker_state_machine.py::test_slots[GatherDepFailureEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 96%] 7441s tests/test_worker_state_machine.py::test_slots[RemoveWorkerEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 96%] 7441s tests/test_worker_state_machine.py::test_slots[ComputeTaskEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 96%] 7441s tests/test_worker_state_machine.py::test_slots[ExecuteDoneEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 96%] 7441s tests/test_worker_state_machine.py::test_slots[ExecuteSuccessEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 97%] 7441s tests/test_worker_state_machine.py::test_slots[ExecuteFailureEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 97%] 7441s tests/test_worker_state_machine.py::test_slots[RescheduleEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 97%] 7441s tests/test_worker_state_machine.py::test_slots[CancelComputeEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 97%] 7441s tests/test_worker_state_machine.py::test_slots[FindMissingEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 97%] 7441s tests/test_worker_state_machine.py::test_slots[RefreshWhoHasEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 97%] 7441s tests/test_worker_state_machine.py::test_slots[AcquireReplicasEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 97%] 7441s tests/test_worker_state_machine.py::test_slots[RemoveReplicasEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 97%] 7441s tests/test_worker_state_machine.py::test_slots[FreeKeysEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 97%] 7441s tests/test_worker_state_machine.py::test_slots[StealRequestEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 97%] 7441s tests/test_worker_state_machine.py::test_slots[UpdateDataEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 97%] 7441s tests/test_worker_state_machine.py::test_slots[SecedeEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 97%] 7441s tests/test_worker_state_machine.py::test_sendmsg_to_dict <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 97%] 7441s tests/test_worker_state_machine.py::test_merge_recs_instructions <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 97%] 7441s tests/test_worker_state_machine.py::test_event_to_dict_with_annotations <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 97%] 7441s tests/test_worker_state_machine.py::test_event_to_dict_without_annotations <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 97%] 7441s tests/test_worker_state_machine.py::test_computetask_to_dict <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 97%] 7441s tests/test_worker_state_machine.py::test_computetask_dummy <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 97%] 7441s tests/test_worker_state_machine.py::test_updatedata_to_dict <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 97%] 7441s tests/test_worker_state_machine.py::test_executesuccess_to_dict <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 97%] 7441s tests/test_worker_state_machine.py::test_executesuccess_dummy <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 97%] 7441s tests/test_worker_state_machine.py::test_executefailure_to_dict <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 97%] 7441s tests/test_worker_state_machine.py::test_executefailure_dummy <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 97%] 7442s tests/test_worker_state_machine.py::test_fetch_to_compute <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 97%] 7442s tests/test_worker_state_machine.py::test_fetch_via_amm_to_compute <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 97%] 7443s tests/test_worker_state_machine.py::test_lose_replica_during_fetch[False] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 97%] 7443s tests/test_worker_state_machine.py::test_lose_replica_during_fetch[True] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 97%] 7444s tests/test_worker_state_machine.py::test_fetch_to_missing_on_busy <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 97%] 7444s tests/test_worker_state_machine.py::test_new_replica_while_all_workers_in_flight <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 97%] 7444s tests/test_worker_state_machine.py::test_cancelled_while_in_flight <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 97%] 7445s tests/test_worker_state_machine.py::test_in_memory_while_in_flight <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 97%] 7445s tests/test_worker_state_machine.py::test_forget_data_needed <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 97%] 7446s tests/test_worker_state_machine.py::test_missing_handle_compute_dependency <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 98%] 7447s tests/test_worker_state_machine.py::test_missing_to_waiting <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 98%] 7448s tests/test_worker_state_machine.py::test_fetch_to_missing_on_refresh_who_has <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 98%] 7448s tests/test_worker_state_machine.py::test_fetch_to_missing_on_network_failure <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 98%] 7449s tests/test_worker_state_machine.py::test_deprecated_worker_attributes <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 98%] 7449s tests/test_worker_state_machine.py::test_aggregate_gather_deps[10000000-3-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 98%] 7449s tests/test_worker_state_machine.py::test_aggregate_gather_deps[10000000-3-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 98%] 7449s tests/test_worker_state_machine.py::test_aggregate_gather_deps[20000000-2-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 98%] 7449s tests/test_worker_state_machine.py::test_aggregate_gather_deps[20000000-2-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 98%] 7449s tests/test_worker_state_machine.py::test_aggregate_gather_deps[30000000-1-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 98%] 7449s tests/test_worker_state_machine.py::test_aggregate_gather_deps[30000000-1-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 98%] 7449s tests/test_worker_state_machine.py::test_aggregate_gather_deps[60000000-1-1] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 98%] 7449s tests/test_worker_state_machine.py::test_aggregate_gather_deps[60000000-1-2] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 98%] 7449s tests/test_worker_state_machine.py::test_gather_priority <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 98%] 7449s tests/test_worker_state_machine.py::test_task_acquires_resources[executing] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 98%] 7449s tests/test_worker_state_machine.py::test_task_acquires_resources[long-running] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 98%] 7449s tests/test_worker_state_machine.py::test_task_releases_resources[executing-ExecuteSuccessEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 98%] 7449s tests/test_worker_state_machine.py::test_task_releases_resources[executing-ExecuteFailureEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 98%] 7449s tests/test_worker_state_machine.py::test_task_releases_resources[executing-RescheduleEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 98%] 7449s tests/test_worker_state_machine.py::test_task_releases_resources[long-running-ExecuteSuccessEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 98%] 7449s tests/test_worker_state_machine.py::test_task_releases_resources[long-running-ExecuteFailureEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 98%] 7449s tests/test_worker_state_machine.py::test_task_releases_resources[long-running-RescheduleEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 98%] 7449s tests/test_worker_state_machine.py::test_task_with_dependencies_acquires_resources <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 98%] 7449s tests/test_worker_state_machine.py::test_resumed_task_releases_resources[executing-ExecuteSuccessEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 98%] 7449s tests/test_worker_state_machine.py::test_resumed_task_releases_resources[executing-ExecuteFailureEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 98%] 7449s tests/test_worker_state_machine.py::test_resumed_task_releases_resources[executing-RescheduleEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 98%] 7449s tests/test_worker_state_machine.py::test_resumed_task_releases_resources[long-running-ExecuteSuccessEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 98%] 7449s tests/test_worker_state_machine.py::test_resumed_task_releases_resources[long-running-ExecuteFailureEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 98%] 7449s tests/test_worker_state_machine.py::test_resumed_task_releases_resources[long-running-RescheduleEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 98%] 7449s tests/test_worker_state_machine.py::test_clean_log <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 98%] 7449s tests/test_worker_state_machine.py::test_running_task_in_all_running_tasks[executing] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 98%] 7449s tests/test_worker_state_machine.py::test_running_task_in_all_running_tasks[long-running] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 98%] 7449s tests/test_worker_state_machine.py::test_done_task_not_in_all_running_tasks[executing-ExecuteSuccessEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 99%] 7449s tests/test_worker_state_machine.py::test_done_task_not_in_all_running_tasks[executing-ExecuteFailureEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 99%] 7449s tests/test_worker_state_machine.py::test_done_task_not_in_all_running_tasks[executing-RescheduleEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 99%] 7449s tests/test_worker_state_machine.py::test_done_task_not_in_all_running_tasks[long-running-ExecuteSuccessEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 99%] 7449s tests/test_worker_state_machine.py::test_done_task_not_in_all_running_tasks[long-running-ExecuteFailureEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 99%] 7449s tests/test_worker_state_machine.py::test_done_task_not_in_all_running_tasks[long-running-RescheduleEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 99%] 7449s tests/test_worker_state_machine.py::test_done_resumed_task_not_in_all_running_tasks[executing-ExecuteSuccessEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 99%] 7449s tests/test_worker_state_machine.py::test_done_resumed_task_not_in_all_running_tasks[executing-ExecuteFailureEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 99%] 7449s tests/test_worker_state_machine.py::test_done_resumed_task_not_in_all_running_tasks[executing-RescheduleEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 99%] 7449s tests/test_worker_state_machine.py::test_done_resumed_task_not_in_all_running_tasks[long-running-ExecuteSuccessEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 99%] 7449s tests/test_worker_state_machine.py::test_done_resumed_task_not_in_all_running_tasks[long-running-ExecuteFailureEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 99%] 7449s tests/test_worker_state_machine.py::test_done_resumed_task_not_in_all_running_tasks[long-running-RescheduleEvent] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 99%] 7449s tests/test_worker_state_machine.py::test_gather_dep_failure <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 99%] 7449s tests/test_worker_state_machine.py::test_recompute_erred_task <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 99%] 7449s tests/test_worker_state_machine.py::test_transfer_incoming_metrics <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 99%] 7449s tests/test_worker_state_machine.py::test_throttling_does_not_affect_first_transfer <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 99%] 7449s tests/test_worker_state_machine.py::test_message_target_does_not_affect_first_transfer_on_different_worker <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 99%] 7449s tests/test_worker_state_machine.py::test_throttle_incoming_transfers_on_count_limit <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 99%] 7449s tests/test_worker_state_machine.py::test_throttling_incoming_transfer_on_transfer_bytes_same_worker <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 99%] 7449s tests/test_worker_state_machine.py::test_throttling_incoming_transfer_on_transfer_bytes_different_workers <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 99%] 7449s tests/test_worker_state_machine.py::test_do_not_throttle_connections_while_below_threshold <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 99%] 7449s tests/test_worker_state_machine.py::test_throttle_on_transfer_bytes_regardless_of_threshold <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 99%] 7449s tests/test_worker_state_machine.py::test_worker_nbytes[executing] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 99%] 7449s tests/test_worker_state_machine.py::test_worker_nbytes[long-running] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 99%] 7449s tests/test_worker_state_machine.py::test_fetch_count <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 99%] 7449s tests/test_worker_state_machine.py::test_task_counter <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 99%] 7449s tests/test_worker_state_machine.py::test_remove_worker_while_in_flight[fail] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 99%] 7449s tests/test_worker_state_machine.py::test_remove_worker_while_in_flight[success] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 99%] 7449s tests/test_worker_state_machine.py::test_remove_worker_while_in_flight[no-key] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 99%] 7449s tests/test_worker_state_machine.py::test_remove_worker_while_in_flight[busy] <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 99%] 7449s tests/test_worker_state_machine.py::test_remove_worker_while_in_flight_unused_peer <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 99%] 7449s tests/test_worker_state_machine.py::test_remove_worker_while_in_fetch <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [ 99%] 7449s tests/test_worker_state_machine.py::test_remove_worker_unknown <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_state_machine.py PASSED [100%] 7449s 7449s =================================== FAILURES =================================== 7449s _____________________________ test_retire_workers ______________________________ 7449s 7449s fut = , timeout = 0 7449s 7449s async def wait_for(fut: Awaitable[T], timeout: float) -> T: 7449s async with asyncio.timeout(timeout): 7449s > return await fut 7449s 7449s /usr/lib/python3/dist-packages/distributed/utils.py:1914: 7449s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 7449s /usr/lib/python3/dist-packages/distributed/nanny.py:358: in start_unsafe 7449s comm = await self.rpc.connect(saddr) 7449s /usr/lib/python3/dist-packages/distributed/core.py:1485: in connect 7449s return await self._connect(addr=addr, timeout=timeout) 7449s /usr/lib/python3/dist-packages/distributed/core.py:1429: in _connect 7449s comm = await connect( 7449s /usr/lib/python3/dist-packages/distributed/comm/core.py:342: in connect 7449s comm = await wait_for( 7449s /usr/lib/python3/dist-packages/distributed/utils.py:1914: in wait_for 7449s return await fut 7449s /usr/lib/python3/dist-packages/distributed/comm/tcp.py:546: in connect 7449s stream = await self.client.connect( 7449s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 7449s 7449s self = 7449s host = '127.0.0.1', port = 40895, af = 7449s ssl_options = 7449s max_buffer_size = 4163037184.0, source_ip = None, source_port = None 7449s timeout = None 7449s 7449s async def connect( 7449s self, 7449s host: str, 7449s port: int, 7449s af: socket.AddressFamily = socket.AF_UNSPEC, 7449s ssl_options: Optional[Union[Dict[str, Any], ssl.SSLContext]] = None, 7449s max_buffer_size: Optional[int] = None, 7449s source_ip: Optional[str] = None, 7449s source_port: Optional[int] = None, 7449s timeout: Optional[Union[float, datetime.timedelta]] = None, 7449s ) -> IOStream: 7449s """Connect to the given host and port. 7449s 7449s Asynchronously returns an `.IOStream` (or `.SSLIOStream` if 7449s ``ssl_options`` is not None). 7449s 7449s Using the ``source_ip`` kwarg, one can specify the source 7449s IP address to use when establishing the connection. 7449s In case the user needs to resolve and 7449s use a specific interface, it has to be handled outside 7449s of Tornado as this depends very much on the platform. 7449s 7449s Raises `TimeoutError` if the input future does not complete before 7449s ``timeout``, which may be specified in any form allowed by 7449s `.IOLoop.add_timeout` (i.e. a `datetime.timedelta` or an absolute time 7449s relative to `.IOLoop.time`) 7449s 7449s Similarly, when the user requires a certain source port, it can 7449s be specified using the ``source_port`` arg. 7449s 7449s .. versionchanged:: 4.5 7449s Added the ``source_ip`` and ``source_port`` arguments. 7449s 7449s .. versionchanged:: 5.0 7449s Added the ``timeout`` argument. 7449s """ 7449s if timeout is not None: 7449s if isinstance(timeout, numbers.Real): 7449s timeout = IOLoop.current().time() + timeout 7449s elif isinstance(timeout, datetime.timedelta): 7449s timeout = IOLoop.current().time() + timeout.total_seconds() 7449s else: 7449s raise TypeError("Unsupported timeout %r" % timeout) 7449s if timeout is not None: 7449s addrinfo = await gen.with_timeout( 7449s timeout, self.resolver.resolve(host, port, af) 7449s ) 7449s else: 7449s addrinfo = await self.resolver.resolve(host, port, af) 7449s connector = _Connector( 7449s addrinfo, 7449s functools.partial( 7449s self._create_stream, 7449s max_buffer_size, 7449s source_ip=source_ip, 7449s source_port=source_port, 7449s ), 7449s ) 7449s > af, addr, stream = await connector.start(connect_timeout=timeout) 7449s E asyncio.exceptions.CancelledError 7449s 7449s /usr/lib/python3/dist-packages/tornado/tcpclient.py:279: CancelledError 7449s 7449s The above exception was the direct cause of the following exception: 7449s 7449s self = 7449s 7449s @final 7449s async def start(self): 7449s async with self._startup_lock: 7449s if self.status == Status.failed: 7449s assert self.__startup_exc is not None 7449s raise self.__startup_exc 7449s elif self.status != Status.init: 7449s return self 7449s timeout = getattr(self, "death_timeout", None) 7449s 7449s async def _close_on_failure(exc: Exception) -> None: 7449s await self.close(reason=f"failure-to-start-{str(type(exc))}") 7449s self.status = Status.failed 7449s self.__startup_exc = exc 7449s 7449s try: 7449s > await wait_for(self.start_unsafe(), timeout=timeout) 7449s 7449s /usr/lib/python3/dist-packages/distributed/core.py:528: 7449s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 7449s /usr/lib/python3/dist-packages/distributed/utils.py:1913: in wait_for 7449s async with asyncio.timeout(timeout): 7449s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 7449s 7449s self = 7449s exc_type = 7449s exc_val = CancelledError(), exc_tb = 7449s 7449s async def __aexit__( 7449s self, 7449s exc_type: Optional[Type[BaseException]], 7449s exc_val: Optional[BaseException], 7449s exc_tb: Optional[TracebackType], 7449s ) -> Optional[bool]: 7449s assert self._state in (_State.ENTERED, _State.EXPIRING) 7449s 7449s if self._timeout_handler is not None: 7449s self._timeout_handler.cancel() 7449s self._timeout_handler = None 7449s 7449s if self._state is _State.EXPIRING: 7449s self._state = _State.EXPIRED 7449s 7449s if self._task.uncancel() <= self._cancelling and exc_type is not None: 7449s # Since there are no new cancel requests, we're 7449s # handling this. 7449s if issubclass(exc_type, exceptions.CancelledError): 7449s > raise TimeoutError from exc_val 7449s E TimeoutError 7449s 7449s /usr/lib/python3.13/asyncio/timeouts.py:116: TimeoutError 7449s 7449s The above exception was the direct cause of the following exception: 7449s 7449s @contextlib.asynccontextmanager 7449s async def _cluster_factory(): 7449s workers = [] 7449s s = None 7449s try: 7449s for _ in range(60): 7449s try: 7449s > s, ws = await start_cluster( 7449s nthreads, 7449s scheduler, 7449s security=security, 7449s Worker=Worker, 7449s scheduler_kwargs=scheduler_kwargs, 7449s worker_kwargs=merge( 7449s {"death_timeout": min(15, int(deadline.remaining))}, 7449s worker_kwargs, 7449s ), 7449s ) 7449s 7449s /usr/lib/python3/dist-packages/distributed/utils_test.py:974: 7449s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 7449s /usr/lib/python3/dist-packages/distributed/utils_test.py:791: in start_cluster 7449s await asyncio.gather(*workers) 7449s /usr/lib/python3.13/asyncio/tasks.py:737: in _wrap_awaitable 7449s return await awaitable 7449s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 7449s 7449s self = 7449s 7449s @final 7449s async def start(self): 7449s async with self._startup_lock: 7449s if self.status == Status.failed: 7449s assert self.__startup_exc is not None 7449s raise self.__startup_exc 7449s elif self.status != Status.init: 7449s return self 7449s timeout = getattr(self, "death_timeout", None) 7449s 7449s async def _close_on_failure(exc: Exception) -> None: 7449s await self.close(reason=f"failure-to-start-{str(type(exc))}") 7449s self.status = Status.failed 7449s self.__startup_exc = exc 7449s 7449s try: 7449s await wait_for(self.start_unsafe(), timeout=timeout) 7449s except asyncio.TimeoutError as exc: 7449s await _close_on_failure(exc) 7449s > raise asyncio.TimeoutError( 7449s f"{type(self).__name__} start timed out after {timeout}s." 7449s ) from exc 7449s E TimeoutError: Nanny start timed out after 0s. 7449s 7449s /usr/lib/python3/dist-packages/distributed/core.py:531: TimeoutError 7449s 7449s During handling of the above exception, another exception occurred: 7449s 7449s fut = ._..test_func..async_fn at 0x748b8a370200> 7449s timeout = 60 7449s 7449s async def wait_for(fut: Awaitable[T], timeout: float) -> T: 7449s async with asyncio.timeout(timeout): 7449s > return await fut 7449s 7449s /usr/lib/python3/dist-packages/distributed/utils.py:1914: 7449s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 7449s /usr/lib/python3/dist-packages/distributed/utils_test.py:1007: in async_fn 7449s _cluster_factory() as (s, workers), 7449s /usr/lib/python3.13/contextlib.py:214: in __aenter__ 7449s return await anext(self.gen) 7449s /usr/lib/python3/dist-packages/distributed/utils_test.py:991: in _cluster_factory 7449s await asyncio.sleep(1) 7449s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 7449s 7449s delay = 1, result = None 7449s 7449s async def sleep(delay, result=None): 7449s """Coroutine that completes after a given time (in seconds).""" 7449s if delay <= 0: 7449s await __sleep0() 7449s return result 7449s 7449s if math.isnan(delay): 7449s raise ValueError("Invalid delay: NaN (not a number)") 7449s 7449s loop = events.get_running_loop() 7449s future = loop.create_future() 7449s h = loop.call_later(delay, 7449s futures._set_result_unless_cancelled, 7449s future, result) 7449s try: 7449s > return await future 7449s E asyncio.exceptions.CancelledError 7449s 7449s /usr/lib/python3.13/asyncio/tasks.py:718: CancelledError 7449s 7449s The above exception was the direct cause of the following exception: 7449s 7449s args = (), kwds = {} 7449s 7449s @wraps(func) 7449s def inner(*args, **kwds): 7449s with self._recreate_cm(): 7449s > return func(*args, **kwds) 7449s 7449s /usr/lib/python3.13/contextlib.py:85: 7449s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 7449s /usr/lib/python3.13/contextlib.py:85: in inner 7449s return func(*args, **kwds) 7449s /usr/lib/python3/dist-packages/distributed/utils_test.py:1090: in test_func 7449s return _run_and_close_tornado(async_fn_outer) 7449s /usr/lib/python3/dist-packages/distributed/utils_test.py:380: in _run_and_close_tornado 7449s return asyncio_run(inner_fn(), loop_factory=get_loop_factory()) 7449s /usr/lib/python3.13/asyncio/runners.py:195: in run 7449s return runner.run(main) 7449s /usr/lib/python3.13/asyncio/runners.py:118: in run 7449s return self._loop.run_until_complete(task) 7449s /usr/lib/python3.13/asyncio/base_events.py:725: in run_until_complete 7449s return future.result() 7449s /usr/lib/python3/dist-packages/distributed/utils_test.py:377: in inner_fn 7449s return await async_fn(*args, **kwargs) 7449s /usr/lib/python3/dist-packages/distributed/utils_test.py:1087: in async_fn_outer 7449s return await utils_wait_for(async_fn(), timeout=timeout * 2) 7449s /usr/lib/python3/dist-packages/distributed/utils.py:1913: in wait_for 7449s async with asyncio.timeout(timeout): 7449s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 7449s 7449s self = 7449s exc_type = 7449s exc_val = CancelledError(), exc_tb = 7449s 7449s async def __aexit__( 7449s self, 7449s exc_type: Optional[Type[BaseException]], 7449s exc_val: Optional[BaseException], 7449s exc_tb: Optional[TracebackType], 7449s ) -> Optional[bool]: 7449s assert self._state in (_State.ENTERED, _State.EXPIRING) 7449s 7449s if self._timeout_handler is not None: 7449s self._timeout_handler.cancel() 7449s self._timeout_handler = None 7449s 7449s if self._state is _State.EXPIRING: 7449s self._state = _State.EXPIRED 7449s 7449s if self._task.uncancel() <= self._cancelling and exc_type is not None: 7449s # Since there are no new cancel requests, we're 7449s # handling this. 7449s if issubclass(exc_type, exceptions.CancelledError): 7449s > raise TimeoutError from exc_val 7449s E TimeoutError 7449s 7449s /usr/lib/python3.13/asyncio/timeouts.py:116: TimeoutError 7449s ----------------------------- Captured stderr call ----------------------------- 7449s 2025-02-21 01:25:56,345 - distributed.scheduler - INFO - State start 7449s 2025-02-21 01:25:56,354 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:43793 7449s 2025-02-21 01:25:56,357 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:46247/status 7449s 2025-02-21 01:25:56,359 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7449s 2025-02-21 01:25:56,383 - distributed.nanny - INFO - Start Nanny at: 'tls://127.0.0.1:35833' 7449s 2025-02-21 01:25:56,385 - distributed.nanny - INFO - Start Nanny at: 'tls://127.0.0.1:38293' 7449s 2025-02-21 01:25:57,401 - distributed.worker.memory - WARNING - Ignoring provided memory limit 8326074368 due to system memory limit of 7.75 GiB 7449s 2025-02-21 01:25:57,433 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38533 7449s 2025-02-21 01:25:57,434 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38533 7449s 2025-02-21 01:25:57,434 - distributed.worker - INFO - Worker name: 1 7449s 2025-02-21 01:25:57,434 - distributed.worker - INFO - dashboard at: 127.0.0.1:42099 7449s 2025-02-21 01:25:57,434 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43793 7449s 2025-02-21 01:25:57,434 - distributed.worker - INFO - ------------------------------------------------- 7449s 2025-02-21 01:25:57,434 - distributed.worker - INFO - Threads: 2 7449s 2025-02-21 01:25:57,434 - distributed.worker - INFO - Memory: 7.75 GiB 7449s 2025-02-21 01:25:57,434 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-5d09vaur 7449s 2025-02-21 01:25:57,434 - distributed.worker - INFO - ------------------------------------------------- 7449s 2025-02-21 01:25:57,450 - distributed.worker.memory - WARNING - Ignoring provided memory limit 8326074368 due to system memory limit of 7.75 GiB 7449s 2025-02-21 01:25:57,478 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:38605 7449s 2025-02-21 01:25:57,478 - distributed.worker - INFO - Listening to: tls://127.0.0.1:38605 7449s 2025-02-21 01:25:57,478 - distributed.worker - INFO - Worker name: 0 7449s 2025-02-21 01:25:57,478 - distributed.worker - INFO - dashboard at: 127.0.0.1:46539 7449s 2025-02-21 01:25:57,478 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:43793 7449s 2025-02-21 01:25:57,478 - distributed.worker - INFO - ------------------------------------------------- 7449s 2025-02-21 01:25:57,478 - distributed.worker - INFO - Threads: 1 7449s 2025-02-21 01:25:57,478 - distributed.worker - INFO - Memory: 7.75 GiB 7449s 2025-02-21 01:25:57,478 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-k40kpy0c 7449s 2025-02-21 01:25:57,479 - distributed.worker - INFO - ------------------------------------------------- 7449s 2025-02-21 01:25:57,914 - distributed.scheduler - INFO - Register worker addr: tls://127.0.0.1:38605 name: 0 7449s 2025-02-21 01:25:57,946 - distributed.scheduler - INFO - Starting worker compute stream, tls://127.0.0.1:38605 7449s 2025-02-21 01:25:57,948 - distributed.core - INFO - Starting established connection to tls://127.0.0.1:46808 7449s 2025-02-21 01:25:57,950 - distributed.worker - INFO - Starting Worker plugin shuffle 7449s 2025-02-21 01:25:57,951 - distributed.worker - INFO - Registered to: tls://127.0.0.1:43793 7449s 2025-02-21 01:25:57,951 - distributed.worker - INFO - ------------------------------------------------- 7449s 2025-02-21 01:25:57,953 - distributed.core - INFO - Starting established connection to tls://127.0.0.1:43793 7449s 2025-02-21 01:25:57,949 - distributed.scheduler - INFO - Register worker addr: tls://127.0.0.1:38533 name: 1 7449s 2025-02-21 01:25:57,984 - distributed.worker - INFO - Starting Worker plugin shuffle 7449s 2025-02-21 01:25:57,985 - distributed.worker - INFO - Registered to: tls://127.0.0.1:43793 7449s 2025-02-21 01:25:57,985 - distributed.worker - INFO - ------------------------------------------------- 7449s 2025-02-21 01:25:57,983 - distributed.scheduler - INFO - Starting worker compute stream, tls://127.0.0.1:38533 7449s 2025-02-21 01:25:57,986 - distributed.core - INFO - Starting established connection to tls://127.0.0.1:43793 7449s 2025-02-21 01:25:57,985 - distributed.core - INFO - Starting established connection to tls://127.0.0.1:46796 7449s 2025-02-21 01:25:57,989 - distributed.core - INFO - Connection to tls://127.0.0.1:46808 has been closed. 7449s 2025-02-21 01:25:57,990 - distributed.core - INFO - Connection to tls://127.0.0.1:43793 has been closed. 7449s 2025-02-21 01:25:57,990 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38605. Reason: worker-handle-scheduler-connection-broken 7449s 2025-02-21 01:25:57,989 - distributed.scheduler - INFO - Remove worker addr: tls://127.0.0.1:38605 name: 0 (stimulus_id='handle-worker-cleanup-1740101157.9894605') 7449s 2025-02-21 01:25:58,003 - distributed.nanny - INFO - Closing Nanny gracefully at 'tls://127.0.0.1:35833'. Reason: worker-handle-scheduler-connection-broken 7449s 2025-02-21 01:25:58,004 - distributed.worker - INFO - Removing Worker plugin shuffle 7449s 2025-02-21 01:25:58,007 - distributed.nanny - INFO - Worker closed 7449s 2025-02-21 01:26:00,009 - distributed.nanny - ERROR - Worker process died unexpectedly 7449s 2025-02-21 01:26:00,311 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:35833'. Reason: nanny-close-gracefully 7449s 2025-02-21 01:26:00,311 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:35833' closed. 7449s 2025-02-21 01:26:27,991 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:38293'. Reason: nanny-close 7449s 2025-02-21 01:26:27,991 - distributed.nanny - INFO - Nanny asking worker to close. Reason: nanny-close 7449s 2025-02-21 01:26:27,992 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:38533. Reason: nanny-close 7449s 2025-02-21 01:26:27,992 - distributed.worker - INFO - Removing Worker plugin shuffle 7449s 2025-02-21 01:26:27,994 - distributed.core - INFO - Connection to tls://127.0.0.1:43793 has been closed. 7449s 2025-02-21 01:26:27,994 - distributed.core - INFO - Received 'close-stream' from tls://127.0.0.1:46796; closing. 7449s 2025-02-21 01:26:27,995 - distributed.nanny - INFO - Worker closed 7449s 2025-02-21 01:26:27,994 - distributed.scheduler - INFO - Remove worker addr: tls://127.0.0.1:38533 name: 1 (stimulus_id='handle-worker-cleanup-1740101187.9947648') 7449s 2025-02-21 01:26:27,997 - distributed.scheduler - INFO - Lost all workers 7449s 2025-02-21 01:26:28,264 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:38293' closed. 7449s 2025-02-21 01:26:28,265 - distributed.scheduler - INFO - Closing scheduler. Reason: unknown 7449s 2025-02-21 01:26:28,268 - distributed.scheduler - INFO - Scheduler closing all comms 7449s 2025-02-21 01:26:28,272 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Cluster creation timeout; retrying 7449s Traceback (most recent call last): 7449s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 974, in _cluster_factory 7449s s, ws = await start_cluster( 7449s ^^^^^^^^^^^^^^^^^^^^ 7449s ...<9 lines>... 7449s ) 7449s ^ 7449s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 806, in start_cluster 7449s raise TimeoutError("Cluster creation timeout") 7449s TimeoutError: Cluster creation timeout 7449s 2025-02-21 01:26:29,279 - distributed.scheduler - INFO - State start 7449s 2025-02-21 01:26:29,286 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:42247 7449s 2025-02-21 01:26:29,300 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:38021/status 7449s 2025-02-21 01:26:29,304 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7449s 2025-02-21 01:26:29,317 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:38999'. Reason: failure-to-start- 7449s 2025-02-21 01:26:29,318 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:38999' closed. 7449s 2025-02-21 01:26:29,318 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:43145'. Reason: failure-to-start- 7449s 2025-02-21 01:26:29,318 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:43145' closed. 7449s 2025-02-21 01:26:29,319 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42247': TLS handshake failed with remote 'tls://127.0.0.1:33344': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 7449s 2025-02-21 01:26:29,319 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42247': TLS handshake failed with remote 'tls://127.0.0.1:33348': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 7449s 2025-02-21 01:26:29,319 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 7449s Traceback (most recent call last): 7449s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 7449s return await fut 7449s ^^^^^^^^^ 7449s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 7449s comm = await self.rpc.connect(saddr) 7449s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7449s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1485, in connect 7449s return await self._connect(addr=addr, timeout=timeout) 7449s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7449s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1429, in _connect 7449s comm = await connect( 7449s ^^^^^^^^^^^^^^ 7449s ...<4 lines>... 7449s ) 7449s ^ 7449s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7449s comm = await wait_for( 7449s ^^^^^^^^^^^^^^^ 7449s ...<2 lines>... 7449s ) 7449s ^ 7449s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 7449s return await fut 7449s ^^^^^^^^^ 7449s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7449s stream = await self.client.connect( 7449s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7449s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7449s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7449s ) 7449s ^ 7449s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7449s af, addr, stream = await connector.start(connect_timeout=timeout) 7449s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7449s asyncio.exceptions.CancelledError 7449s 7449s The above exception was the direct cause of the following exception: 7449s 7449s Traceback (most recent call last): 7449s File "/usr/lib/python3/dist-packages/distributed/core.py", line 528, in start 7449s await wait_for(self.start_unsafe(), timeout=timeout) 7449s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1913, in wait_for 7449s async with asyncio.timeout(timeout): 7449s ~~~~~~~~~~~~~~~^^^^^^^^^ 7449s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7449s raise TimeoutError from exc_val 7449s TimeoutError 7449s 7449s The above exception was the direct cause of the following exception: 7449s 7449s Traceback (most recent call last): 7449s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 974, in _cluster_factory 7449s s, ws = await start_cluster( 7449s ^^^^^^^^^^^^^^^^^^^^ 7449s ...<9 lines>... 7449s ) 7449s ^ 7449s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 791, in start_cluster 7449s await asyncio.gather(*workers) 7449s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7449s return await awaitable 7449s ^^^^^^^^^^^^^^^ 7449s File "/usr/lib/python3/dist-packages/distributed/core.py", line 531, in start 7449s raise asyncio.TimeoutError( 7449s f"{type(self).__name__} start timed out after {timeout}s." 7449s ) from exc 7449s TimeoutError: Nanny start timed out after 0s. 7449s 2025-02-21 01:26:30,330 - distributed.scheduler - INFO - State start 7449s 2025-02-21 01:26:30,338 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:39403 7449s 2025-02-21 01:26:30,341 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:42073/status 7449s 2025-02-21 01:26:30,344 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7449s 2025-02-21 01:26:30,357 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:35107'. Reason: failure-to-start- 7449s 2025-02-21 01:26:30,358 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:35107' closed. 7449s 2025-02-21 01:26:30,358 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:43315'. Reason: failure-to-start- 7449s 2025-02-21 01:26:30,358 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:43315' closed. 7449s 2025-02-21 01:26:30,359 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39403': TLS handshake failed with remote 'tls://127.0.0.1:50720': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 7449s 2025-02-21 01:26:30,359 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39403': TLS handshake failed with remote 'tls://127.0.0.1:50734': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 7449s 2025-02-21 01:26:30,359 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 7449s Traceback (most recent call last): 7449s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 7449s return await fut 7449s ^^^^^^^^^ 7449s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 7449s comm = await self.rpc.connect(saddr) 7449s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7449s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1485, in connect 7449s return await self._connect(addr=addr, timeout=timeout) 7449s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7449s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1429, in _connect 7449s comm = await connect( 7449s ^^^^^^^^^^^^^^ 7449s ...<4 lines>... 7449s ) 7449s ^ 7449s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7449s comm = await wait_for( 7449s ^^^^^^^^^^^^^^^ 7449s ...<2 lines>... 7449s ) 7449s ^ 7449s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 7449s return await fut 7449s ^^^^^^^^^ 7449s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7449s stream = await self.client.connect( 7449s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7449s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7449s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7449s ) 7449s ^ 7449s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7449s af, addr, stream = await connector.start(connect_timeout=timeout) 7449s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7449s asyncio.exceptions.CancelledError 7449s 7449s The above exception was the direct cause of the following exception: 7449s 7449s Traceback (most recent call last): 7449s File "/usr/lib/python3/dist-packages/distributed/core.py", line 528, in start 7449s await wait_for(self.start_unsafe(), timeout=timeout) 7449s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1913, in wait_for 7449s async with asyncio.timeout(timeout): 7449s ~~~~~~~~~~~~~~~^^^^^^^^^ 7449s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7449s raise TimeoutError from exc_val 7449s TimeoutError 7449s 7449s The above exception was the direct cause of the following exception: 7449s 7449s Traceback (most recent call last): 7449s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 974, in _cluster_factory 7449s s, ws = await start_cluster( 7449s ^^^^^^^^^^^^^^^^^^^^ 7449s ...<9 lines>... 7449s ) 7449s ^ 7449s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 791, in start_cluster 7449s await asyncio.gather(*workers) 7449s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7449s return await awaitable 7449s ^^^^^^^^^^^^^^^ 7449s File "/usr/lib/python3/dist-packages/distributed/core.py", line 531, in start 7449s raise asyncio.TimeoutError( 7449s f"{type(self).__name__} start timed out after {timeout}s." 7449s ) from exc 7449s TimeoutError: Nanny start timed out after 0s. 7449s 2025-02-21 01:26:31,372 - distributed.scheduler - INFO - State start 7449s 2025-02-21 01:26:31,379 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:42671 7449s 2025-02-21 01:26:31,383 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:34407/status 7449s 2025-02-21 01:26:31,386 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7449s 2025-02-21 01:26:31,396 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:44531'. Reason: failure-to-start- 7449s 2025-02-21 01:26:31,396 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:44531' closed. 7449s 2025-02-21 01:26:31,396 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:40603'. Reason: failure-to-start- 7449s 2025-02-21 01:26:31,397 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:40603' closed. 7449s 2025-02-21 01:26:31,397 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42671': TLS handshake failed with remote 'tls://127.0.0.1:37174': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 7449s 2025-02-21 01:26:31,397 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42671': TLS handshake failed with remote 'tls://127.0.0.1:37178': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 7449s 2025-02-21 01:26:31,397 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 7449s Traceback (most recent call last): 7449s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 7449s return await fut 7449s ^^^^^^^^^ 7449s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 7449s comm = await self.rpc.connect(saddr) 7449s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7449s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1485, in connect 7449s return await self._connect(addr=addr, timeout=timeout) 7449s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7449s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1429, in _connect 7449s comm = await connect( 7449s ^^^^^^^^^^^^^^ 7449s ...<4 lines>... 7449s ) 7449s ^ 7449s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7449s comm = await wait_for( 7449s ^^^^^^^^^^^^^^^ 7449s ...<2 lines>... 7449s ) 7449s ^ 7449s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 7449s return await fut 7449s ^^^^^^^^^ 7449s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7449s stream = await self.client.connect( 7449s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7449s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7449s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7449s ) 7449s ^ 7449s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7449s af, addr, stream = await connector.start(connect_timeout=timeout) 7449s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7449s asyncio.exceptions.CancelledError 7449s 7449s The above exception was the direct cause of the following exception: 7449s 7449s Traceback (most recent call last): 7449s File "/usr/lib/python3/dist-packages/distributed/core.py", line 528, in start 7449s await wait_for(self.start_unsafe(), timeout=timeout) 7449s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1913, in wait_for 7449s async with asyncio.timeout(timeout): 7449s ~~~~~~~~~~~~~~~^^^^^^^^^ 7449s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7449s raise TimeoutError from exc_val 7449s TimeoutError 7449s 7449s The above exception was the direct cause of the following exception: 7449s 7449s Traceback (most recent call last): 7449s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 974, in _cluster_factory 7449s s, ws = await start_cluster( 7449s ^^^^^^^^^^^^^^^^^^^^ 7449s ...<9 lines>... 7449s ) 7449s ^ 7449s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 791, in start_cluster 7449s await asyncio.gather(*workers) 7449s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7449s return await awaitable 7449s ^^^^^^^^^^^^^^^ 7449s File "/usr/lib/python3/dist-packages/distributed/core.py", line 531, in start 7449s raise asyncio.TimeoutError( 7449s f"{type(self).__name__} start timed out after {timeout}s." 7449s ) from exc 7449s TimeoutError: Nanny start timed out after 0s. 7449s 2025-02-21 01:26:32,405 - distributed.scheduler - INFO - State start 7449s 2025-02-21 01:26:32,413 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:45727 7449s 2025-02-21 01:26:32,417 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:32879/status 7449s 2025-02-21 01:26:32,420 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7449s 2025-02-21 01:26:32,434 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:39799'. Reason: failure-to-start- 7449s 2025-02-21 01:26:32,435 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:39799' closed. 7449s 2025-02-21 01:26:32,435 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:35953'. Reason: failure-to-start- 7449s 2025-02-21 01:26:32,435 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:35953' closed. 7449s 2025-02-21 01:26:32,436 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45727': TLS handshake failed with remote 'tls://127.0.0.1:44768': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 7449s 2025-02-21 01:26:32,436 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45727': TLS handshake failed with remote 'tls://127.0.0.1:44780': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 7449s 2025-02-21 01:26:32,436 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 7449s Traceback (most recent call last): 7449s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 7449s return await fut 7449s ^^^^^^^^^ 7449s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 7449s comm = await self.rpc.connect(saddr) 7449s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7449s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1485, in connect 7449s return await self._connect(addr=addr, timeout=timeout) 7449s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7449s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1429, in _connect 7449s comm = await connect( 7449s ^^^^^^^^^^^^^^ 7449s ...<4 lines>... 7449s ) 7449s ^ 7449s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7449s comm = await wait_for( 7449s ^^^^^^^^^^^^^^^ 7449s ...<2 lines>... 7449s ) 7449s ^ 7449s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 7449s return await fut 7449s ^^^^^^^^^ 7449s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7449s stream = await self.client.connect( 7449s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7449s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7449s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7449s ) 7449s ^ 7449s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7449s af, addr, stream = await connector.start(connect_timeout=timeout) 7449s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7449s asyncio.exceptions.CancelledError 7449s 7449s The above exception was the direct cause of the following exception: 7449s 7449s Traceback (most recent call last): 7449s File "/usr/lib/python3/dist-packages/distributed/core.py", line 528, in start 7449s await wait_for(self.start_unsafe(), timeout=timeout) 7449s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1913, in wait_for 7449s async with asyncio.timeout(timeout): 7449s ~~~~~~~~~~~~~~~^^^^^^^^^ 7449s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7449s raise TimeoutError from exc_val 7449s TimeoutError 7449s 7449s The above exception was the direct cause of the following exception: 7449s 7449s Traceback (most recent call last): 7449s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 974, in _cluster_factory 7449s s, ws = await start_cluster( 7449s ^^^^^^^^^^^^^^^^^^^^ 7449s ...<9 lines>... 7449s ) 7449s ^ 7449s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 791, in start_cluster 7449s await asyncio.gather(*workers) 7449s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7449s return await awaitable 7449s ^^^^^^^^^^^^^^^ 7449s File "/usr/lib/python3/dist-packages/distributed/core.py", line 531, in start 7449s raise asyncio.TimeoutError( 7449s f"{type(self).__name__} start timed out after {timeout}s." 7449s ) from exc 7449s TimeoutError: Nanny start timed out after 0s. 7449s 2025-02-21 01:26:33,445 - distributed.scheduler - INFO - State start 7449s 2025-02-21 01:26:33,464 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:41503 7449s 2025-02-21 01:26:33,468 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:37299/status 7449s 2025-02-21 01:26:33,469 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7449s 2025-02-21 01:26:33,483 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:37323'. Reason: failure-to-start- 7449s 2025-02-21 01:26:33,483 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:37323' closed. 7449s 2025-02-21 01:26:33,483 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:46293'. Reason: failure-to-start- 7449s 2025-02-21 01:26:33,483 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:46293' closed. 7449s 2025-02-21 01:26:33,484 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41503': TLS handshake failed with remote 'tls://127.0.0.1:39022': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 7449s 2025-02-21 01:26:33,484 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41503': TLS handshake failed with remote 'tls://127.0.0.1:39032': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 7449s 2025-02-21 01:26:33,484 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 7449s Traceback (most recent call last): 7449s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 7449s return await fut 7449s ^^^^^^^^^ 7449s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 7449s comm = await self.rpc.connect(saddr) 7449s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7449s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1485, in connect 7449s return await self._connect(addr=addr, timeout=timeout) 7449s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7449s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1429, in _connect 7449s comm = await connect( 7449s ^^^^^^^^^^^^^^ 7449s ...<4 lines>... 7449s ) 7449s ^ 7449s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7449s comm = await wait_for( 7449s ^^^^^^^^^^^^^^^ 7449s ...<2 lines>... 7449s ) 7449s ^ 7449s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 7449s return await fut 7449s ^^^^^^^^^ 7449s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7449s stream = await self.client.connect( 7449s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7449s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7449s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7449s ) 7449s ^ 7449s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7449s af, addr, stream = await connector.start(connect_timeout=timeout) 7449s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7449s asyncio.exceptions.CancelledError 7449s 7449s The above exception was the direct cause of the following exception: 7449s 7449s Traceback (most recent call last): 7449s File "/usr/lib/python3/dist-packages/distributed/core.py", line 528, in start 7449s await wait_for(self.start_unsafe(), timeout=timeout) 7449s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1913, in wait_for 7449s async with asyncio.timeout(timeout): 7449s ~~~~~~~~~~~~~~~^^^^^^^^^ 7449s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7449s raise TimeoutError from exc_val 7449s TimeoutError 7449s 7449s The above exception was the direct cause of the following exception: 7449s 7449s Traceback (most recent call last): 7449s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 974, in _cluster_factory 7449s s, ws = await start_cluster( 7449s ^^^^^^^^^^^^^^^^^^^^ 7449s ...<9 lines>... 7449s ) 7449s ^ 7449s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 791, in start_cluster 7449s await asyncio.gather(*workers) 7449s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7449s return await awaitable 7449s ^^^^^^^^^^^^^^^ 7449s File "/usr/lib/python3/dist-packages/distributed/core.py", line 531, in start 7449s raise asyncio.TimeoutError( 7449s f"{type(self).__name__} start timed out after {timeout}s." 7449s ) from exc 7449s TimeoutError: Nanny start timed out after 0s. 7449s 2025-02-21 01:26:34,496 - distributed.scheduler - INFO - State start 7449s 2025-02-21 01:26:34,503 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:46381 7449s 2025-02-21 01:26:34,506 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:41749/status 7449s 2025-02-21 01:26:34,508 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7449s 2025-02-21 01:26:34,518 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:35117'. Reason: failure-to-start- 7449s 2025-02-21 01:26:34,519 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:35117' closed. 7449s 2025-02-21 01:26:34,519 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:35403'. Reason: failure-to-start- 7449s 2025-02-21 01:26:34,519 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:35403' closed. 7449s 2025-02-21 01:26:34,519 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46381': TLS handshake failed with remote 'tls://127.0.0.1:35238': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 7449s 2025-02-21 01:26:34,519 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46381': TLS handshake failed with remote 'tls://127.0.0.1:35244': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 7449s 2025-02-21 01:26:34,520 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 7449s Traceback (most recent call last): 7449s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 7449s return await fut 7449s ^^^^^^^^^ 7449s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 7449s comm = await self.rpc.connect(saddr) 7449s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7449s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1485, in connect 7449s return await self._connect(addr=addr, timeout=timeout) 7449s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7449s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1429, in _connect 7449s comm = await connect( 7449s ^^^^^^^^^^^^^^ 7449s ...<4 lines>... 7449s ) 7449s ^ 7449s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7449s comm = await wait_for( 7449s ^^^^^^^^^^^^^^^ 7449s ...<2 lines>... 7449s ) 7449s ^ 7449s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 7449s return await fut 7449s ^^^^^^^^^ 7449s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7449s stream = await self.client.connect( 7449s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7449s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7449s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7449s ) 7449s ^ 7449s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7449s af, addr, stream = await connector.start(connect_timeout=timeout) 7449s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7449s asyncio.exceptions.CancelledError 7449s 7449s The above exception was the direct cause of the following exception: 7449s 7449s Traceback (most recent call last): 7449s File "/usr/lib/python3/dist-packages/distributed/core.py", line 528, in start 7449s await wait_for(self.start_unsafe(), timeout=timeout) 7449s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1913, in wait_for 7449s async with asyncio.timeout(timeout): 7449s ~~~~~~~~~~~~~~~^^^^^^^^^ 7449s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7449s raise TimeoutError from exc_val 7449s TimeoutError 7449s 7449s The above exception was the direct cause of the following exception: 7449s 7449s Traceback (most recent call last): 7449s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 974, in _cluster_factory 7449s s, ws = await start_cluster( 7449s ^^^^^^^^^^^^^^^^^^^^ 7449s ...<9 lines>... 7449s ) 7449s ^ 7449s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 791, in start_cluster 7449s await asyncio.gather(*workers) 7449s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7449s return await awaitable 7449s ^^^^^^^^^^^^^^^ 7449s File "/usr/lib/python3/dist-packages/distributed/core.py", line 531, in start 7449s raise asyncio.TimeoutError( 7449s f"{type(self).__name__} start timed out after {timeout}s." 7449s ) from exc 7449s TimeoutError: Nanny start timed out after 0s. 7449s 2025-02-21 01:26:35,527 - distributed.scheduler - INFO - State start 7449s 2025-02-21 01:26:35,538 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:36957 7449s 2025-02-21 01:26:35,540 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:41811/status 7449s 2025-02-21 01:26:35,542 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7449s 2025-02-21 01:26:35,551 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:43101'. Reason: failure-to-start- 7449s 2025-02-21 01:26:35,551 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:43101' closed. 7449s 2025-02-21 01:26:35,552 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:33003'. Reason: failure-to-start- 7449s 2025-02-21 01:26:35,552 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:33003' closed. 7449s 2025-02-21 01:26:35,552 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36957': TLS handshake failed with remote 'tls://127.0.0.1:32816': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 7449s 2025-02-21 01:26:35,552 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36957': TLS handshake failed with remote 'tls://127.0.0.1:32826': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 7449s 2025-02-21 01:26:35,552 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 7449s Traceback (most recent call last): 7449s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 7449s return await fut 7449s ^^^^^^^^^ 7449s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 7449s comm = await self.rpc.connect(saddr) 7449s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7449s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1485, in connect 7449s return await self._connect(addr=addr, timeout=timeout) 7449s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7449s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1429, in _connect 7449s comm = await connect( 7449s ^^^^^^^^^^^^^^ 7449s ...<4 lines>... 7449s ) 7449s ^ 7449s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7449s comm = await wait_for( 7449s ^^^^^^^^^^^^^^^ 7449s ...<2 lines>... 7449s ) 7449s ^ 7449s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 7449s return await fut 7449s ^^^^^^^^^ 7449s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7449s stream = await self.client.connect( 7449s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7449s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7449s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7449s ) 7449s ^ 7449s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7449s af, addr, stream = await connector.start(connect_timeout=timeout) 7449s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7449s asyncio.exceptions.CancelledError 7449s 7449s The above exception was the direct cause of the following exception: 7449s 7449s Traceback (most recent call last): 7449s File "/usr/lib/python3/dist-packages/distributed/core.py", line 528, in start 7449s await wait_for(self.start_unsafe(), timeout=timeout) 7449s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1913, in wait_for 7449s async with asyncio.timeout(timeout): 7449s ~~~~~~~~~~~~~~~^^^^^^^^^ 7449s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7449s raise TimeoutError from exc_val 7449s TimeoutError 7449s 7449s The above exception was the direct cause of the following exception: 7449s 7449s Traceback (most recent call last): 7449s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 974, in _cluster_factory 7449s s, ws = await start_cluster( 7449s ^^^^^^^^^^^^^^^^^^^^ 7449s ...<9 lines>... 7449s ) 7449s ^ 7449s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 791, in start_cluster 7449s await asyncio.gather(*workers) 7449s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7449s return await awaitable 7449s ^^^^^^^^^^^^^^^ 7449s File "/usr/lib/python3/dist-packages/distributed/core.py", line 531, in start 7449s raise asyncio.TimeoutError( 7449s f"{type(self).__name__} start timed out after {timeout}s." 7449s ) from exc 7449s TimeoutError: Nanny start timed out after 0s. 7449s 2025-02-21 01:26:36,558 - distributed.scheduler - INFO - State start 7449s 2025-02-21 01:26:36,563 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:35489 7449s 2025-02-21 01:26:36,566 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:39707/status 7449s 2025-02-21 01:26:36,568 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7449s 2025-02-21 01:26:36,577 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:36625'. Reason: failure-to-start- 7449s 2025-02-21 01:26:36,577 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:36625' closed. 7449s 2025-02-21 01:26:36,577 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:42427'. Reason: failure-to-start- 7449s 2025-02-21 01:26:36,577 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:42427' closed. 7449s 2025-02-21 01:26:36,578 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35489': TLS handshake failed with remote 'tls://127.0.0.1:40230': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 7449s 2025-02-21 01:26:36,578 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35489': TLS handshake failed with remote 'tls://127.0.0.1:40234': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 7449s 2025-02-21 01:26:36,578 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 7449s Traceback (most recent call last): 7449s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 7449s return await fut 7449s ^^^^^^^^^ 7449s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 7449s comm = await self.rpc.connect(saddr) 7449s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7449s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1485, in connect 7449s return await self._connect(addr=addr, timeout=timeout) 7449s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7449s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1429, in _connect 7449s comm = await connect( 7449s ^^^^^^^^^^^^^^ 7449s ...<4 lines>... 7449s ) 7449s ^ 7449s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7449s comm = await wait_for( 7449s ^^^^^^^^^^^^^^^ 7449s ...<2 lines>... 7449s ) 7449s ^ 7449s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 7449s return await fut 7449s ^^^^^^^^^ 7449s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7449s stream = await self.client.connect( 7449s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7449s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7449s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7449s ) 7449s ^ 7449s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7449s af, addr, stream = await connector.start(connect_timeout=timeout) 7449s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7449s asyncio.exceptions.CancelledError 7449s 7449s The above exception was the direct cause of the following exception: 7449s 7449s Traceback (most recent call last): 7449s File "/usr/lib/python3/dist-packages/distributed/core.py", line 528, in start 7449s await wait_for(self.start_unsafe(), timeout=timeout) 7449s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1913, in wait_for 7449s async with asyncio.timeout(timeout): 7449s ~~~~~~~~~~~~~~~^^^^^^^^^ 7449s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7449s raise TimeoutError from exc_val 7449s TimeoutError 7449s 7449s The above exception was the direct cause of the following exception: 7449s 7449s Traceback (most recent call last): 7449s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 974, in _cluster_factory 7449s s, ws = await start_cluster( 7449s ^^^^^^^^^^^^^^^^^^^^ 7449s ...<9 lines>... 7449s ) 7449s ^ 7449s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 791, in start_cluster 7449s await asyncio.gather(*workers) 7449s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7449s return await awaitable 7449s ^^^^^^^^^^^^^^^ 7449s File "/usr/lib/python3/dist-packages/distributed/core.py", line 531, in start 7449s raise asyncio.TimeoutError( 7449s f"{type(self).__name__} start timed out after {timeout}s." 7449s ) from exc 7449s TimeoutError: Nanny start timed out after 0s. 7449s 2025-02-21 01:26:37,584 - distributed.scheduler - INFO - State start 7449s 2025-02-21 01:26:37,593 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37889 7449s 2025-02-21 01:26:37,596 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:46823/status 7449s 2025-02-21 01:26:37,600 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7449s 2025-02-21 01:26:37,625 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:37369'. Reason: failure-to-start- 7449s 2025-02-21 01:26:37,626 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:37369' closed. 7449s 2025-02-21 01:26:37,626 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:41403'. Reason: failure-to-start- 7449s 2025-02-21 01:26:37,626 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:41403' closed. 7449s 2025-02-21 01:26:37,627 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37889': TLS handshake failed with remote 'tls://127.0.0.1:53956': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 7449s 2025-02-21 01:26:37,627 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37889': TLS handshake failed with remote 'tls://127.0.0.1:53968': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 7449s 2025-02-21 01:26:37,627 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 7449s Traceback (most recent call last): 7449s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 7449s return await fut 7449s ^^^^^^^^^ 7449s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 7449s comm = await self.rpc.connect(saddr) 7449s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7449s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1485, in connect 7449s return await self._connect(addr=addr, timeout=timeout) 7449s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7449s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1429, in _connect 7449s comm = await connect( 7449s ^^^^^^^^^^^^^^ 7449s ...<4 lines>... 7449s ) 7449s ^ 7449s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7449s comm = await wait_for( 7449s ^^^^^^^^^^^^^^^ 7449s ...<2 lines>... 7449s ) 7449s ^ 7449s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 7449s return await fut 7449s ^^^^^^^^^ 7449s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7449s stream = await self.client.connect( 7449s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7449s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7449s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7449s ) 7449s ^ 7449s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7449s af, addr, stream = await connector.start(connect_timeout=timeout) 7449s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7449s asyncio.exceptions.CancelledError 7449s 7449s The above exception was the direct cause of the following exception: 7449s 7449s Traceback (most recent call last): 7449s File "/usr/lib/python3/dist-packages/distributed/core.py", line 528, in start 7449s await wait_for(self.start_unsafe(), timeout=timeout) 7449s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1913, in wait_for 7449s async with asyncio.timeout(timeout): 7449s ~~~~~~~~~~~~~~~^^^^^^^^^ 7449s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7449s raise TimeoutError from exc_val 7449s TimeoutError 7449s 7449s The above exception was the direct cause of the following exception: 7449s 7449s Traceback (most recent call last): 7449s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 974, in _cluster_factory 7449s s, ws = await start_cluster( 7449s ^^^^^^^^^^^^^^^^^^^^ 7449s ...<9 lines>... 7449s ) 7449s ^ 7449s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 791, in start_cluster 7449s await asyncio.gather(*workers) 7449s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7449s return await awaitable 7449s ^^^^^^^^^^^^^^^ 7449s File "/usr/lib/python3/dist-packages/distributed/core.py", line 531, in start 7449s raise asyncio.TimeoutError( 7449s f"{type(self).__name__} start timed out after {timeout}s." 7449s ) from exc 7449s TimeoutError: Nanny start timed out after 0s. 7449s 2025-02-21 01:26:38,634 - distributed.scheduler - INFO - State start 7449s 2025-02-21 01:26:38,641 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:40183 7449s 2025-02-21 01:26:38,645 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:35887/status 7449s 2025-02-21 01:26:38,648 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7449s 2025-02-21 01:26:38,661 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:37403'. Reason: failure-to-start- 7449s 2025-02-21 01:26:38,662 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:37403' closed. 7449s 2025-02-21 01:26:38,662 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:37213'. Reason: failure-to-start- 7449s 2025-02-21 01:26:38,662 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:37213' closed. 7449s 2025-02-21 01:26:38,663 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40183': TLS handshake failed with remote 'tls://127.0.0.1:53022': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 7449s 2025-02-21 01:26:38,663 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40183': TLS handshake failed with remote 'tls://127.0.0.1:53024': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 7449s 2025-02-21 01:26:38,663 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 7449s Traceback (most recent call last): 7449s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 7449s return await fut 7449s ^^^^^^^^^ 7449s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 7449s comm = await self.rpc.connect(saddr) 7449s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7449s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1485, in connect 7449s return await self._connect(addr=addr, timeout=timeout) 7449s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7449s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1429, in _connect 7449s comm = await connect( 7449s ^^^^^^^^^^^^^^ 7449s ...<4 lines>... 7449s ) 7449s ^ 7449s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7449s comm = await wait_for( 7449s ^^^^^^^^^^^^^^^ 7449s ...<2 lines>... 7449s ) 7449s ^ 7449s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 7449s return await fut 7449s ^^^^^^^^^ 7449s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7449s stream = await self.client.connect( 7449s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7449s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7449s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7449s ) 7449s ^ 7449s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7449s af, addr, stream = await connector.start(connect_timeout=timeout) 7449s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7449s asyncio.exceptions.CancelledError 7449s 7449s The above exception was the direct cause of the following exception: 7449s 7449s Traceback (most recent call last): 7449s File "/usr/lib/python3/dist-packages/distributed/core.py", line 528, in start 7449s await wait_for(self.start_unsafe(), timeout=timeout) 7449s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1913, in wait_for 7449s async with asyncio.timeout(timeout): 7449s ~~~~~~~~~~~~~~~^^^^^^^^^ 7449s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7449s raise TimeoutError from exc_val 7449s TimeoutError 7449s 7449s The above exception was the direct cause of the following exception: 7449s 7449s Traceback (most recent call last): 7449s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 974, in _cluster_factory 7449s s, ws = await start_cluster( 7449s ^^^^^^^^^^^^^^^^^^^^ 7449s ...<9 lines>... 7449s ) 7449s ^ 7449s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 791, in start_cluster 7449s await asyncio.gather(*workers) 7449s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7449s return await awaitable 7449s ^^^^^^^^^^^^^^^ 7449s File "/usr/lib/python3/dist-packages/distributed/core.py", line 531, in start 7449s raise asyncio.TimeoutError( 7449s f"{type(self).__name__} start timed out after {timeout}s." 7449s ) from exc 7449s TimeoutError: Nanny start timed out after 0s. 7449s 2025-02-21 01:26:39,670 - distributed.scheduler - INFO - State start 7449s 2025-02-21 01:26:39,679 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:46089 7449s 2025-02-21 01:26:39,681 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:33309/status 7449s 2025-02-21 01:26:39,683 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7449s 2025-02-21 01:26:39,697 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:34875'. Reason: failure-to-start- 7449s 2025-02-21 01:26:39,697 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:34875' closed. 7449s 2025-02-21 01:26:39,697 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:34869'. Reason: failure-to-start- 7449s 2025-02-21 01:26:39,698 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:34869' closed. 7449s 2025-02-21 01:26:39,698 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46089': TLS handshake failed with remote 'tls://127.0.0.1:47674': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 7449s 2025-02-21 01:26:39,698 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46089': TLS handshake failed with remote 'tls://127.0.0.1:47676': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 7449s 2025-02-21 01:26:39,698 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 7449s Traceback (most recent call last): 7449s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 7449s return await fut 7449s ^^^^^^^^^ 7449s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 7449s comm = await self.rpc.connect(saddr) 7449s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7449s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1485, in connect 7449s return await self._connect(addr=addr, timeout=timeout) 7449s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7449s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1429, in _connect 7449s comm = await connect( 7449s ^^^^^^^^^^^^^^ 7449s ...<4 lines>... 7449s ) 7449s ^ 7449s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7449s comm = await wait_for( 7449s ^^^^^^^^^^^^^^^ 7449s ...<2 lines>... 7449s ) 7449s ^ 7449s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 7449s return await fut 7449s ^^^^^^^^^ 7449s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7449s stream = await self.client.connect( 7449s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7449s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7449s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7449s ) 7449s ^ 7449s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7449s af, addr, stream = await connector.start(connect_timeout=timeout) 7449s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7449s asyncio.exceptions.CancelledError 7449s 7449s The above exception was the direct cause of the following exception: 7449s 7449s Traceback (most recent call last): 7449s File "/usr/lib/python3/dist-packages/distributed/core.py", line 528, in start 7449s await wait_for(self.start_unsafe(), timeout=timeout) 7449s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1913, in wait_for 7449s async with asyncio.timeout(timeout): 7449s ~~~~~~~~~~~~~~~^^^^^^^^^ 7449s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7449s raise TimeoutError from exc_val 7449s TimeoutError 7449s 7449s The above exception was the direct cause of the following exception: 7449s 7449s Traceback (most recent call last): 7449s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 974, in _cluster_factory 7449s s, ws = await start_cluster( 7449s ^^^^^^^^^^^^^^^^^^^^ 7449s ...<9 lines>... 7449s ) 7449s ^ 7449s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 791, in start_cluster 7449s await asyncio.gather(*workers) 7449s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7449s return await awaitable 7449s ^^^^^^^^^^^^^^^ 7449s File "/usr/lib/python3/dist-packages/distributed/core.py", line 531, in start 7449s raise asyncio.TimeoutError( 7449s f"{type(self).__name__} start timed out after {timeout}s." 7449s ) from exc 7449s TimeoutError: Nanny start timed out after 0s. 7449s 2025-02-21 01:26:40,705 - distributed.scheduler - INFO - State start 7449s 2025-02-21 01:26:40,714 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37845 7449s 2025-02-21 01:26:40,720 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:43395/status 7449s 2025-02-21 01:26:40,722 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7449s 2025-02-21 01:26:40,734 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:46683'. Reason: failure-to-start- 7449s 2025-02-21 01:26:40,734 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:46683' closed. 7449s 2025-02-21 01:26:40,734 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:43683'. Reason: failure-to-start- 7449s 2025-02-21 01:26:40,735 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:43683' closed. 7449s 2025-02-21 01:26:40,735 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37845': TLS handshake failed with remote 'tls://127.0.0.1:57968': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 7449s 2025-02-21 01:26:40,735 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37845': TLS handshake failed with remote 'tls://127.0.0.1:57980': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 7449s 2025-02-21 01:26:40,736 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 7449s Traceback (most recent call last): 7449s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 7449s return await fut 7449s ^^^^^^^^^ 7449s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 7449s comm = await self.rpc.connect(saddr) 7449s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7449s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1485, in connect 7449s return await self._connect(addr=addr, timeout=timeout) 7449s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7449s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1429, in _connect 7449s comm = await connect( 7449s ^^^^^^^^^^^^^^ 7449s ...<4 lines>... 7449s ) 7449s ^ 7449s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7449s comm = await wait_for( 7449s ^^^^^^^^^^^^^^^ 7449s ...<2 lines>... 7449s ) 7449s ^ 7449s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 7449s return await fut 7449s ^^^^^^^^^ 7449s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7449s stream = await self.client.connect( 7449s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7449s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7449s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7449s ) 7449s ^ 7449s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7449s af, addr, stream = await connector.start(connect_timeout=timeout) 7449s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7449s asyncio.exceptions.CancelledError 7449s 7449s The above exception was the direct cause of the following exception: 7449s 7449s Traceback (most recent call last): 7449s File "/usr/lib/python3/dist-packages/distributed/core.py", line 528, in start 7449s await wait_for(self.start_unsafe(), timeout=timeout) 7449s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1913, in wait_for 7449s async with asyncio.timeout(timeout): 7449s ~~~~~~~~~~~~~~~^^^^^^^^^ 7449s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7449s raise TimeoutError from exc_val 7449s TimeoutError 7449s 7449s The above exception was the direct cause of the following exception: 7449s 7449s Traceback (most recent call last): 7449s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 974, in _cluster_factory 7449s s, ws = await start_cluster( 7449s ^^^^^^^^^^^^^^^^^^^^ 7449s ...<9 lines>... 7449s ) 7449s ^ 7449s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 791, in start_cluster 7449s await asyncio.gather(*workers) 7449s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7449s return await awaitable 7449s ^^^^^^^^^^^^^^^ 7449s File "/usr/lib/python3/dist-packages/distributed/core.py", line 531, in start 7449s raise asyncio.TimeoutError( 7449s f"{type(self).__name__} start timed out after {timeout}s." 7449s ) from exc 7449s TimeoutError: Nanny start timed out after 0s. 7449s 2025-02-21 01:26:41,743 - distributed.scheduler - INFO - State start 7449s 2025-02-21 01:26:41,749 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:39021 7449s 2025-02-21 01:26:41,752 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:39441/status 7449s 2025-02-21 01:26:41,755 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7449s 2025-02-21 01:26:41,771 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:41193'. Reason: failure-to-start- 7449s 2025-02-21 01:26:41,772 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:41193' closed. 7449s 2025-02-21 01:26:41,772 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:46125'. Reason: failure-to-start- 7449s 2025-02-21 01:26:41,772 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:46125' closed. 7449s 2025-02-21 01:26:41,773 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39021': TLS handshake failed with remote 'tls://127.0.0.1:34836': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 7449s 2025-02-21 01:26:41,773 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39021': TLS handshake failed with remote 'tls://127.0.0.1:34840': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 7449s 2025-02-21 01:26:41,773 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 7449s Traceback (most recent call last): 7449s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 7449s return await fut 7449s ^^^^^^^^^ 7449s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 7449s comm = await self.rpc.connect(saddr) 7449s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7449s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1485, in connect 7449s return await self._connect(addr=addr, timeout=timeout) 7449s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7449s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1429, in _connect 7449s comm = await connect( 7449s ^^^^^^^^^^^^^^ 7449s ...<4 lines>... 7449s ) 7449s ^ 7449s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7449s comm = await wait_for( 7449s ^^^^^^^^^^^^^^^ 7449s ...<2 lines>... 7449s ) 7449s ^ 7449s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 7449s return await fut 7449s ^^^^^^^^^ 7449s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7449s stream = await self.client.connect( 7449s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7449s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7449s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7449s ) 7449s ^ 7449s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7449s af, addr, stream = await connector.start(connect_timeout=timeout) 7449s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7449s asyncio.exceptions.CancelledError 7449s 7449s The above exception was the direct cause of the following exception: 7449s 7449s Traceback (most recent call last): 7449s File "/usr/lib/python3/dist-packages/distributed/core.py", line 528, in start 7449s await wait_for(self.start_unsafe(), timeout=timeout) 7449s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1913, in wait_for 7449s async with asyncio.timeout(timeout): 7449s ~~~~~~~~~~~~~~~^^^^^^^^^ 7449s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7449s raise TimeoutError from exc_val 7449s TimeoutError 7449s 7449s The above exception was the direct cause of the following exception: 7449s 7449s Traceback (most recent call last): 7449s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 974, in _cluster_factory 7449s s, ws = await start_cluster( 7449s ^^^^^^^^^^^^^^^^^^^^ 7449s ...<9 lines>... 7449s ) 7449s ^ 7449s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 791, in start_cluster 7449s await asyncio.gather(*workers) 7449s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7449s return await awaitable 7449s ^^^^^^^^^^^^^^^ 7449s File "/usr/lib/python3/dist-packages/distributed/core.py", line 531, in start 7449s raise asyncio.TimeoutError( 7449s f"{type(self).__name__} start timed out after {timeout}s." 7449s ) from exc 7449s TimeoutError: Nanny start timed out after 0s. 7449s 2025-02-21 01:26:42,778 - distributed.scheduler - INFO - State start 7449s 2025-02-21 01:26:42,785 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:36169 7449s 2025-02-21 01:26:42,787 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:39923/status 7449s 2025-02-21 01:26:42,789 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7449s 2025-02-21 01:26:42,798 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:41685'. Reason: failure-to-start- 7449s 2025-02-21 01:26:42,798 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:41685' closed. 7449s 2025-02-21 01:26:42,798 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:41713'. Reason: failure-to-start- 7449s 2025-02-21 01:26:42,799 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:41713' closed. 7449s 2025-02-21 01:26:42,799 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36169': TLS handshake failed with remote 'tls://127.0.0.1:41470': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 7449s 2025-02-21 01:26:42,799 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36169': TLS handshake failed with remote 'tls://127.0.0.1:41480': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 7449s 2025-02-21 01:26:42,799 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 7449s Traceback (most recent call last): 7449s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 7449s return await fut 7449s ^^^^^^^^^ 7449s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 7449s comm = await self.rpc.connect(saddr) 7449s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7449s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1485, in connect 7449s return await self._connect(addr=addr, timeout=timeout) 7449s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7449s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1429, in _connect 7449s comm = await connect( 7449s ^^^^^^^^^^^^^^ 7449s ...<4 lines>... 7449s ) 7449s ^ 7449s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7449s comm = await wait_for( 7449s ^^^^^^^^^^^^^^^ 7449s ...<2 lines>... 7449s ) 7449s ^ 7449s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 7449s return await fut 7449s ^^^^^^^^^ 7449s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7449s stream = await self.client.connect( 7449s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7449s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7449s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7449s ) 7449s ^ 7449s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7449s af, addr, stream = await connector.start(connect_timeout=timeout) 7449s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7449s asyncio.exceptions.CancelledError 7449s 7449s The above exception was the direct cause of the following exception: 7449s 7449s Traceback (most recent call last): 7449s File "/usr/lib/python3/dist-packages/distributed/core.py", line 528, in start 7449s await wait_for(self.start_unsafe(), timeout=timeout) 7449s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1913, in wait_for 7449s async with asyncio.timeout(timeout): 7449s ~~~~~~~~~~~~~~~^^^^^^^^^ 7449s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7449s raise TimeoutError from exc_val 7449s TimeoutError 7449s 7449s The above exception was the direct cause of the following exception: 7449s 7449s Traceback (most recent call last): 7449s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 974, in _cluster_factory 7449s s, ws = await start_cluster( 7449s ^^^^^^^^^^^^^^^^^^^^ 7449s ...<9 lines>... 7449s ) 7449s ^ 7449s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 791, in start_cluster 7449s await asyncio.gather(*workers) 7449s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7449s return await awaitable 7449s ^^^^^^^^^^^^^^^ 7449s File "/usr/lib/python3/dist-packages/distributed/core.py", line 531, in start 7449s raise asyncio.TimeoutError( 7449s f"{type(self).__name__} start timed out after {timeout}s." 7449s ) from exc 7449s TimeoutError: Nanny start timed out after 0s. 7449s 2025-02-21 01:26:43,806 - distributed.scheduler - INFO - State start 7449s 2025-02-21 01:26:43,812 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:45973 7449s 2025-02-21 01:26:43,815 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:38459/status 7449s 2025-02-21 01:26:43,818 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7449s 2025-02-21 01:26:43,834 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:45853'. Reason: failure-to-start- 7449s 2025-02-21 01:26:43,834 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:45853' closed. 7449s 2025-02-21 01:26:43,834 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:34587'. Reason: failure-to-start- 7449s 2025-02-21 01:26:43,834 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:34587' closed. 7449s 2025-02-21 01:26:43,835 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45973': TLS handshake failed with remote 'tls://127.0.0.1:50326': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 7449s 2025-02-21 01:26:43,835 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45973': TLS handshake failed with remote 'tls://127.0.0.1:50336': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 7449s 2025-02-21 01:26:43,835 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 7449s Traceback (most recent call last): 7449s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 7449s return await fut 7449s ^^^^^^^^^ 7449s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 7449s comm = await self.rpc.connect(saddr) 7449s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7449s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1485, in connect 7449s return await self._connect(addr=addr, timeout=timeout) 7449s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7449s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1429, in _connect 7449s comm = await connect( 7449s ^^^^^^^^^^^^^^ 7449s ...<4 lines>... 7449s ) 7449s ^ 7449s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7449s comm = await wait_for( 7449s ^^^^^^^^^^^^^^^ 7449s ...<2 lines>... 7449s ) 7449s ^ 7449s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 7449s return await fut 7449s ^^^^^^^^^ 7449s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7449s stream = await self.client.connect( 7449s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7449s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7449s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7449s ) 7449s ^ 7449s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7449s af, addr, stream = await connector.start(connect_timeout=timeout) 7449s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7449s asyncio.exceptions.CancelledError 7449s 7449s The above exception was the direct cause of the following exception: 7449s 7449s Traceback (most recent call last): 7449s File "/usr/lib/python3/dist-packages/distributed/core.py", line 528, in start 7449s await wait_for(self.start_unsafe(), timeout=timeout) 7449s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1913, in wait_for 7449s async with asyncio.timeout(timeout): 7449s ~~~~~~~~~~~~~~~^^^^^^^^^ 7449s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7449s raise TimeoutError from exc_val 7449s TimeoutError 7449s 7449s The above exception was the direct cause of the following exception: 7449s 7449s Traceback (most recent call last): 7449s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 974, in _cluster_factory 7449s s, ws = await start_cluster( 7449s ^^^^^^^^^^^^^^^^^^^^ 7449s ...<9 lines>... 7449s ) 7449s ^ 7449s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 791, in start_cluster 7449s await asyncio.gather(*workers) 7449s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7449s return await awaitable 7449s ^^^^^^^^^^^^^^^ 7449s File "/usr/lib/python3/dist-packages/distributed/core.py", line 531, in start 7449s raise asyncio.TimeoutError( 7449s f"{type(self).__name__} start timed out after {timeout}s." 7449s ) from exc 7449s TimeoutError: Nanny start timed out after 0s. 7449s 2025-02-21 01:26:44,841 - distributed.scheduler - INFO - State start 7449s 2025-02-21 01:26:44,848 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:40689 7449s 2025-02-21 01:26:44,851 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:33085/status 7449s 2025-02-21 01:26:44,853 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7449s 2025-02-21 01:26:44,865 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:34283'. Reason: failure-to-start- 7449s 2025-02-21 01:26:44,865 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:34283' closed. 7449s 2025-02-21 01:26:44,865 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:35557'. Reason: failure-to-start- 7449s 2025-02-21 01:26:44,865 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:35557' closed. 7449s 2025-02-21 01:26:44,866 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40689': TLS handshake failed with remote 'tls://127.0.0.1:59320': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 7449s 2025-02-21 01:26:44,866 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40689': TLS handshake failed with remote 'tls://127.0.0.1:59328': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 7449s 2025-02-21 01:26:44,866 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 7449s Traceback (most recent call last): 7449s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 7449s return await fut 7449s ^^^^^^^^^ 7449s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 7449s comm = await self.rpc.connect(saddr) 7449s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7449s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1485, in connect 7449s return await self._connect(addr=addr, timeout=timeout) 7449s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7449s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1429, in _connect 7449s comm = await connect( 7449s ^^^^^^^^^^^^^^ 7449s ...<4 lines>... 7449s ) 7449s ^ 7449s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7449s comm = await wait_for( 7449s ^^^^^^^^^^^^^^^ 7449s ...<2 lines>... 7449s ) 7449s ^ 7449s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 7449s return await fut 7449s ^^^^^^^^^ 7449s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7449s stream = await self.client.connect( 7449s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7449s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7449s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7449s ) 7449s ^ 7449s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7449s af, addr, stream = await connector.start(connect_timeout=timeout) 7449s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7449s asyncio.exceptions.CancelledError 7449s 7449s The above exception was the direct cause of the following exception: 7449s 7449s Traceback (most recent call last): 7449s File "/usr/lib/python3/dist-packages/distributed/core.py", line 528, in start 7449s await wait_for(self.start_unsafe(), timeout=timeout) 7449s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1913, in wait_for 7449s async with asyncio.timeout(timeout): 7449s ~~~~~~~~~~~~~~~^^^^^^^^^ 7449s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7449s raise TimeoutError from exc_val 7449s TimeoutError 7449s 7449s The above exception was the direct cause of the following exception: 7449s 7449s Traceback (most recent call last): 7449s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 974, in _cluster_factory 7449s s, ws = await start_cluster( 7449s ^^^^^^^^^^^^^^^^^^^^ 7449s ...<9 lines>... 7449s ) 7449s ^ 7449s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 791, in start_cluster 7449s await asyncio.gather(*workers) 7449s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7449s return await awaitable 7449s ^^^^^^^^^^^^^^^ 7449s File "/usr/lib/python3/dist-packages/distributed/core.py", line 531, in start 7449s raise asyncio.TimeoutError( 7449s f"{type(self).__name__} start timed out after {timeout}s." 7449s ) from exc 7449s TimeoutError: Nanny start timed out after 0s. 7449s 2025-02-21 01:26:45,871 - distributed.scheduler - INFO - State start 7449s 2025-02-21 01:26:45,877 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:45871 7449s 2025-02-21 01:26:45,879 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:33061/status 7449s 2025-02-21 01:26:45,880 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7449s 2025-02-21 01:26:45,891 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:36845'. Reason: failure-to-start- 7449s 2025-02-21 01:26:45,891 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:36845' closed. 7449s 2025-02-21 01:26:45,891 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:36363'. Reason: failure-to-start- 7449s 2025-02-21 01:26:45,891 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:36363' closed. 7449s 2025-02-21 01:26:45,892 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45871': TLS handshake failed with remote 'tls://127.0.0.1:57924': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 7449s 2025-02-21 01:26:45,892 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45871': TLS handshake failed with remote 'tls://127.0.0.1:57940': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 7449s 2025-02-21 01:26:45,892 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 7449s Traceback (most recent call last): 7449s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 7449s return await fut 7449s ^^^^^^^^^ 7449s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 7449s comm = await self.rpc.connect(saddr) 7449s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7449s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1485, in connect 7449s return await self._connect(addr=addr, timeout=timeout) 7449s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7449s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1429, in _connect 7449s comm = await connect( 7449s ^^^^^^^^^^^^^^ 7449s ...<4 lines>... 7449s ) 7449s ^ 7449s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7449s comm = await wait_for( 7449s ^^^^^^^^^^^^^^^ 7449s ...<2 lines>... 7449s ) 7449s ^ 7449s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 7449s return await fut 7449s ^^^^^^^^^ 7449s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7449s stream = await self.client.connect( 7449s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7449s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7449s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7449s ) 7449s ^ 7449s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7449s af, addr, stream = await connector.start(connect_timeout=timeout) 7449s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7449s asyncio.exceptions.CancelledError 7449s 7449s The above exception was the direct cause of the following exception: 7449s 7449s Traceback (most recent call last): 7449s File "/usr/lib/python3/dist-packages/distributed/core.py", line 528, in start 7449s await wait_for(self.start_unsafe(), timeout=timeout) 7449s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1913, in wait_for 7449s async with asyncio.timeout(timeout): 7449s ~~~~~~~~~~~~~~~^^^^^^^^^ 7449s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7449s raise TimeoutError from exc_val 7449s TimeoutError 7449s 7449s The above exception was the direct cause of the following exception: 7449s 7449s Traceback (most recent call last): 7449s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 974, in _cluster_factory 7449s s, ws = await start_cluster( 7449s ^^^^^^^^^^^^^^^^^^^^ 7449s ...<9 lines>... 7449s ) 7449s ^ 7449s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 791, in start_cluster 7449s await asyncio.gather(*workers) 7449s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7449s return await awaitable 7449s ^^^^^^^^^^^^^^^ 7449s File "/usr/lib/python3/dist-packages/distributed/core.py", line 531, in start 7449s raise asyncio.TimeoutError( 7449s f"{type(self).__name__} start timed out after {timeout}s." 7449s ) from exc 7449s TimeoutError: Nanny start timed out after 0s. 7449s 2025-02-21 01:26:46,898 - distributed.scheduler - INFO - State start 7449s 2025-02-21 01:26:46,905 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:34879 7449s 2025-02-21 01:26:46,908 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:43303/status 7449s 2025-02-21 01:26:46,911 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7449s 2025-02-21 01:26:46,922 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:42015'. Reason: failure-to-start- 7449s 2025-02-21 01:26:46,922 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:42015' closed. 7449s 2025-02-21 01:26:46,922 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:37241'. Reason: failure-to-start- 7449s 2025-02-21 01:26:46,922 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:37241' closed. 7449s 2025-02-21 01:26:46,923 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34879': TLS handshake failed with remote 'tls://127.0.0.1:54860': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 7449s 2025-02-21 01:26:46,923 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34879': TLS handshake failed with remote 'tls://127.0.0.1:54872': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 7449s 2025-02-21 01:26:46,923 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 7449s Traceback (most recent call last): 7449s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 7449s return await fut 7449s ^^^^^^^^^ 7449s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 7449s comm = await self.rpc.connect(saddr) 7449s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7449s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1485, in connect 7449s return await self._connect(addr=addr, timeout=timeout) 7449s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7449s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1429, in _connect 7449s comm = await connect( 7449s ^^^^^^^^^^^^^^ 7449s ...<4 lines>... 7449s ) 7449s ^ 7449s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7449s comm = await wait_for( 7449s ^^^^^^^^^^^^^^^ 7449s ...<2 lines>... 7449s ) 7449s ^ 7449s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 7449s return await fut 7449s ^^^^^^^^^ 7449s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7449s stream = await self.client.connect( 7449s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7449s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7449s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7449s ) 7449s ^ 7449s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7449s af, addr, stream = await connector.start(connect_timeout=timeout) 7449s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7449s asyncio.exceptions.CancelledError 7449s 7449s The above exception was the direct cause of the following exception: 7449s 7449s Traceback (most recent call last): 7449s File "/usr/lib/python3/dist-packages/distributed/core.py", line 528, in start 7449s await wait_for(self.start_unsafe(), timeout=timeout) 7449s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1913, in wait_for 7449s async with asyncio.timeout(timeout): 7449s ~~~~~~~~~~~~~~~^^^^^^^^^ 7449s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7449s raise TimeoutError from exc_val 7449s TimeoutError 7449s 7449s The above exception was the direct cause of the following exception: 7449s 7449s Traceback (most recent call last): 7449s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 974, in _cluster_factory 7449s s, ws = await start_cluster( 7449s ^^^^^^^^^^^^^^^^^^^^ 7449s ...<9 lines>... 7449s ) 7449s ^ 7449s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 791, in start_cluster 7449s await asyncio.gather(*workers) 7449s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7449s return await awaitable 7449s ^^^^^^^^^^^^^^^ 7449s File "/usr/lib/python3/dist-packages/distributed/core.py", line 531, in start 7449s raise asyncio.TimeoutError( 7449s f"{type(self).__name__} start timed out after {timeout}s." 7449s ) from exc 7449s TimeoutError: Nanny start timed out after 0s. 7449s 2025-02-21 01:26:47,928 - distributed.scheduler - INFO - State start 7449s 2025-02-21 01:26:47,935 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:41803 7449s 2025-02-21 01:26:47,938 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:46275/status 7449s 2025-02-21 01:26:47,940 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7449s 2025-02-21 01:26:47,954 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:40089'. Reason: failure-to-start- 7449s 2025-02-21 01:26:47,954 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:40089' closed. 7449s 2025-02-21 01:26:47,955 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:43573'. Reason: failure-to-start- 7449s 2025-02-21 01:26:47,955 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:43573' closed. 7449s 2025-02-21 01:26:47,955 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41803': TLS handshake failed with remote 'tls://127.0.0.1:35834': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 7449s 2025-02-21 01:26:47,955 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41803': TLS handshake failed with remote 'tls://127.0.0.1:35848': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 7449s 2025-02-21 01:26:47,955 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 7449s Traceback (most recent call last): 7449s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 7449s return await fut 7449s ^^^^^^^^^ 7449s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 7449s comm = await self.rpc.connect(saddr) 7449s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7449s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1485, in connect 7449s return await self._connect(addr=addr, timeout=timeout) 7449s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7449s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1429, in _connect 7449s comm = await connect( 7449s ^^^^^^^^^^^^^^ 7449s ...<4 lines>... 7449s ) 7449s ^ 7449s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7449s comm = await wait_for( 7449s ^^^^^^^^^^^^^^^ 7449s ...<2 lines>... 7449s ) 7449s ^ 7449s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 7449s return await fut 7449s ^^^^^^^^^ 7449s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7449s stream = await self.client.connect( 7449s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7449s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7449s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7449s ) 7449s ^ 7449s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7449s af, addr, stream = await connector.start(connect_timeout=timeout) 7449s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7449s asyncio.exceptions.CancelledError 7449s 7449s The above exception was the direct cause of the following exception: 7449s 7449s Traceback (most recent call last): 7449s File "/usr/lib/python3/dist-packages/distributed/core.py", line 528, in start 7449s await wait_for(self.start_unsafe(), timeout=timeout) 7449s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1913, in wait_for 7449s async with asyncio.timeout(timeout): 7449s ~~~~~~~~~~~~~~~^^^^^^^^^ 7449s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7449s raise TimeoutError from exc_val 7449s TimeoutError 7449s 7449s The above exception was the direct cause of the following exception: 7449s 7449s Traceback (most recent call last): 7449s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 974, in _cluster_factory 7449s s, ws = await start_cluster( 7449s ^^^^^^^^^^^^^^^^^^^^ 7449s ...<9 lines>... 7449s ) 7449s ^ 7449s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 791, in start_cluster 7449s await asyncio.gather(*workers) 7449s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7449s return await awaitable 7449s ^^^^^^^^^^^^^^^ 7449s File "/usr/lib/python3/dist-packages/distributed/core.py", line 531, in start 7449s raise asyncio.TimeoutError( 7449s f"{type(self).__name__} start timed out after {timeout}s." 7449s ) from exc 7449s TimeoutError: Nanny start timed out after 0s. 7449s 2025-02-21 01:26:48,960 - distributed.scheduler - INFO - State start 7449s 2025-02-21 01:26:48,966 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:46165 7449s 2025-02-21 01:26:48,969 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:40581/status 7449s 2025-02-21 01:26:48,972 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7449s 2025-02-21 01:26:48,984 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:35833'. Reason: failure-to-start- 7449s 2025-02-21 01:26:48,984 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:35833' closed. 7449s 2025-02-21 01:26:48,985 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:44425'. Reason: failure-to-start- 7449s 2025-02-21 01:26:48,985 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:44425' closed. 7449s 2025-02-21 01:26:48,986 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46165': TLS handshake failed with remote 'tls://127.0.0.1:41624': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 7449s 2025-02-21 01:26:48,986 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46165': TLS handshake failed with remote 'tls://127.0.0.1:41634': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 7449s 2025-02-21 01:26:48,986 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 7449s Traceback (most recent call last): 7449s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 7449s return await fut 7449s ^^^^^^^^^ 7449s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 7449s comm = await self.rpc.connect(saddr) 7449s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7449s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1485, in connect 7449s return await self._connect(addr=addr, timeout=timeout) 7449s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7449s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1429, in _connect 7449s comm = await connect( 7449s ^^^^^^^^^^^^^^ 7449s ...<4 lines>... 7449s ) 7449s ^ 7449s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7449s comm = await wait_for( 7449s ^^^^^^^^^^^^^^^ 7449s ...<2 lines>... 7449s ) 7449s ^ 7449s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 7449s return await fut 7449s ^^^^^^^^^ 7449s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7449s stream = await self.client.connect( 7449s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7449s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7449s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7449s ) 7449s ^ 7449s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7449s af, addr, stream = await connector.start(connect_timeout=timeout) 7449s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7449s asyncio.exceptions.CancelledError 7449s 7449s The above exception was the direct cause of the following exception: 7449s 7449s Traceback (most recent call last): 7449s File "/usr/lib/python3/dist-packages/distributed/core.py", line 528, in start 7449s await wait_for(self.start_unsafe(), timeout=timeout) 7449s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1913, in wait_for 7449s async with asyncio.timeout(timeout): 7449s ~~~~~~~~~~~~~~~^^^^^^^^^ 7449s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7449s raise TimeoutError from exc_val 7449s TimeoutError 7449s 7449s The above exception was the direct cause of the following exception: 7449s 7449s Traceback (most recent call last): 7449s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 974, in _cluster_factory 7449s s, ws = await start_cluster( 7449s ^^^^^^^^^^^^^^^^^^^^ 7449s ...<9 lines>... 7449s ) 7449s ^ 7449s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 791, in start_cluster 7449s await asyncio.gather(*workers) 7449s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7449s return await awaitable 7449s ^^^^^^^^^^^^^^^ 7449s File "/usr/lib/python3/dist-packages/distributed/core.py", line 531, in start 7449s raise asyncio.TimeoutError( 7449s f"{type(self).__name__} start timed out after {timeout}s." 7449s ) from exc 7449s TimeoutError: Nanny start timed out after 0s. 7449s 2025-02-21 01:26:49,991 - distributed.scheduler - INFO - State start 7449s 2025-02-21 01:26:49,996 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:43113 7449s 2025-02-21 01:26:49,998 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:44331/status 7449s 2025-02-21 01:26:50,000 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7449s 2025-02-21 01:26:50,013 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:40159'. Reason: failure-to-start- 7449s 2025-02-21 01:26:50,013 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:40159' closed. 7449s 2025-02-21 01:26:50,013 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:46839'. Reason: failure-to-start- 7449s 2025-02-21 01:26:50,014 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:46839' closed. 7449s 2025-02-21 01:26:50,015 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43113': TLS handshake failed with remote 'tls://127.0.0.1:35298': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 7449s 2025-02-21 01:26:50,015 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43113': TLS handshake failed with remote 'tls://127.0.0.1:35300': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 7449s 2025-02-21 01:26:50,016 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 7449s Traceback (most recent call last): 7449s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 7449s return await fut 7449s ^^^^^^^^^ 7449s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 7449s comm = await self.rpc.connect(saddr) 7449s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7449s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1485, in connect 7449s return await self._connect(addr=addr, timeout=timeout) 7449s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7449s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1429, in _connect 7449s comm = await connect( 7449s ^^^^^^^^^^^^^^ 7449s ...<4 lines>... 7449s ) 7449s ^ 7449s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7449s comm = await wait_for( 7449s ^^^^^^^^^^^^^^^ 7449s ...<2 lines>... 7449s ) 7449s ^ 7449s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 7449s return await fut 7449s ^^^^^^^^^ 7449s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7449s stream = await self.client.connect( 7449s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7449s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7449s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7449s ) 7449s ^ 7449s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7449s af, addr, stream = await connector.start(connect_timeout=timeout) 7449s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7449s asyncio.exceptions.CancelledError 7449s 7449s The above exception was the direct cause of the following exception: 7449s 7449s Traceback (most recent call last): 7449s File "/usr/lib/python3/dist-packages/distributed/core.py", line 528, in start 7449s await wait_for(self.start_unsafe(), timeout=timeout) 7449s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1913, in wait_for 7449s async with asyncio.timeout(timeout): 7449s ~~~~~~~~~~~~~~~^^^^^^^^^ 7449s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7449s raise TimeoutError from exc_val 7449s TimeoutError 7449s 7449s The above exception was the direct cause of the following exception: 7449s 7449s Traceback (most recent call last): 7449s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 974, in _cluster_factory 7449s s, ws = await start_cluster( 7449s ^^^^^^^^^^^^^^^^^^^^ 7449s ...<9 lines>... 7449s ) 7449s ^ 7449s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 791, in start_cluster 7449s await asyncio.gather(*workers) 7449s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7449s return await awaitable 7449s ^^^^^^^^^^^^^^^ 7449s File "/usr/lib/python3/dist-packages/distributed/core.py", line 531, in start 7449s raise asyncio.TimeoutError( 7449s f"{type(self).__name__} start timed out after {timeout}s." 7449s ) from exc 7449s TimeoutError: Nanny start timed out after 0s. 7449s 2025-02-21 01:26:51,023 - distributed.scheduler - INFO - State start 7449s 2025-02-21 01:26:51,030 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37265 7449s 2025-02-21 01:26:51,033 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:39925/status 7449s 2025-02-21 01:26:51,037 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7449s 2025-02-21 01:26:51,051 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:43207'. Reason: failure-to-start- 7449s 2025-02-21 01:26:51,051 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:43207' closed. 7449s 2025-02-21 01:26:51,051 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:45675'. Reason: failure-to-start- 7449s 2025-02-21 01:26:51,052 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:45675' closed. 7449s 2025-02-21 01:26:51,052 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37265': TLS handshake failed with remote 'tls://127.0.0.1:40114': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 7449s 2025-02-21 01:26:51,052 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37265': TLS handshake failed with remote 'tls://127.0.0.1:40118': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 7449s 2025-02-21 01:26:51,053 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 7449s Traceback (most recent call last): 7449s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 7449s return await fut 7449s ^^^^^^^^^ 7449s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 7449s comm = await self.rpc.connect(saddr) 7449s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7449s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1485, in connect 7449s return await self._connect(addr=addr, timeout=timeout) 7449s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7449s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1429, in _connect 7449s comm = await connect( 7449s ^^^^^^^^^^^^^^ 7449s ...<4 lines>... 7449s ) 7449s ^ 7449s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7449s comm = await wait_for( 7449s ^^^^^^^^^^^^^^^ 7449s ...<2 lines>... 7449s ) 7449s ^ 7449s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 7449s return await fut 7449s ^^^^^^^^^ 7449s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7449s stream = await self.client.connect( 7449s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7449s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7449s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7449s ) 7449s ^ 7449s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7449s af, addr, stream = await connector.start(connect_timeout=timeout) 7449s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7449s asyncio.exceptions.CancelledError 7449s 7449s The above exception was the direct cause of the following exception: 7449s 7449s Traceback (most recent call last): 7449s File "/usr/lib/python3/dist-packages/distributed/core.py", line 528, in start 7449s await wait_for(self.start_unsafe(), timeout=timeout) 7449s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1913, in wait_for 7449s async with asyncio.timeout(timeout): 7449s ~~~~~~~~~~~~~~~^^^^^^^^^ 7449s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7449s raise TimeoutError from exc_val 7449s TimeoutError 7449s 7449s The above exception was the direct cause of the following exception: 7449s 7449s Traceback (most recent call last): 7449s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 974, in _cluster_factory 7449s s, ws = await start_cluster( 7449s ^^^^^^^^^^^^^^^^^^^^ 7449s ...<9 lines>... 7449s ) 7449s ^ 7449s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 791, in start_cluster 7449s await asyncio.gather(*workers) 7449s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7449s return await awaitable 7449s ^^^^^^^^^^^^^^^ 7449s File "/usr/lib/python3/dist-packages/distributed/core.py", line 531, in start 7449s raise asyncio.TimeoutError( 7449s f"{type(self).__name__} start timed out after {timeout}s." 7449s ) from exc 7449s TimeoutError: Nanny start timed out after 0s. 7449s 2025-02-21 01:26:52,058 - distributed.scheduler - INFO - State start 7449s 2025-02-21 01:26:52,064 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:46217 7449s 2025-02-21 01:26:52,067 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:34655/status 7449s 2025-02-21 01:26:52,068 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7449s 2025-02-21 01:26:52,092 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:36089'. Reason: failure-to-start- 7449s 2025-02-21 01:26:52,093 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:36089' closed. 7449s 2025-02-21 01:26:52,093 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:36621'. Reason: failure-to-start- 7449s 2025-02-21 01:26:52,093 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:36621' closed. 7449s 2025-02-21 01:26:52,094 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46217': TLS handshake failed with remote 'tls://127.0.0.1:37180': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 7449s 2025-02-21 01:26:52,094 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46217': TLS handshake failed with remote 'tls://127.0.0.1:37190': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 7449s 2025-02-21 01:26:52,094 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 7449s Traceback (most recent call last): 7449s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 7449s return await fut 7449s ^^^^^^^^^ 7449s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 7449s comm = await self.rpc.connect(saddr) 7449s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7449s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1485, in connect 7449s return await self._connect(addr=addr, timeout=timeout) 7449s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7449s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1429, in _connect 7449s comm = await connect( 7449s ^^^^^^^^^^^^^^ 7449s ...<4 lines>... 7449s ) 7449s ^ 7449s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7449s comm = await wait_for( 7449s ^^^^^^^^^^^^^^^ 7449s ...<2 lines>... 7449s ) 7449s ^ 7449s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 7449s return await fut 7449s ^^^^^^^^^ 7449s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7449s stream = await self.client.connect( 7449s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7449s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7449s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7449s ) 7449s ^ 7449s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7449s af, addr, stream = await connector.start(connect_timeout=timeout) 7449s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7449s asyncio.exceptions.CancelledError 7449s 7449s The above exception was the direct cause of the following exception: 7449s 7449s Traceback (most recent call last): 7449s File "/usr/lib/python3/dist-packages/distributed/core.py", line 528, in start 7449s await wait_for(self.start_unsafe(), timeout=timeout) 7449s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1913, in wait_for 7449s async with asyncio.timeout(timeout): 7449s ~~~~~~~~~~~~~~~^^^^^^^^^ 7449s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7449s raise TimeoutError from exc_val 7449s TimeoutError 7449s 7449s The above exception was the direct cause of the following exception: 7449s 7449s Traceback (most recent call last): 7449s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 974, in _cluster_factory 7449s s, ws = await start_cluster( 7449s ^^^^^^^^^^^^^^^^^^^^ 7449s ...<9 lines>... 7449s ) 7449s ^ 7449s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 791, in start_cluster 7449s await asyncio.gather(*workers) 7449s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7449s return await awaitable 7449s ^^^^^^^^^^^^^^^ 7449s File "/usr/lib/python3/dist-packages/distributed/core.py", line 531, in start 7449s raise asyncio.TimeoutError( 7449s f"{type(self).__name__} start timed out after {timeout}s." 7449s ) from exc 7449s TimeoutError: Nanny start timed out after 0s. 7449s 2025-02-21 01:26:53,100 - distributed.scheduler - INFO - State start 7449s 2025-02-21 01:26:53,108 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:40879 7449s 2025-02-21 01:26:53,111 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:32769/status 7449s 2025-02-21 01:26:53,113 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7449s 2025-02-21 01:26:53,127 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:43831'. Reason: failure-to-start- 7449s 2025-02-21 01:26:53,127 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:43831' closed. 7449s 2025-02-21 01:26:53,127 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:34115'. Reason: failure-to-start- 7449s 2025-02-21 01:26:53,128 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:34115' closed. 7449s 2025-02-21 01:26:53,128 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40879': TLS handshake failed with remote 'tls://127.0.0.1:53608': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 7449s 2025-02-21 01:26:53,129 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40879': TLS handshake failed with remote 'tls://127.0.0.1:53618': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 7449s 2025-02-21 01:26:53,129 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 7449s Traceback (most recent call last): 7449s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 7449s return await fut 7449s ^^^^^^^^^ 7449s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 7449s comm = await self.rpc.connect(saddr) 7449s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7449s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1485, in connect 7449s return await self._connect(addr=addr, timeout=timeout) 7449s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7449s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1429, in _connect 7449s comm = await connect( 7449s ^^^^^^^^^^^^^^ 7449s ...<4 lines>... 7449s ) 7449s ^ 7449s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7449s comm = await wait_for( 7449s ^^^^^^^^^^^^^^^ 7449s ...<2 lines>... 7449s ) 7449s ^ 7449s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 7449s return await fut 7449s ^^^^^^^^^ 7449s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7449s stream = await self.client.connect( 7449s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7449s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7449s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7449s ) 7449s ^ 7449s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7449s af, addr, stream = await connector.start(connect_timeout=timeout) 7449s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7449s asyncio.exceptions.CancelledError 7449s 7449s The above exception was the direct cause of the following exception: 7449s 7449s Traceback (most recent call last): 7449s File "/usr/lib/python3/dist-packages/distributed/core.py", line 528, in start 7449s await wait_for(self.start_unsafe(), timeout=timeout) 7449s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1913, in wait_for 7449s async with asyncio.timeout(timeout): 7449s ~~~~~~~~~~~~~~~^^^^^^^^^ 7449s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7449s raise TimeoutError from exc_val 7449s TimeoutError 7449s 7449s The above exception was the direct cause of the following exception: 7449s 7449s Traceback (most recent call last): 7449s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 974, in _cluster_factory 7449s s, ws = await start_cluster( 7449s ^^^^^^^^^^^^^^^^^^^^ 7449s ...<9 lines>... 7449s ) 7449s ^ 7449s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 791, in start_cluster 7449s await asyncio.gather(*workers) 7449s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7449s return await awaitable 7449s ^^^^^^^^^^^^^^^ 7449s File "/usr/lib/python3/dist-packages/distributed/core.py", line 531, in start 7449s raise asyncio.TimeoutError( 7449s f"{type(self).__name__} start timed out after {timeout}s." 7449s ) from exc 7449s TimeoutError: Nanny start timed out after 0s. 7449s 2025-02-21 01:26:54,135 - distributed.scheduler - INFO - State start 7449s 2025-02-21 01:26:54,141 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:35581 7449s 2025-02-21 01:26:54,144 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:41081/status 7449s 2025-02-21 01:26:54,146 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7449s 2025-02-21 01:26:54,163 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:43313'. Reason: failure-to-start- 7449s 2025-02-21 01:26:54,163 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:43313' closed. 7449s 2025-02-21 01:26:54,164 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:40469'. Reason: failure-to-start- 7449s 2025-02-21 01:26:54,164 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:40469' closed. 7449s 2025-02-21 01:26:54,165 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35581': TLS handshake failed with remote 'tls://127.0.0.1:56882': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 7449s 2025-02-21 01:26:54,165 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35581': TLS handshake failed with remote 'tls://127.0.0.1:56884': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 7449s 2025-02-21 01:26:54,165 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 7449s Traceback (most recent call last): 7449s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 7449s return await fut 7449s ^^^^^^^^^ 7449s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 7449s comm = await self.rpc.connect(saddr) 7449s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7449s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1485, in connect 7449s return await self._connect(addr=addr, timeout=timeout) 7449s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7449s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1429, in _connect 7449s comm = await connect( 7449s ^^^^^^^^^^^^^^ 7449s ...<4 lines>... 7449s ) 7449s ^ 7449s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7449s comm = await wait_for( 7449s ^^^^^^^^^^^^^^^ 7449s ...<2 lines>... 7449s ) 7449s ^ 7449s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 7449s return await fut 7449s ^^^^^^^^^ 7449s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7449s stream = await self.client.connect( 7449s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7449s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7449s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7449s ) 7449s ^ 7449s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7449s af, addr, stream = await connector.start(connect_timeout=timeout) 7449s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7449s asyncio.exceptions.CancelledError 7449s 7449s The above exception was the direct cause of the following exception: 7449s 7449s Traceback (most recent call last): 7449s File "/usr/lib/python3/dist-packages/distributed/core.py", line 528, in start 7449s await wait_for(self.start_unsafe(), timeout=timeout) 7449s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1913, in wait_for 7449s async with asyncio.timeout(timeout): 7449s ~~~~~~~~~~~~~~~^^^^^^^^^ 7449s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7449s raise TimeoutError from exc_val 7449s TimeoutError 7449s 7449s The above exception was the direct cause of the following exception: 7449s 7449s Traceback (most recent call last): 7449s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 974, in _cluster_factory 7449s s, ws = await start_cluster( 7449s ^^^^^^^^^^^^^^^^^^^^ 7449s ...<9 lines>... 7449s ) 7449s ^ 7449s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 791, in start_cluster 7449s await asyncio.gather(*workers) 7449s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7449s return await awaitable 7449s ^^^^^^^^^^^^^^^ 7449s File "/usr/lib/python3/dist-packages/distributed/core.py", line 531, in start 7449s raise asyncio.TimeoutError( 7449s f"{type(self).__name__} start timed out after {timeout}s." 7449s ) from exc 7449s TimeoutError: Nanny start timed out after 0s. 7449s 2025-02-21 01:26:55,171 - distributed.scheduler - INFO - State start 7449s 2025-02-21 01:26:55,180 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:45599 7449s 2025-02-21 01:26:55,183 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:33315/status 7449s 2025-02-21 01:26:55,185 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7449s 2025-02-21 01:26:55,195 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:38115'. Reason: failure-to-start- 7449s 2025-02-21 01:26:55,195 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:38115' closed. 7449s 2025-02-21 01:26:55,195 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:38053'. Reason: failure-to-start- 7449s 2025-02-21 01:26:55,196 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:38053' closed. 7449s 2025-02-21 01:26:55,196 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45599': TLS handshake failed with remote 'tls://127.0.0.1:53894': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 7449s 2025-02-21 01:26:55,196 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45599': TLS handshake failed with remote 'tls://127.0.0.1:53904': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 7449s 2025-02-21 01:26:55,196 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 7449s Traceback (most recent call last): 7449s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 7449s return await fut 7449s ^^^^^^^^^ 7449s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 7449s comm = await self.rpc.connect(saddr) 7449s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7449s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1485, in connect 7449s return await self._connect(addr=addr, timeout=timeout) 7449s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7449s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1429, in _connect 7449s comm = await connect( 7449s ^^^^^^^^^^^^^^ 7449s ...<4 lines>... 7449s ) 7449s ^ 7449s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7449s comm = await wait_for( 7449s ^^^^^^^^^^^^^^^ 7449s ...<2 lines>... 7449s ) 7449s ^ 7449s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 7449s return await fut 7449s ^^^^^^^^^ 7449s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7449s stream = await self.client.connect( 7449s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7449s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7449s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7449s ) 7449s ^ 7449s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7449s af, addr, stream = await connector.start(connect_timeout=timeout) 7449s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7449s asyncio.exceptions.CancelledError 7449s 7449s The above exception was the direct cause of the following exception: 7449s 7449s Traceback (most recent call last): 7449s File "/usr/lib/python3/dist-packages/distributed/core.py", line 528, in start 7449s await wait_for(self.start_unsafe(), timeout=timeout) 7449s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1913, in wait_for 7449s async with asyncio.timeout(timeout): 7449s ~~~~~~~~~~~~~~~^^^^^^^^^ 7449s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7449s raise TimeoutError from exc_val 7449s TimeoutError 7449s 7449s The above exception was the direct cause of the following exception: 7449s 7449s Traceback (most recent call last): 7449s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 974, in _cluster_factory 7449s s, ws = await start_cluster( 7449s ^^^^^^^^^^^^^^^^^^^^ 7449s ...<9 lines>... 7449s ) 7449s ^ 7449s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 791, in start_cluster 7449s await asyncio.gather(*workers) 7449s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7449s return await awaitable 7449s ^^^^^^^^^^^^^^^ 7449s File "/usr/lib/python3/dist-packages/distributed/core.py", line 531, in start 7449s raise asyncio.TimeoutError( 7449s f"{type(self).__name__} start timed out after {timeout}s." 7449s ) from exc 7449s TimeoutError: Nanny start timed out after 0s. 7449s 2025-02-21 01:26:56,203 - distributed.scheduler - INFO - State start 7449s 2025-02-21 01:26:56,213 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:40895 7449s 2025-02-21 01:26:56,215 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:46041/status 7449s 2025-02-21 01:26:56,218 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7449s 2025-02-21 01:26:56,232 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:35097'. Reason: failure-to-start- 7449s 2025-02-21 01:26:56,233 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:35097' closed. 7449s 2025-02-21 01:26:56,233 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:40429'. Reason: failure-to-start- 7449s 2025-02-21 01:26:56,233 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:40429' closed. 7449s 2025-02-21 01:26:56,234 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40895': TLS handshake failed with remote 'tls://127.0.0.1:43930': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 7449s 2025-02-21 01:26:56,234 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40895': TLS handshake failed with remote 'tls://127.0.0.1:43940': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 7449s 2025-02-21 01:26:56,234 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 7449s Traceback (most recent call last): 7449s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 7449s return await fut 7449s ^^^^^^^^^ 7449s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 7449s comm = await self.rpc.connect(saddr) 7449s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7449s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1485, in connect 7449s return await self._connect(addr=addr, timeout=timeout) 7449s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7449s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1429, in _connect 7449s comm = await connect( 7449s ^^^^^^^^^^^^^^ 7449s ...<4 lines>... 7449s ) 7449s ^ 7449s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7449s comm = await wait_for( 7449s ^^^^^^^^^^^^^^^ 7449s ...<2 lines>... 7449s ) 7449s ^ 7449s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 7449s return await fut 7449s ^^^^^^^^^ 7449s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7449s stream = await self.client.connect( 7449s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7449s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7449s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7449s ) 7449s ^ 7449s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7449s af, addr, stream = await connector.start(connect_timeout=timeout) 7449s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7449s asyncio.exceptions.CancelledError 7449s 7449s The above exception was the direct cause of the following exception: 7449s 7449s Traceback (most recent call last): 7449s File "/usr/lib/python3/dist-packages/distributed/core.py", line 528, in start 7449s await wait_for(self.start_unsafe(), timeout=timeout) 7449s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1913, in wait_for 7449s async with asyncio.timeout(timeout): 7449s ~~~~~~~~~~~~~~~^^^^^^^^^ 7449s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7449s raise TimeoutError from exc_val 7449s TimeoutError 7449s 7449s The above exception was the direct cause of the following exception: 7449s 7449s Traceback (most recent call last): 7449s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 974, in _cluster_factory 7449s s, ws = await start_cluster( 7449s ^^^^^^^^^^^^^^^^^^^^ 7449s ...<9 lines>... 7449s ) 7449s ^ 7449s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 791, in start_cluster 7449s await asyncio.gather(*workers) 7449s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7449s return await awaitable 7449s ^^^^^^^^^^^^^^^ 7449s File "/usr/lib/python3/dist-packages/distributed/core.py", line 531, in start 7449s raise asyncio.TimeoutError( 7449s f"{type(self).__name__} start timed out after {timeout}s." 7449s ) from exc 7449s TimeoutError: Nanny start timed out after 0s. 7449s ============================= slowest 20 durations ============================= 7449s 60.00s call tests/test_tls_functional.py::test_retire_workers 7449s 13.83s call tests/test_gc.py::test_gc_diagnosis_cpu_time 7449s 10.03s call tests/test_utils_test.py::test_popen_timeout 7449s 9.59s call tests/test_stress.py::test_cancel_stress 7449s 7.53s call tests/test_nanny.py::test_num_fds 7449s 6.65s call tests/test_stress.py::test_cancel_stress_sync 7449s 6.63s call tests/test_failed_workers.py::test_worker_doesnt_await_task_completion 7449s 6.34s call tests/test_chaos.py::test_KillWorker[segfault] 7449s 6.11s call shuffle/tests/test_rechunk.py::test_rechunk_method 7449s 5.46s call diagnostics/tests/test_progress.py::test_group_timing 7449s 5.45s call tests/test_utils_test.py::test_bare_cluster 7449s 5.43s call shuffle/tests/test_rechunk.py::test_rechunk_with_partially_unknown_dimension[x3-chunks3] 7449s 5.36s call tests/test_steal.py::test_balance_with_longer_task 7449s 5.19s call shuffle/tests/test_rechunk.py::test_rechunk_with_partially_unknown_dimension[x5-chunks5] 7449s 5.13s call tests/test_chaos.py::test_KillWorker[sys.exit] 7449s 5.09s call shuffle/tests/test_rechunk.py::test_homogeneously_schedule_unpack 7449s 4.84s call tests/test_nanny.py::test_environ_plugin 7449s 4.79s call diagnostics/tests/test_progress.py::test_AllProgress 7449s 4.76s call tests/test_failed_workers.py::test_restart_sync 7449s 4.69s call shuffle/tests/test_rechunk.py::test_rechunk_with_partially_unknown_dimension[x4-chunks4] 7449s =========================== short test summary info ============================ 7449s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_ssh.py:9: could not import 'paramiko': No module named 'paramiko' 7449s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/comm/tests/test_ucx.py:15: could not import 'ucp': No module named 'ucp' 7449s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/comm/tests/test_ucx_config.py:23: could not import 'ucp': No module named 'ucp' 7449s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/dashboard/tests/test_components.py:5: could not import 'bokeh': No module named 'bokeh' 7449s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/dashboard/tests/test_scheduler_bokeh.py:11: could not import 'bokeh': No module named 'bokeh' 7449s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/dashboard/tests/test_worker_bokeh.py:10: could not import 'bokeh': No module named 'bokeh' 7449s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_old_ssh.py:7: could not import 'paramiko': No module named 'paramiko' 7449s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_ssh.py:5: could not import 'asyncssh': No module named 'asyncssh' 7449s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_cudf_diagnostics.py:20: could not import 'cudf': No module named 'cudf' 7449s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_memray.py:5: could not import 'memray': No module named 'memray' 7449s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_nvml.py:11: could not import 'pynvml': No module named 'pynvml' 7449s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_progress_stream.py:5: could not import 'bokeh': No module named 'bokeh' 7449s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_progress_widgets.py:14: could not import 'ipywidgets': No module named 'ipywidgets' 7449s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_rmm_diagnostics.py:14: could not import 'dask_cuda': No module named 'dask_cuda' 7449s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_arrow.py:5: could not import 'pyarrow': No module named 'pyarrow' 7449s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_cupy.py:11: could not import 'cupy': No module named 'cupy' 7449s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_h5py.py:8: could not import 'h5py': No module named 'h5py' 7449s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_keras.py:5: could not import 'keras': No module named 'keras' 7449s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_netcdf4.py:5: could not import 'netCDF4': No module named 'netCDF4' 7449s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numba.py:11: could not import 'numba.cuda': No module named 'numba' 7449s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_rmm.py:10: could not import 'numba.cuda': No module named 'numba' 7449s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_scipy.py:8: could not import 'scipy': No module named 'scipy' 7449s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_sparse.py:6: could not import 'sparse': No module named 'sparse' 7449s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_torch.py:8: could not import 'torch': No module named 'torch' 7449s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_graph.py:9: could not import 'pyarrow': No module named 'pyarrow' 7449s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_merge.py:71: could not import 'pyarrow': No module named 'pyarrow' 7449s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_merge_column_and_index.py:110: could not import 'pyarrow': No module named 'pyarrow' 7449s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_metrics.py:71: could not import 'pyarrow': No module named 'pyarrow' 7449s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_shuffle.py:195: could not import 'pyarrow': No module named 'pyarrow' 7449s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_parse_stdout.py:14: could not import 'parse_stdout': No module named 'parse_stdout' 7449s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py:85: could not import 'bokeh': No module named 'bokeh' 7449s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py:117: could not import 'bokeh': No module named 'bokeh' 7449s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py:168: could not import 'bokeh': No module named 'bokeh' 7449s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py:325: could not import 'bokeh': No module named 'bokeh' 7449s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py:552: need --runslow option to run 7449s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py:564: need --runslow option to run 7449s SKIPPED [2] ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_scheduler.py:662: need --runslow option to run 7449s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py:169: need --runslow option to run 7449s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py:196: need --runslow option to run 7449s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py:270: need --runslow option to run 7449s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py:308: need --runslow option to run 7449s SKIPPED [2] ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py:329: need --runslow option to run 7449s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py:388: need --runslow option to run 7449s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py:429: need --runslow option to run 7449s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py:436: need --runslow option to run 7449s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py:444: need --runslow option to run 7449s SKIPPED [4] ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py:472: need --runslow option to run 7449s SKIPPED [4] ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py:508: need --runslow option to run 7449s SKIPPED [4] ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py:547: need --runslow option to run 7449s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py:578: need --runslow option to run 7449s SKIPPED [2] ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py:616: need --runslow option to run 7449s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py:627: need --runslow option to run 7449s SKIPPED [2] ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py:637: need --runslow option to run 7449s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py:682: need --runslow option to run 7449s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py:699: need --runslow option to run 7449s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py:719: need --runslow option to run 7449s SKIPPED [2] ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py:733: need --runslow option to run 7449s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/cli/tests/test_dask_worker.py:824: need --runslow option to run 7449s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_subprocess.py:77: need --runslow option to run 7449s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_subprocess.py:92: Windows-specific error testing (distributed#7434) 7449s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_eventstream.py:16: could not import 'bokeh': No module named 'bokeh' 7449s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_install_plugin.py:143: need --runslow option to run 7449s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_install_plugin.py:151: need --runslow option to run 7449s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_install_plugin.py:158: need --runslow option to run 7449s SKIPPED [2] ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_memory_sampler.py:103: could not import 'matplotlib': No module named 'matplotlib' 7449s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_task_stream.py:140: could not import 'bokeh.models': No module named 'bokeh' 7449s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/diagnostics/tests/test_task_stream.py:151: could not import 'bokeh.models': No module named 'bokeh' 7449s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_missing_bokeh.py:35: could not import 'bokeh': No module named 'bokeh' 7449s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_missing_bokeh.py:59: could not import 'bokeh': No module named 'bokeh' 7449s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py:87: could not import 'bokeh': No module named 'bokeh' 7449s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py:535: could not import 'aiohttp': No module named 'aiohttp' 7449s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py:648: could not import 'bokeh': No module named 'bokeh' 7449s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py:689: could not import 'aiohttp': No module named 'aiohttp' 7449s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py:709: could not import 'aiohttp': No module named 'aiohttp' 7449s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py:732: could not import 'aiohttp': No module named 'aiohttp' 7449s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py:754: could not import 'aiohttp': No module named 'aiohttp' 7449s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/http/scheduler/tests/test_scheduler_http.py:775: could not import 'aiohttp': No module named 'aiohttp' 7449s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/http/worker/tests/test_worker_http.py:150: could not import 'aiohttp': No module named 'aiohttp' 7449s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/http/worker/tests/test_worker_http.py:163: could not import 'aiohttp': No module named 'aiohttp' 7449s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/http/worker/tests/test_worker_http.py:234: Fails on 32-bit, seems to be large memory request 7449s SKIPPED [4] ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_collection_cuda.py:12: could not import 'cupy': No module named 'cupy' 7449s SKIPPED [4] ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_collection_cuda.py:44: could not import 'cudf': No module named 'cudf' 7449s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py:125: could not import 'lz4': No module named 'lz4' 7449s SKIPPED [2] ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py:132: could not import 'lz4': No module named 'lz4' 7449s SKIPPED [2] ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py:132: could not import 'snappy': No module named 'snappy' 7449s SKIPPED [2] ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py:132: could not import 'zstandard': No module named 'zstandard' 7449s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py:143: could not import 'lz4': No module named 'lz4' 7449s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py:143: could not import 'snappy': No module named 'snappy' 7449s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py:143: could not import 'zstandard': No module named 'zstandard' 7449s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py:151: could not import 'lz4': No module named 'lz4' 7449s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py:151: could not import 'snappy': No module named 'snappy' 7449s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py:151: could not import 'zstandard': No module named 'zstandard' 7449s SKIPPED [10] ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py:168: need --runslow option to run 7449s SKIPPED [5] ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_compression.py:188: need --runslow option to run 7449s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py:150: could not import 'numpy.core.test_rational': No module named 'numpy.core.test_rational' 7449s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_numpy.py:180: need --runslow option to run 7449s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_pickle.py:275: need --runslow option to run 7449s SKIPPED [3] ../../../../usr/lib/python3/dist-packages/distributed/protocol/tests/test_protocol.py:219: need --runslow option to run 7449s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/shuffle/tests/test_rechunk.py:1326: need --runslow option to run 7449s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py:1304: need --runslow option to run 7449s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py:1317: need --runslow option to run 7449s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py:1339: need --runslow option to run 7449s SKIPPED [2] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_active_memory_manager.py:1360: need --runslow option to run 7449s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_batched.py:158: need --runslow option to run 7449s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_batched.py:228: need --runslow option to run 7449s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py:859: need --runslow option to run 7449s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py:1707: Upstream issue in CPython. See https://github.com/dask/distributed/issues/8708 and https://github.com/python/cpython/issues/121342. 7449s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py:1736: need --runslow option to run 7449s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py:1870: unconditional skip 7449s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py:2088: unconditional skip 7449s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py:2677: Use fast random selection now 7449s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py:3301: unconditional skip 7449s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py:3585: need --runslow option to run 7449s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py:3650: need --runslow option to run 7449s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py:3762: need --runslow option to run 7449s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py:4563: need --runslow option to run 7449s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py:4667: Now prefer first-in-first-out 7449s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py:4697: need --runslow option to run 7449s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py:4804: need --runslow option to run 7449s SKIPPED [2] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py:4849: need --runslow option to run 7449s SKIPPED [2] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py:4869: need --runslow option to run 7449s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py:4896: need --runslow option to run 7449s SKIPPED [2] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py:4909: need --runslow option to run 7449s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py:5097: need --runslow option to run 7449s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py:5118: need --runslow option to run 7449s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py:5417: need --runslow option to run 7449s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py:5643: need --runslow option to run 7449s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py:5844: need --runslow option to run 7449s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py:5961: unconditional skip 7449s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py:6179: could not import 'bokeh.plotting': No module named 'bokeh' 7449s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py:6540: known intermittent failure 7449s SKIPPED [2] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py:6621: need --runslow option to run 7449s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py:6695: need --runslow option to run 7449s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py:7065: could not import 'bokeh': No module named 'bokeh' 7449s SKIPPED [2] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py:7166: need --runslow option to run 7449s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py:7265: numpy >=1.25 can capture ufunc code 7449s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py:7413: need --runslow option to run 7449s SKIPPED [2] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py:8031: need --runslow option to run 7449s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py:8235: need --runslow option to run 7449s SKIPPED [2] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client.py:8286: need --runslow option to run 7449s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_client_executor.py:146: need --runslow option to run 7449s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_config.py:356: could not import 'uvloop': No module named 'uvloop' 7449s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_core.py:450: need --runslow option to run 7449s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_core.py:915: could not import 'crick': No module named 'crick' 7449s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_core.py:924: could not import 'crick': No module named 'crick' 7449s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_core.py:1386: need --runslow option to run 7449s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_counter.py:13: no crick library 7449s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_dask_collections.py:221: could not import 'sparse': No module named 'sparse' 7449s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_diskutils.py:224: need --runslow option to run 7449s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_failed_workers.py:41: need --runslow option to run 7449s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_failed_workers.py:117: need --runslow option to run 7449s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_failed_workers.py:128: need --runslow option to run 7449s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_failed_workers.py:287: need --runslow option to run 7449s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_failed_workers.py:358: need --runslow option to run 7449s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_failed_workers.py:442: need --runslow option to run 7449s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_failed_workers.py:454: need --runslow option to run 7449s SKIPPED [2] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_failed_workers.py:491: need --runslow option to run 7449s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_failed_workers.py:537: need --runslow option to run 7449s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_jupyter.py:48: need --runslow option to run 7449s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_metrics.py:30: WindowsTime doesn't work with high accuracy base timer 7449s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py:93: need --runslow option to run 7449s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py:107: need --runslow option to run 7449s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py:141: need --runslow option to run 7449s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py:291: need --runslow option to run 7449s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py:490: need --runslow option to run 7449s SKIPPED [2] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py:567: could not import 'ucp': No module named 'ucp' 7449s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py:682: need --runslow option to run 7449s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py:690: need --runslow option to run 7449s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py:731: need --runslow option to run 7449s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_nanny.py:774: need --runslow option to run 7449s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_profile.py:75: could not import 'stacktrace': No module named 'stacktrace' 7449s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_queues.py:114: need --runslow option to run 7449s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py:363: Skipped 7449s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py:422: Should protect resource keys from optimization 7449s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_resources.py:445: atop fusion seemed to break this 7449s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py:286: Not relevant with queuing on; see https://github.com/dask/distributed/issues/7204 7449s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py:421: need --runslow option to run 7449s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py:1075: need --runslow option to run 7449s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py:1103: need --runslow option to run 7449s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py:1124: need --runslow option to run 7449s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py:1216: need --runslow option to run 7449s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py:1234: need --runslow option to run 7449s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py:1625: need --runslow option to run 7449s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py:1680: need --runslow option to run 7449s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py:1697: need --runslow option to run 7449s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py:1860: need --runslow option to run 7449s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py:1900: need --runslow option to run 7449s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py:2095: need --runslow option to run 7449s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py:2356: need --runslow option to run 7449s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py:2481: need --runslow option to run 7449s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py:2508: need --runslow option to run 7449s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py:2556: need --runslow option to run 7449s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py:2606: need --runslow option to run 7449s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py:2661: could not import 'bokeh': No module named 'bokeh' 7449s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py:3112: need --runslow option to run 7449s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py:3512: need --runslow option to run 7449s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py:3691: need --runslow option to run 7449s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py:3723: need --runslow option to run 7449s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py:3866: need --runslow option to run 7449s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py:3923: need --runslow option to run 7449s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_scheduler.py:3943: need --runslow option to run 7449s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py:106: need --runslow option to run 7449s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py:285: Skipped 7449s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py:1287: executing heartbeats not considered yet 7449s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_steal.py:1353: need --runslow option to run 7449s SKIPPED [2] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_stress.py:51: need --runslow option to run 7449s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_stress.py:100: need --runslow option to run 7449s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_stress.py:209: unconditional skip 7449s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_stress.py:240: need --runslow option to run 7449s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_stress.py:269: need --runslow option to run 7449s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_stress.py:310: need --runslow option to run 7449s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_system_monitor.py:111: could not import 'gilknocker': No module named 'gilknocker' 7449s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py:166: could not import 'IPython': No module named 'IPython' 7449s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils.py:347: could not import 'pyarrow': No module named 'pyarrow' 7449s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py:146: This hangs on travis 7449s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_utils_test.py:721: need --runslow option to run 7449s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_variable.py:205: need --runslow option to run 7449s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py:219: don't yet support uploading pyc files 7449s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py:309: could not import 'crick': No module named 'crick' 7449s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py:345: need --runslow option to run 7449s SKIPPED [8] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py:420: need --runslow option to run 7449s SKIPPED [5] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py:562: need --runslow option to run 7449s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py:1180: need --runslow option to run 7449s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py:1264: need --runslow option to run 7449s SKIPPED [2] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py:1453: could not import 'ucp': No module named 'ucp' 7449s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py:1517: need --runslow option to run 7449s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py:1549: need --runslow option to run 7449s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py:1580: need --runslow option to run 7449s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py:1607: need --runslow option to run 7449s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py:1635: need --runslow option to run 7449s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py:1702: need --runslow option to run 7449s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py:1806: need --runslow option to run 7449s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py:2705: need --runslow option to run 7449s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py:3399: need --runslow option to run 7449s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker.py:3429: need --runslow option to run 7449s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py:871: need --runslow option to run 7449s SKIPPED [2] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py:883: need --runslow option to run 7449s SKIPPED [1] ../../../../usr/lib/python3/dist-packages/distributed/tests/test_worker_memory.py:997: need --runslow option to run 7449s FAILED tests/test_tls_functional.py::test_retire_workers - TimeoutError 7449s = 1 failed, 2937 passed, 301 skipped, 160 deselected, 15 xfailed, 8 xpassed in 1479.88s (0:24:39) = 7460s *** END OF RUN 1: NOT ALL TESTS HAVE YET PASSED/XFAILED *** 7460s *** STARTING RUN 2: python3.13 -m pytest --pyargs distributed --verbose --color=no --timeout-method=signal --timeout=300 -m not avoid_ci -rfE --last-failed --last-failed-no-failures none --ignore=../../../../../usr/lib/python3/dist-packages/distributed/comm/tests/test_comms.py --ignore=../../../../../usr/lib/python3/dist-packages/distributed/comm/tests/test_ws.py --ignore=../../../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_adaptive.py --ignore=../../../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_local.py --ignore=../../../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_slow_adaptive.py --ignore=../../../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_spec_cluster.py --deselect=cli/tests/test_dask_scheduler.py::test_no_dashboard --deselect=deploy/tests/test_local.py::test_localcluster_get_client --deselect=deploy/tests/test_old_ssh.py::test_cluster --deselect=deploy/tests/test_old_ssh.py::test_old_ssh_nprocs_renamed_to_n_workers --deselect=deploy/tests/test_old_ssh.py::test_nprocs_attribute_is_deprecated --deselect=deploy/tests/test_ssh.py::test_nprocs_attribute_is_deprecated --deselect=http/tests/test_core.py::test_prometheus_api_doc --deselect=tests/test_init.py::test_git_revision --deselect=tests/test_jupyter.py::test_jupyter_idle_timeout --deselect=tests/test_jupyter.py::test_jupyter_idle_timeout_returned --deselect=tests/test_jupyter.py::test_jupyter_server --deselect=tests/test_jupyter.py::test_shutsdown_cleanly --deselect=tests/test_profile.py::test_stack_overflow --deselect=tests/test_pubsub.py::test_client_worker --deselect=tests/test_queues.py::test_queue_in_task --deselect=tests/test_spill.py::test_spillbuffer_oserror --deselect=tests/test_steal.py::test_steal_twice --deselect=tests/test_utils_test.py::test_cluster --deselect=tests/test_variable.py::test_variable_in_task --deselect=tests/test_worker.py::test_process_executor_kills_process --deselect=tests/test_worker_memory.py::test_fail_to_pickle_execute_1 --deselect=tests/test_worker_state_machine.py::test_task_state_instance_are_garbage_collected --deselect=protocol/tests/test_protocol.py::test_deeply_nested_structures --deselect=protocol/tests/test_serialize.py::test_deeply_nested_structures --deselect=cli/tests/test_dask_scheduler.py::test_defaults --deselect=cli/tests/test_dask_scheduler.py::test_hostport --deselect=cli/tests/test_dask_spec.py::test_errors --deselect=cli/tests/test_dask_worker.py::test_scheduler_file --deselect=cli/tests/test_dask_worker.py::test_scheduler_file --deselect=cli/tests/test_dask_worker.py::test_scheduler_file --deselect=dashboard/tests/test_scheduler_bokeh.py::test_counters --deselect=dashboard/tests/test_worker_bokeh.py::test_counters --deselect=deploy/tests/test_local.py::test_adapt_then_manual --deselect=deploy/tests/test_local.py::test_async_with --deselect=deploy/tests/test_local.py::test_close_twice --deselect=deploy/tests/test_local.py::test_cluster_info_sync --deselect=deploy/tests/test_local.py::test_local_tls --deselect=deploy/tests/test_local.py::test_no_dangling_asyncio_tasks --deselect=deploy/tests/test_local.py::test_only_local_access --deselect=deploy/tests/test_local.py::test_remote_access --deselect=diagnostics/tests/test_progress_widgets.py::test_serializers --deselect=diagnostics/tests/test_scheduler_plugin.py::test_lifecycle --deselect=http/scheduler/tests/test_missing_bokeh.py::test_missing_bokeh --deselect=http/scheduler/tests/test_scheduler_http.py::test_metrics_when_prometheus_client_not_installed --deselect=protocol/tests/test_serialize.py::test_errors --deselect=tests/test_batched.py::test_BatchedSend --deselect=tests/test_batched.py::test_close_closed --deselect=tests/test_batched.py::test_close_twice --deselect=tests/test_batched.py::test_send_after_stream_start --deselect=tests/test_batched.py::test_send_before_close --deselect=tests/test_batched.py::test_send_before_start --deselect=tests/test_batched.py::test_sending_traffic_jam --deselect=tests/test_batched.py::test_serializers --deselect=tests/test_client.py::TestClientSecurityLoader::test_security_loader --deselect=tests/test_client.py::TestClientSecurityLoader::test_security_loader_ignored_if_explicit_security_provided --deselect=tests/test_client.py::TestClientSecurityLoader::test_security_loader_ignored_if_returns_none --deselect=tests/test_client.py::test_async_with --deselect=tests/test_client.py::test_client_is_quiet_cluster_close --deselect=tests/test_client.py::test_dashboard_link_cluster --deselect=tests/test_client.py::test_dashboard_link_inproc --deselect=tests/test_client.py::test_file_descriptors_dont_leak --deselect=tests/test_client.py::test_mixing_clients_different_scheduler --deselect=tests/test_client.py::test_quiet_client_close --deselect=tests/test_client.py::test_rebalance_sync --deselect=tests/test_client.py::test_repr_localcluster --deselect=tests/test_client.py::test_security_loader --deselect=tests/test_client.py::test_security_loader_ignored_if_explicit_security_provided --deselect=tests/test_client.py::test_security_loader_ignored_if_returns_none --deselect=tests/test_client.py::test_shutdown --deselect=tests/test_client.py::test_shutdown_is_quiet_with_cluster --deselect=tests/test_client.py::test_shutdown_localcluster --deselect=tests/test_client.py::test_shutdown_stops_callbacks --deselect=tests/test_client_loop.py::test_close_loop_sync_start_new_loop --deselect=tests/test_client_loop.py::test_close_loop_sync_use_running_loop --deselect=tests/test_core.py::test_close_fast_without_active_handlers --deselect=tests/test_core.py::test_close_grace_period_for_handlers --deselect=tests/test_core.py::test_close_properly --deselect=tests/test_core.py::test_compression --deselect=tests/test_core.py::test_connection_pool --deselect=tests/test_core.py::test_connection_pool_close_while_connecting --deselect=tests/test_core.py::test_connection_pool_detects_remote_close --deselect=tests/test_core.py::test_connection_pool_outside_cancellation --deselect=tests/test_core.py::test_connection_pool_remove --deselect=tests/test_core.py::test_connection_pool_respects_limit --deselect=tests/test_core.py::test_connection_pool_tls --deselect=tests/test_core.py::test_counters --deselect=tests/test_core.py::test_deserialize_error --deselect=tests/test_core.py::test_errors --deselect=tests/test_core.py::test_identity_inproc --deselect=tests/test_core.py::test_identity_tcp --deselect=tests/test_core.py::test_large_packets_inproc --deselect=tests/test_core.py::test_messages_are_ordered_bsend --deselect=tests/test_core.py::test_messages_are_ordered_raw --deselect=tests/test_core.py::test_ports --deselect=tests/test_core.py::test_rpc_default --deselect=tests/test_core.py::test_rpc_inproc --deselect=tests/test_core.py::test_rpc_message_lifetime_default --deselect=tests/test_core.py::test_rpc_message_lifetime_inproc --deselect=tests/test_core.py::test_rpc_message_lifetime_tcp --deselect=tests/test_core.py::test_rpc_serialization --deselect=tests/test_core.py::test_rpc_tcp --deselect=tests/test_core.py::test_rpc_tls --deselect=tests/test_core.py::test_rpc_with_many_connections_inproc --deselect=tests/test_core.py::test_rpc_with_many_connections_tcp --deselect=tests/test_core.py::test_send_recv_args --deselect=tests/test_core.py::test_send_recv_cancelled --deselect=tests/test_core.py::test_server --deselect=tests/test_core.py::test_server_comms_mark_active_handlers --deselect=tests/test_core.py::test_server_raises_on_blocked_handlers --deselect=tests/test_jupyter.py::test_jupyter_idle_timeout --deselect=tests/test_jupyter.py::test_jupyter_server --deselect=tests/test_locks.py::test_errors --deselect=tests/test_nanny.py::test_scheduler_file --deselect=tests/test_nanny.py::test_scheduler_file --deselect=tests/test_nanny.py::test_scheduler_file --deselect=tests/test_nanny.py::test_worker_uses_same_host_as_nanny --deselect=tests/test_preload.py::test_failure_doesnt_crash_scheduler --deselect=tests/test_preload.py::test_preload_import_time --deselect=tests/test_preload.py::test_preload_manager_sequence --deselect=tests/test_preload.py::test_worker_preload_text --deselect=tests/test_scheduler.py::test_allowed_failures_config --deselect=tests/test_scheduler.py::test_async_context_manager --deselect=tests/test_scheduler.py::test_dashboard_host --deselect=tests/test_scheduler.py::test_file_descriptors_dont_leak --deselect=tests/test_scheduler.py::test_finished --deselect=tests/test_scheduler.py::test_multiple_listeners --deselect=tests/test_scheduler.py::test_no_dangling_asyncio_tasks --deselect=tests/test_scheduler.py::test_scheduler_file --deselect=tests/test_scheduler.py::test_scheduler_file --deselect=tests/test_scheduler.py::test_scheduler_file --deselect=tests/test_security.py::test_require_encryption --deselect=tests/test_security.py::test_tls_listen_connect --deselect=tests/test_security.py::test_tls_temporary_credentials_functional --deselect=tests/test_semaphore.py::test_threadpoolworkers_pick_correct_ioloop --deselect=tests/test_tls_functional.py::test_security_dict_input_no_security --deselect=tests/test_utils_test.py::test_ensure_no_new_clients --deselect=tests/test_utils_test.py::test_freeze_batched_send --deselect=tests/test_utils_test.py::test_locked_comm_drop_in_replacement --deselect=tests/test_utils_test.py::test_locked_comm_intercept_read --deselect=tests/test_utils_test.py::test_locked_comm_intercept_write --deselect=tests/test_worker.py::test_host_uses_scheduler_protocol --deselect=tests/test_worker.py::test_plugin_exception --deselect=tests/test_worker.py::test_plugin_internal_exception --deselect=tests/test_worker.py::test_plugin_multiple_exceptions --deselect=tests/test_worker.py::test_scheduler_file --deselect=tests/test_worker.py::test_scheduler_file --deselect=tests/test_worker.py::test_scheduler_file --deselect=tests/test_worker_client.py::test_dont_override_default_get 7461s ============================= test session starts ============================== 7461s platform linux -- Python 3.13.2, pytest-8.3.4, pluggy-1.5.0 -- /usr/bin/python3.13 7461s cachedir: .pytest_cache 7461s rootdir: /tmp/autopkgtest.4PKwEm/autopkgtest_tmp/build 7461s configfile: pyproject.toml 7461s plugins: timeout-2.3.1, rerunfailures-15.0, anyio-4.7.0, typeguard-4.4.1 7461s timeout: 300.0s 7461s timeout method: signal 7461s timeout func_only: False 7472s collecting ... collected 3392 items / 3391 deselected / 30 skipped / 1 selected 7472s run-last-failure: rerun previous 1 failure 7472s 7533s tests/test_tls_functional.py::test_retire_workers <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_tls_functional.py FAILED [100%] 7533s 7533s =================================== FAILURES =================================== 7533s _____________________________ test_retire_workers ______________________________ 7533s 7533s fut = , timeout = 0 7533s 7533s async def wait_for(fut: Awaitable[T], timeout: float) -> T: 7533s async with asyncio.timeout(timeout): 7533s > return await fut 7533s 7533s /usr/lib/python3/dist-packages/distributed/utils.py:1914: 7533s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 7533s /usr/lib/python3/dist-packages/distributed/nanny.py:358: in start_unsafe 7533s comm = await self.rpc.connect(saddr) 7533s /usr/lib/python3/dist-packages/distributed/core.py:1485: in connect 7533s return await self._connect(addr=addr, timeout=timeout) 7533s /usr/lib/python3/dist-packages/distributed/core.py:1429: in _connect 7533s comm = await connect( 7533s /usr/lib/python3/dist-packages/distributed/comm/core.py:342: in connect 7533s comm = await wait_for( 7533s /usr/lib/python3/dist-packages/distributed/utils.py:1914: in wait_for 7533s return await fut 7533s /usr/lib/python3/dist-packages/distributed/comm/tcp.py:546: in connect 7533s stream = await self.client.connect( 7533s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 7533s 7533s self = 7533s host = '127.0.0.1', port = 33273, af = 7533s ssl_options = 7533s max_buffer_size = 4163037184.0, source_ip = None, source_port = None 7533s timeout = None 7533s 7533s async def connect( 7533s self, 7533s host: str, 7533s port: int, 7533s af: socket.AddressFamily = socket.AF_UNSPEC, 7533s ssl_options: Optional[Union[Dict[str, Any], ssl.SSLContext]] = None, 7533s max_buffer_size: Optional[int] = None, 7533s source_ip: Optional[str] = None, 7533s source_port: Optional[int] = None, 7533s timeout: Optional[Union[float, datetime.timedelta]] = None, 7533s ) -> IOStream: 7533s """Connect to the given host and port. 7533s 7533s Asynchronously returns an `.IOStream` (or `.SSLIOStream` if 7533s ``ssl_options`` is not None). 7533s 7533s Using the ``source_ip`` kwarg, one can specify the source 7533s IP address to use when establishing the connection. 7533s In case the user needs to resolve and 7533s use a specific interface, it has to be handled outside 7533s of Tornado as this depends very much on the platform. 7533s 7533s Raises `TimeoutError` if the input future does not complete before 7533s ``timeout``, which may be specified in any form allowed by 7533s `.IOLoop.add_timeout` (i.e. a `datetime.timedelta` or an absolute time 7533s relative to `.IOLoop.time`) 7533s 7533s Similarly, when the user requires a certain source port, it can 7533s be specified using the ``source_port`` arg. 7533s 7533s .. versionchanged:: 4.5 7533s Added the ``source_ip`` and ``source_port`` arguments. 7533s 7533s .. versionchanged:: 5.0 7533s Added the ``timeout`` argument. 7533s """ 7533s if timeout is not None: 7533s if isinstance(timeout, numbers.Real): 7533s timeout = IOLoop.current().time() + timeout 7533s elif isinstance(timeout, datetime.timedelta): 7533s timeout = IOLoop.current().time() + timeout.total_seconds() 7533s else: 7533s raise TypeError("Unsupported timeout %r" % timeout) 7533s if timeout is not None: 7533s addrinfo = await gen.with_timeout( 7533s timeout, self.resolver.resolve(host, port, af) 7533s ) 7533s else: 7533s addrinfo = await self.resolver.resolve(host, port, af) 7533s connector = _Connector( 7533s addrinfo, 7533s functools.partial( 7533s self._create_stream, 7533s max_buffer_size, 7533s source_ip=source_ip, 7533s source_port=source_port, 7533s ), 7533s ) 7533s > af, addr, stream = await connector.start(connect_timeout=timeout) 7533s E asyncio.exceptions.CancelledError 7533s 7533s /usr/lib/python3/dist-packages/tornado/tcpclient.py:279: CancelledError 7533s 7533s The above exception was the direct cause of the following exception: 7533s 7533s self = 7533s 7533s @final 7533s async def start(self): 7533s async with self._startup_lock: 7533s if self.status == Status.failed: 7533s assert self.__startup_exc is not None 7533s raise self.__startup_exc 7533s elif self.status != Status.init: 7533s return self 7533s timeout = getattr(self, "death_timeout", None) 7533s 7533s async def _close_on_failure(exc: Exception) -> None: 7533s await self.close(reason=f"failure-to-start-{str(type(exc))}") 7533s self.status = Status.failed 7533s self.__startup_exc = exc 7533s 7533s try: 7533s > await wait_for(self.start_unsafe(), timeout=timeout) 7533s 7533s /usr/lib/python3/dist-packages/distributed/core.py:528: 7533s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 7533s /usr/lib/python3/dist-packages/distributed/utils.py:1913: in wait_for 7533s async with asyncio.timeout(timeout): 7533s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 7533s 7533s self = 7533s exc_type = 7533s exc_val = CancelledError(), exc_tb = 7533s 7533s async def __aexit__( 7533s self, 7533s exc_type: Optional[Type[BaseException]], 7533s exc_val: Optional[BaseException], 7533s exc_tb: Optional[TracebackType], 7533s ) -> Optional[bool]: 7533s assert self._state in (_State.ENTERED, _State.EXPIRING) 7533s 7533s if self._timeout_handler is not None: 7533s self._timeout_handler.cancel() 7533s self._timeout_handler = None 7533s 7533s if self._state is _State.EXPIRING: 7533s self._state = _State.EXPIRED 7533s 7533s if self._task.uncancel() <= self._cancelling and exc_type is not None: 7533s # Since there are no new cancel requests, we're 7533s # handling this. 7533s if issubclass(exc_type, exceptions.CancelledError): 7533s > raise TimeoutError from exc_val 7533s E TimeoutError 7533s 7533s /usr/lib/python3.13/asyncio/timeouts.py:116: TimeoutError 7533s 7533s The above exception was the direct cause of the following exception: 7533s 7533s @contextlib.asynccontextmanager 7533s async def _cluster_factory(): 7533s workers = [] 7533s s = None 7533s try: 7533s for _ in range(60): 7533s try: 7533s > s, ws = await start_cluster( 7533s nthreads, 7533s scheduler, 7533s security=security, 7533s Worker=Worker, 7533s scheduler_kwargs=scheduler_kwargs, 7533s worker_kwargs=merge( 7533s {"death_timeout": min(15, int(deadline.remaining))}, 7533s worker_kwargs, 7533s ), 7533s ) 7533s 7533s /usr/lib/python3/dist-packages/distributed/utils_test.py:974: 7533s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 7533s /usr/lib/python3/dist-packages/distributed/utils_test.py:791: in start_cluster 7533s await asyncio.gather(*workers) 7533s /usr/lib/python3.13/asyncio/tasks.py:737: in _wrap_awaitable 7533s return await awaitable 7533s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 7533s 7533s self = 7533s 7533s @final 7533s async def start(self): 7533s async with self._startup_lock: 7533s if self.status == Status.failed: 7533s assert self.__startup_exc is not None 7533s raise self.__startup_exc 7533s elif self.status != Status.init: 7533s return self 7533s timeout = getattr(self, "death_timeout", None) 7533s 7533s async def _close_on_failure(exc: Exception) -> None: 7533s await self.close(reason=f"failure-to-start-{str(type(exc))}") 7533s self.status = Status.failed 7533s self.__startup_exc = exc 7533s 7533s try: 7533s await wait_for(self.start_unsafe(), timeout=timeout) 7533s except asyncio.TimeoutError as exc: 7533s await _close_on_failure(exc) 7533s > raise asyncio.TimeoutError( 7533s f"{type(self).__name__} start timed out after {timeout}s." 7533s ) from exc 7533s E TimeoutError: Nanny start timed out after 0s. 7533s 7533s /usr/lib/python3/dist-packages/distributed/core.py:531: TimeoutError 7533s 7533s During handling of the above exception, another exception occurred: 7533s 7533s fut = ._..test_func..async_fn at 0x7c7b87147840> 7533s timeout = 60 7533s 7533s async def wait_for(fut: Awaitable[T], timeout: float) -> T: 7533s async with asyncio.timeout(timeout): 7533s > return await fut 7533s 7533s /usr/lib/python3/dist-packages/distributed/utils.py:1914: 7533s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 7533s /usr/lib/python3/dist-packages/distributed/utils_test.py:1007: in async_fn 7533s _cluster_factory() as (s, workers), 7533s /usr/lib/python3.13/contextlib.py:214: in __aenter__ 7533s return await anext(self.gen) 7533s /usr/lib/python3/dist-packages/distributed/utils_test.py:991: in _cluster_factory 7533s await asyncio.sleep(1) 7533s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 7533s 7533s delay = 1, result = None 7533s 7533s async def sleep(delay, result=None): 7533s """Coroutine that completes after a given time (in seconds).""" 7533s if delay <= 0: 7533s await __sleep0() 7533s return result 7533s 7533s if math.isnan(delay): 7533s raise ValueError("Invalid delay: NaN (not a number)") 7533s 7533s loop = events.get_running_loop() 7533s future = loop.create_future() 7533s h = loop.call_later(delay, 7533s futures._set_result_unless_cancelled, 7533s future, result) 7533s try: 7533s > return await future 7533s E asyncio.exceptions.CancelledError 7533s 7533s /usr/lib/python3.13/asyncio/tasks.py:718: CancelledError 7533s 7533s The above exception was the direct cause of the following exception: 7533s 7533s args = (), kwds = {} 7533s 7533s @wraps(func) 7533s def inner(*args, **kwds): 7533s with self._recreate_cm(): 7533s > return func(*args, **kwds) 7533s 7533s /usr/lib/python3.13/contextlib.py:85: 7533s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 7533s /usr/lib/python3.13/contextlib.py:85: in inner 7533s return func(*args, **kwds) 7533s /usr/lib/python3/dist-packages/distributed/utils_test.py:1090: in test_func 7533s return _run_and_close_tornado(async_fn_outer) 7533s /usr/lib/python3/dist-packages/distributed/utils_test.py:380: in _run_and_close_tornado 7533s return asyncio_run(inner_fn(), loop_factory=get_loop_factory()) 7533s /usr/lib/python3.13/asyncio/runners.py:195: in run 7533s return runner.run(main) 7533s /usr/lib/python3.13/asyncio/runners.py:118: in run 7533s return self._loop.run_until_complete(task) 7533s /usr/lib/python3.13/asyncio/base_events.py:725: in run_until_complete 7533s return future.result() 7533s /usr/lib/python3/dist-packages/distributed/utils_test.py:377: in inner_fn 7533s return await async_fn(*args, **kwargs) 7533s /usr/lib/python3/dist-packages/distributed/utils_test.py:1087: in async_fn_outer 7533s return await utils_wait_for(async_fn(), timeout=timeout * 2) 7533s /usr/lib/python3/dist-packages/distributed/utils.py:1913: in wait_for 7533s async with asyncio.timeout(timeout): 7533s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 7533s 7533s self = 7533s exc_type = 7533s exc_val = CancelledError(), exc_tb = 7533s 7533s async def __aexit__( 7533s self, 7533s exc_type: Optional[Type[BaseException]], 7533s exc_val: Optional[BaseException], 7533s exc_tb: Optional[TracebackType], 7533s ) -> Optional[bool]: 7533s assert self._state in (_State.ENTERED, _State.EXPIRING) 7533s 7533s if self._timeout_handler is not None: 7533s self._timeout_handler.cancel() 7533s self._timeout_handler = None 7533s 7533s if self._state is _State.EXPIRING: 7533s self._state = _State.EXPIRED 7533s 7533s if self._task.uncancel() <= self._cancelling and exc_type is not None: 7533s # Since there are no new cancel requests, we're 7533s # handling this. 7533s if issubclass(exc_type, exceptions.CancelledError): 7533s > raise TimeoutError from exc_val 7533s E TimeoutError 7533s 7533s /usr/lib/python3.13/asyncio/timeouts.py:116: TimeoutError 7533s ----------------------------- Captured stderr call ----------------------------- 7533s 2025-02-21 01:31:15,522 - distributed.http.proxy - INFO - To route to workers diagnostics web server please install jupyter-server-proxy: python -m pip install jupyter-server-proxy 7533s 2025-02-21 01:31:15,525 - distributed.scheduler - INFO - State start 7533s 2025-02-21 01:31:15,530 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:34115 7533s 2025-02-21 01:31:15,530 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:44907/status 7533s 2025-02-21 01:31:15,530 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7533s 2025-02-21 01:31:15,555 - distributed.nanny - INFO - Start Nanny at: 'tls://127.0.0.1:37405' 7533s 2025-02-21 01:31:15,559 - distributed.nanny - INFO - Start Nanny at: 'tls://127.0.0.1:41443' 7533s 2025-02-21 01:31:16,307 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:36019 7533s 2025-02-21 01:31:16,307 - distributed.worker - INFO - Listening to: tls://127.0.0.1:36019 7533s 2025-02-21 01:31:16,307 - distributed.worker - INFO - Worker name: 1 7533s 2025-02-21 01:31:16,307 - distributed.worker - INFO - dashboard at: 127.0.0.1:42261 7533s 2025-02-21 01:31:16,307 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34115 7533s 2025-02-21 01:31:16,307 - distributed.worker - INFO - ------------------------------------------------- 7533s 2025-02-21 01:31:16,307 - distributed.worker - INFO - Threads: 2 7533s 2025-02-21 01:31:16,307 - distributed.worker - INFO - Memory: 7.75 GiB 7533s 2025-02-21 01:31:16,307 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-q0hooao_ 7533s 2025-02-21 01:31:16,307 - distributed.worker - INFO - ------------------------------------------------- 7533s 2025-02-21 01:31:16,351 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:43963 7533s 2025-02-21 01:31:16,351 - distributed.worker - INFO - Listening to: tls://127.0.0.1:43963 7533s 2025-02-21 01:31:16,351 - distributed.worker - INFO - Worker name: 0 7533s 2025-02-21 01:31:16,352 - distributed.worker - INFO - dashboard at: 127.0.0.1:41205 7533s 2025-02-21 01:31:16,352 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:34115 7533s 2025-02-21 01:31:16,352 - distributed.worker - INFO - ------------------------------------------------- 7533s 2025-02-21 01:31:16,352 - distributed.worker - INFO - Threads: 1 7533s 2025-02-21 01:31:16,352 - distributed.worker - INFO - Memory: 7.75 GiB 7533s 2025-02-21 01:31:16,352 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-xffu1w6m 7533s 2025-02-21 01:31:16,352 - distributed.worker - INFO - ------------------------------------------------- 7533s 2025-02-21 01:31:16,669 - distributed.scheduler - INFO - Register worker addr: tls://127.0.0.1:36019 name: 1 7533s 2025-02-21 01:31:16,670 - distributed.scheduler - INFO - Starting worker compute stream, tls://127.0.0.1:36019 7533s 2025-02-21 01:31:16,670 - distributed.core - INFO - Starting established connection to tls://127.0.0.1:58242 7533s 2025-02-21 01:31:16,672 - distributed.worker - INFO - Starting Worker plugin shuffle 7533s 2025-02-21 01:31:16,673 - distributed.worker - INFO - Registered to: tls://127.0.0.1:34115 7533s 2025-02-21 01:31:16,673 - distributed.worker - INFO - ------------------------------------------------- 7533s 2025-02-21 01:31:16,674 - distributed.core - INFO - Starting established connection to tls://127.0.0.1:34115 7533s 2025-02-21 01:31:16,693 - distributed.scheduler - INFO - Register worker addr: tls://127.0.0.1:43963 name: 0 7533s 2025-02-21 01:31:16,694 - distributed.scheduler - INFO - Starting worker compute stream, tls://127.0.0.1:43963 7533s 2025-02-21 01:31:16,695 - distributed.core - INFO - Starting established connection to tls://127.0.0.1:58252 7533s 2025-02-21 01:31:16,695 - distributed.core - INFO - Connection to tls://127.0.0.1:58252 has been closed. 7533s 2025-02-21 01:31:16,695 - distributed.scheduler - INFO - Remove worker addr: tls://127.0.0.1:43963 name: 0 (stimulus_id='handle-worker-cleanup-1740101476.6953337') 7533s 2025-02-21 01:31:16,695 - distributed.worker - INFO - Starting Worker plugin shuffle 7533s 2025-02-21 01:31:16,696 - distributed.batched - INFO - Batched Comm Closed Scheduler local=tls://127.0.0.1:58252 remote=tls://127.0.0.1:34115> 7533s Traceback (most recent call last): 7533s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 297, in write 7533s raise StreamClosedError() 7533s tornado.iostream.StreamClosedError: Stream is closed 7533s 7533s The above exception was the direct cause of the following exception: 7533s 7533s Traceback (most recent call last): 7533s File "/usr/lib/python3/dist-packages/distributed/batched.py", line 115, in _background_send 7533s nbytes = yield coro 7533s ^^^^^^^^^^ 7533s File "/usr/lib/python3/dist-packages/tornado/gen.py", line 766, in run 7533s value = future.result() 7533s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 307, in write 7533s convert_stream_closed_error(self, e) 7533s ~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^ 7533s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 142, in convert_stream_closed_error 7533s raise CommClosedError(f"in {obj}: {exc}") from exc 7533s distributed.comm.core.CommClosedError: in Scheduler local=tls://127.0.0.1:58252 remote=tls://127.0.0.1:34115>: Stream is closed 7533s 2025-02-21 01:31:16,699 - distributed.worker - INFO - Registered to: tls://127.0.0.1:34115 7533s 2025-02-21 01:31:16,699 - distributed.worker - INFO - ------------------------------------------------- 7533s 2025-02-21 01:31:16,700 - distributed.core - INFO - Starting established connection to tls://127.0.0.1:34115 7533s 2025-02-21 01:31:16,700 - distributed.core - INFO - Connection to tls://127.0.0.1:34115 has been closed. 7533s 2025-02-21 01:31:16,700 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:43963. Reason: worker-handle-scheduler-connection-broken 7533s 2025-02-21 01:31:16,736 - distributed.nanny - INFO - Closing Nanny gracefully at 'tls://127.0.0.1:37405'. Reason: worker-handle-scheduler-connection-broken 7533s 2025-02-21 01:31:16,736 - distributed.worker - INFO - Removing Worker plugin shuffle 7533s 2025-02-21 01:31:16,738 - distributed.nanny - INFO - Worker closed 7533s 2025-02-21 01:31:18,740 - distributed.nanny - ERROR - Worker process died unexpectedly 7533s 2025-02-21 01:31:18,940 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:37405'. Reason: nanny-close-gracefully 7533s 2025-02-21 01:31:18,940 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:37405' closed. 7533s 2025-02-21 01:31:46,742 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:41443'. Reason: nanny-close 7533s 2025-02-21 01:31:46,742 - distributed.nanny - INFO - Nanny asking worker to close. Reason: nanny-close 7533s 2025-02-21 01:31:46,743 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:36019. Reason: nanny-close 7533s 2025-02-21 01:31:46,743 - distributed.worker - INFO - Removing Worker plugin shuffle 7533s 2025-02-21 01:31:46,745 - distributed.core - INFO - Received 'close-stream' from tls://127.0.0.1:58242; closing. 7533s 2025-02-21 01:31:46,745 - distributed.core - INFO - Connection to tls://127.0.0.1:34115 has been closed. 7533s 2025-02-21 01:31:46,745 - distributed.scheduler - INFO - Remove worker addr: tls://127.0.0.1:36019 name: 1 (stimulus_id='handle-worker-cleanup-1740101506.7455323') 7533s 2025-02-21 01:31:46,745 - distributed.scheduler - INFO - Lost all workers 7533s 2025-02-21 01:31:46,746 - distributed.nanny - INFO - Worker closed 7533s 2025-02-21 01:31:46,977 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:41443' closed. 7533s 2025-02-21 01:31:46,977 - distributed.scheduler - INFO - Closing scheduler. Reason: unknown 7533s 2025-02-21 01:31:46,977 - distributed.scheduler - INFO - Scheduler closing all comms 7533s 2025-02-21 01:31:46,978 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Cluster creation timeout; retrying 7533s Traceback (most recent call last): 7533s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 974, in _cluster_factory 7533s s, ws = await start_cluster( 7533s ^^^^^^^^^^^^^^^^^^^^ 7533s ...<9 lines>... 7533s ) 7533s ^ 7533s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 806, in start_cluster 7533s raise TimeoutError("Cluster creation timeout") 7533s TimeoutError: Cluster creation timeout 7533s 2025-02-21 01:31:47,982 - distributed.scheduler - INFO - State start 7533s 2025-02-21 01:31:47,992 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:43543 7533s 2025-02-21 01:31:47,992 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:44349/status 7533s 2025-02-21 01:31:47,992 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7533s 2025-02-21 01:31:48,001 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:37453'. Reason: failure-to-start- 7533s 2025-02-21 01:31:48,002 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:37453' closed. 7533s 2025-02-21 01:31:48,002 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:42693'. Reason: failure-to-start- 7533s 2025-02-21 01:31:48,002 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:42693' closed. 7533s 2025-02-21 01:31:48,002 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43543': TLS handshake failed with remote 'tls://127.0.0.1:53936': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 7533s 2025-02-21 01:31:48,002 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43543': TLS handshake failed with remote 'tls://127.0.0.1:53942': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 7533s 2025-02-21 01:31:48,003 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 7533s Traceback (most recent call last): 7533s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 7533s return await fut 7533s ^^^^^^^^^ 7533s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 7533s comm = await self.rpc.connect(saddr) 7533s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7533s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1485, in connect 7533s return await self._connect(addr=addr, timeout=timeout) 7533s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7533s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1429, in _connect 7533s comm = await connect( 7533s ^^^^^^^^^^^^^^ 7533s ...<4 lines>... 7533s ) 7533s ^ 7533s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7533s comm = await wait_for( 7533s ^^^^^^^^^^^^^^^ 7533s ...<2 lines>... 7533s ) 7533s ^ 7533s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 7533s return await fut 7533s ^^^^^^^^^ 7533s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7533s stream = await self.client.connect( 7533s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7533s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7533s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7533s ) 7533s ^ 7533s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7533s af, addr, stream = await connector.start(connect_timeout=timeout) 7533s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7533s asyncio.exceptions.CancelledError 7533s 7533s The above exception was the direct cause of the following exception: 7533s 7533s Traceback (most recent call last): 7533s File "/usr/lib/python3/dist-packages/distributed/core.py", line 528, in start 7533s await wait_for(self.start_unsafe(), timeout=timeout) 7533s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1913, in wait_for 7533s async with asyncio.timeout(timeout): 7533s ~~~~~~~~~~~~~~~^^^^^^^^^ 7533s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7533s raise TimeoutError from exc_val 7533s TimeoutError 7533s 7533s The above exception was the direct cause of the following exception: 7533s 7533s Traceback (most recent call last): 7533s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 974, in _cluster_factory 7533s s, ws = await start_cluster( 7533s ^^^^^^^^^^^^^^^^^^^^ 7533s ...<9 lines>... 7533s ) 7533s ^ 7533s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 791, in start_cluster 7533s await asyncio.gather(*workers) 7533s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7533s return await awaitable 7533s ^^^^^^^^^^^^^^^ 7533s File "/usr/lib/python3/dist-packages/distributed/core.py", line 531, in start 7533s raise asyncio.TimeoutError( 7533s f"{type(self).__name__} start timed out after {timeout}s." 7533s ) from exc 7533s TimeoutError: Nanny start timed out after 0s. 7533s 2025-02-21 01:31:49,011 - distributed.scheduler - INFO - State start 7533s 2025-02-21 01:31:49,014 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:35357 7533s 2025-02-21 01:31:49,014 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:36213/status 7533s 2025-02-21 01:31:49,014 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7533s 2025-02-21 01:31:49,020 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:43313'. Reason: failure-to-start- 7533s 2025-02-21 01:31:49,021 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:43313' closed. 7533s 2025-02-21 01:31:49,021 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:39627'. Reason: failure-to-start- 7533s 2025-02-21 01:31:49,021 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:39627' closed. 7533s 2025-02-21 01:31:49,021 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35357': TLS handshake failed with remote 'tls://127.0.0.1:40762': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 7533s 2025-02-21 01:31:49,021 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35357': TLS handshake failed with remote 'tls://127.0.0.1:40778': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 7533s 2025-02-21 01:31:49,021 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 7533s Traceback (most recent call last): 7533s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 7533s return await fut 7533s ^^^^^^^^^ 7533s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 7533s comm = await self.rpc.connect(saddr) 7533s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7533s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1485, in connect 7533s return await self._connect(addr=addr, timeout=timeout) 7533s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7533s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1429, in _connect 7533s comm = await connect( 7533s ^^^^^^^^^^^^^^ 7533s ...<4 lines>... 7533s ) 7533s ^ 7533s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7533s comm = await wait_for( 7533s ^^^^^^^^^^^^^^^ 7533s ...<2 lines>... 7533s ) 7533s ^ 7533s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 7533s return await fut 7533s ^^^^^^^^^ 7533s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7533s stream = await self.client.connect( 7533s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7533s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7533s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7533s ) 7533s ^ 7533s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7533s af, addr, stream = await connector.start(connect_timeout=timeout) 7533s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7533s asyncio.exceptions.CancelledError 7533s 7533s The above exception was the direct cause of the following exception: 7533s 7533s Traceback (most recent call last): 7533s File "/usr/lib/python3/dist-packages/distributed/core.py", line 528, in start 7533s await wait_for(self.start_unsafe(), timeout=timeout) 7533s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1913, in wait_for 7533s async with asyncio.timeout(timeout): 7533s ~~~~~~~~~~~~~~~^^^^^^^^^ 7533s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7533s raise TimeoutError from exc_val 7533s TimeoutError 7533s 7533s The above exception was the direct cause of the following exception: 7533s 7533s Traceback (most recent call last): 7533s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 974, in _cluster_factory 7533s s, ws = await start_cluster( 7533s ^^^^^^^^^^^^^^^^^^^^ 7533s ...<9 lines>... 7533s ) 7533s ^ 7533s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 791, in start_cluster 7533s await asyncio.gather(*workers) 7533s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7533s return await awaitable 7533s ^^^^^^^^^^^^^^^ 7533s File "/usr/lib/python3/dist-packages/distributed/core.py", line 531, in start 7533s raise asyncio.TimeoutError( 7533s f"{type(self).__name__} start timed out after {timeout}s." 7533s ) from exc 7533s TimeoutError: Nanny start timed out after 0s. 7533s 2025-02-21 01:31:50,028 - distributed.scheduler - INFO - State start 7533s 2025-02-21 01:31:50,032 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:34757 7533s 2025-02-21 01:31:50,032 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:36947/status 7533s 2025-02-21 01:31:50,033 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7533s 2025-02-21 01:31:50,041 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:42405'. Reason: failure-to-start- 7533s 2025-02-21 01:31:50,042 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:42405' closed. 7533s 2025-02-21 01:31:50,042 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:45217'. Reason: failure-to-start- 7533s 2025-02-21 01:31:50,042 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:45217' closed. 7533s 2025-02-21 01:31:50,042 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34757': TLS handshake failed with remote 'tls://127.0.0.1:56188': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 7533s 2025-02-21 01:31:50,042 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34757': TLS handshake failed with remote 'tls://127.0.0.1:56204': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 7533s 2025-02-21 01:31:50,042 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 7533s Traceback (most recent call last): 7533s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 7533s return await fut 7533s ^^^^^^^^^ 7533s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 7533s comm = await self.rpc.connect(saddr) 7533s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7533s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1485, in connect 7533s return await self._connect(addr=addr, timeout=timeout) 7533s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7533s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1429, in _connect 7533s comm = await connect( 7533s ^^^^^^^^^^^^^^ 7533s ...<4 lines>... 7533s ) 7533s ^ 7533s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7533s comm = await wait_for( 7533s ^^^^^^^^^^^^^^^ 7533s ...<2 lines>... 7533s ) 7533s ^ 7533s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 7533s return await fut 7533s ^^^^^^^^^ 7533s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7533s stream = await self.client.connect( 7533s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7533s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7533s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7533s ) 7533s ^ 7533s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7533s af, addr, stream = await connector.start(connect_timeout=timeout) 7533s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7533s asyncio.exceptions.CancelledError 7533s 7533s The above exception was the direct cause of the following exception: 7533s 7533s Traceback (most recent call last): 7533s File "/usr/lib/python3/dist-packages/distributed/core.py", line 528, in start 7533s await wait_for(self.start_unsafe(), timeout=timeout) 7533s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1913, in wait_for 7533s async with asyncio.timeout(timeout): 7533s ~~~~~~~~~~~~~~~^^^^^^^^^ 7533s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7533s raise TimeoutError from exc_val 7533s TimeoutError 7533s 7533s The above exception was the direct cause of the following exception: 7533s 7533s Traceback (most recent call last): 7533s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 974, in _cluster_factory 7533s s, ws = await start_cluster( 7533s ^^^^^^^^^^^^^^^^^^^^ 7533s ...<9 lines>... 7533s ) 7533s ^ 7533s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 791, in start_cluster 7533s await asyncio.gather(*workers) 7533s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7533s return await awaitable 7533s ^^^^^^^^^^^^^^^ 7533s File "/usr/lib/python3/dist-packages/distributed/core.py", line 531, in start 7533s raise asyncio.TimeoutError( 7533s f"{type(self).__name__} start timed out after {timeout}s." 7533s ) from exc 7533s TimeoutError: Nanny start timed out after 0s. 7533s 2025-02-21 01:31:51,048 - distributed.scheduler - INFO - State start 7533s 2025-02-21 01:31:51,051 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:46053 7533s 2025-02-21 01:31:51,051 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:33603/status 7533s 2025-02-21 01:31:51,051 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7533s 2025-02-21 01:31:51,059 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:44593'. Reason: failure-to-start- 7533s 2025-02-21 01:31:51,059 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:44593' closed. 7533s 2025-02-21 01:31:51,059 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:45787'. Reason: failure-to-start- 7533s 2025-02-21 01:31:51,059 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:45787' closed. 7533s 2025-02-21 01:31:51,059 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46053': TLS handshake failed with remote 'tls://127.0.0.1:40394': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 7533s 2025-02-21 01:31:51,059 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46053': TLS handshake failed with remote 'tls://127.0.0.1:40404': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 7533s 2025-02-21 01:31:51,059 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 7533s Traceback (most recent call last): 7533s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 7533s return await fut 7533s ^^^^^^^^^ 7533s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 7533s comm = await self.rpc.connect(saddr) 7533s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7533s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1485, in connect 7533s return await self._connect(addr=addr, timeout=timeout) 7533s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7533s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1429, in _connect 7533s comm = await connect( 7533s ^^^^^^^^^^^^^^ 7533s ...<4 lines>... 7533s ) 7533s ^ 7533s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7533s comm = await wait_for( 7533s ^^^^^^^^^^^^^^^ 7533s ...<2 lines>... 7533s ) 7533s ^ 7533s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 7533s return await fut 7533s ^^^^^^^^^ 7533s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7533s stream = await self.client.connect( 7533s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7533s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7533s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7533s ) 7533s ^ 7533s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7533s af, addr, stream = await connector.start(connect_timeout=timeout) 7533s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7533s asyncio.exceptions.CancelledError 7533s 7533s The above exception was the direct cause of the following exception: 7533s 7533s Traceback (most recent call last): 7533s File "/usr/lib/python3/dist-packages/distributed/core.py", line 528, in start 7533s await wait_for(self.start_unsafe(), timeout=timeout) 7533s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1913, in wait_for 7533s async with asyncio.timeout(timeout): 7533s ~~~~~~~~~~~~~~~^^^^^^^^^ 7533s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7533s raise TimeoutError from exc_val 7533s TimeoutError 7533s 7533s The above exception was the direct cause of the following exception: 7533s 7533s Traceback (most recent call last): 7533s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 974, in _cluster_factory 7533s s, ws = await start_cluster( 7533s ^^^^^^^^^^^^^^^^^^^^ 7533s ...<9 lines>... 7533s ) 7533s ^ 7533s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 791, in start_cluster 7533s await asyncio.gather(*workers) 7533s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7533s return await awaitable 7533s ^^^^^^^^^^^^^^^ 7533s File "/usr/lib/python3/dist-packages/distributed/core.py", line 531, in start 7533s raise asyncio.TimeoutError( 7533s f"{type(self).__name__} start timed out after {timeout}s." 7533s ) from exc 7533s TimeoutError: Nanny start timed out after 0s. 7533s 2025-02-21 01:31:52,065 - distributed.scheduler - INFO - State start 7533s 2025-02-21 01:31:52,071 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:41045 7533s 2025-02-21 01:31:52,071 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:33251/status 7533s 2025-02-21 01:31:52,071 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7533s 2025-02-21 01:31:52,079 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:43383'. Reason: failure-to-start- 7533s 2025-02-21 01:31:52,079 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:43383' closed. 7533s 2025-02-21 01:31:52,079 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:34137'. Reason: failure-to-start- 7533s 2025-02-21 01:31:52,079 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:34137' closed. 7533s 2025-02-21 01:31:52,080 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41045': TLS handshake failed with remote 'tls://127.0.0.1:52588': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 7533s 2025-02-21 01:31:52,080 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41045': TLS handshake failed with remote 'tls://127.0.0.1:52602': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 7533s 2025-02-21 01:31:52,080 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 7533s Traceback (most recent call last): 7533s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 7533s return await fut 7533s ^^^^^^^^^ 7533s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 7533s comm = await self.rpc.connect(saddr) 7533s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7533s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1485, in connect 7533s return await self._connect(addr=addr, timeout=timeout) 7533s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7533s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1429, in _connect 7533s comm = await connect( 7533s ^^^^^^^^^^^^^^ 7533s ...<4 lines>... 7533s ) 7533s ^ 7533s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7533s comm = await wait_for( 7533s ^^^^^^^^^^^^^^^ 7533s ...<2 lines>... 7533s ) 7533s ^ 7533s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 7533s return await fut 7533s ^^^^^^^^^ 7533s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7533s stream = await self.client.connect( 7533s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7533s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7533s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7533s ) 7533s ^ 7533s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7533s af, addr, stream = await connector.start(connect_timeout=timeout) 7533s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7533s asyncio.exceptions.CancelledError 7533s 7533s The above exception was the direct cause of the following exception: 7533s 7533s Traceback (most recent call last): 7533s File "/usr/lib/python3/dist-packages/distributed/core.py", line 528, in start 7533s await wait_for(self.start_unsafe(), timeout=timeout) 7533s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1913, in wait_for 7533s async with asyncio.timeout(timeout): 7533s ~~~~~~~~~~~~~~~^^^^^^^^^ 7533s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7533s raise TimeoutError from exc_val 7533s TimeoutError 7533s 7533s The above exception was the direct cause of the following exception: 7533s 7533s Traceback (most recent call last): 7533s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 974, in _cluster_factory 7533s s, ws = await start_cluster( 7533s ^^^^^^^^^^^^^^^^^^^^ 7533s ...<9 lines>... 7533s ) 7533s ^ 7533s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 791, in start_cluster 7533s await asyncio.gather(*workers) 7533s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7533s return await awaitable 7533s ^^^^^^^^^^^^^^^ 7533s File "/usr/lib/python3/dist-packages/distributed/core.py", line 531, in start 7533s raise asyncio.TimeoutError( 7533s f"{type(self).__name__} start timed out after {timeout}s." 7533s ) from exc 7533s TimeoutError: Nanny start timed out after 0s. 7533s 2025-02-21 01:31:53,087 - distributed.scheduler - INFO - State start 7533s 2025-02-21 01:31:53,093 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:43539 7533s 2025-02-21 01:31:53,093 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:46349/status 7533s 2025-02-21 01:31:53,093 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7533s 2025-02-21 01:31:53,104 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:42207'. Reason: failure-to-start- 7533s 2025-02-21 01:31:53,104 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:42207' closed. 7533s 2025-02-21 01:31:53,104 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:45839'. Reason: failure-to-start- 7533s 2025-02-21 01:31:53,104 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:45839' closed. 7533s 2025-02-21 01:31:53,105 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43539': TLS handshake failed with remote 'tls://127.0.0.1:50126': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 7533s 2025-02-21 01:31:53,105 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43539': TLS handshake failed with remote 'tls://127.0.0.1:50134': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 7533s 2025-02-21 01:31:53,105 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 7533s Traceback (most recent call last): 7533s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 7533s return await fut 7533s ^^^^^^^^^ 7533s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 7533s comm = await self.rpc.connect(saddr) 7533s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7533s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1485, in connect 7533s return await self._connect(addr=addr, timeout=timeout) 7533s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7533s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1429, in _connect 7533s comm = await connect( 7533s ^^^^^^^^^^^^^^ 7533s ...<4 lines>... 7533s ) 7533s ^ 7533s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7533s comm = await wait_for( 7533s ^^^^^^^^^^^^^^^ 7533s ...<2 lines>... 7533s ) 7533s ^ 7533s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 7533s return await fut 7533s ^^^^^^^^^ 7533s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7533s stream = await self.client.connect( 7533s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7533s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7533s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7533s ) 7533s ^ 7533s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7533s af, addr, stream = await connector.start(connect_timeout=timeout) 7533s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7533s asyncio.exceptions.CancelledError 7533s 7533s The above exception was the direct cause of the following exception: 7533s 7533s Traceback (most recent call last): 7533s File "/usr/lib/python3/dist-packages/distributed/core.py", line 528, in start 7533s await wait_for(self.start_unsafe(), timeout=timeout) 7533s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1913, in wait_for 7533s async with asyncio.timeout(timeout): 7533s ~~~~~~~~~~~~~~~^^^^^^^^^ 7533s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7533s raise TimeoutError from exc_val 7533s TimeoutError 7533s 7533s The above exception was the direct cause of the following exception: 7533s 7533s Traceback (most recent call last): 7533s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 974, in _cluster_factory 7533s s, ws = await start_cluster( 7533s ^^^^^^^^^^^^^^^^^^^^ 7533s ...<9 lines>... 7533s ) 7533s ^ 7533s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 791, in start_cluster 7533s await asyncio.gather(*workers) 7533s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7533s return await awaitable 7533s ^^^^^^^^^^^^^^^ 7533s File "/usr/lib/python3/dist-packages/distributed/core.py", line 531, in start 7533s raise asyncio.TimeoutError( 7533s f"{type(self).__name__} start timed out after {timeout}s." 7533s ) from exc 7533s TimeoutError: Nanny start timed out after 0s. 7533s 2025-02-21 01:31:54,112 - distributed.scheduler - INFO - State start 7533s 2025-02-21 01:31:54,118 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:43955 7533s 2025-02-21 01:31:54,118 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:46473/status 7533s 2025-02-21 01:31:54,118 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7533s 2025-02-21 01:31:54,128 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:36345'. Reason: failure-to-start- 7533s 2025-02-21 01:31:54,128 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:36345' closed. 7533s 2025-02-21 01:31:54,128 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:40711'. Reason: failure-to-start- 7533s 2025-02-21 01:31:54,128 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:40711' closed. 7533s 2025-02-21 01:31:54,129 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43955': TLS handshake failed with remote 'tls://127.0.0.1:37164': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 7533s 2025-02-21 01:31:54,129 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43955': TLS handshake failed with remote 'tls://127.0.0.1:37178': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 7533s 2025-02-21 01:31:54,129 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 7533s Traceback (most recent call last): 7533s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 7533s return await fut 7533s ^^^^^^^^^ 7533s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 7533s comm = await self.rpc.connect(saddr) 7533s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7533s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1485, in connect 7533s return await self._connect(addr=addr, timeout=timeout) 7533s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7533s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1429, in _connect 7533s comm = await connect( 7533s ^^^^^^^^^^^^^^ 7533s ...<4 lines>... 7533s ) 7533s ^ 7533s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7533s comm = await wait_for( 7533s ^^^^^^^^^^^^^^^ 7533s ...<2 lines>... 7533s ) 7533s ^ 7533s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 7533s return await fut 7533s ^^^^^^^^^ 7533s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7533s stream = await self.client.connect( 7533s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7533s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7533s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7533s ) 7533s ^ 7533s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7533s af, addr, stream = await connector.start(connect_timeout=timeout) 7533s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7533s asyncio.exceptions.CancelledError 7533s 7533s The above exception was the direct cause of the following exception: 7533s 7533s Traceback (most recent call last): 7533s File "/usr/lib/python3/dist-packages/distributed/core.py", line 528, in start 7533s await wait_for(self.start_unsafe(), timeout=timeout) 7533s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1913, in wait_for 7533s async with asyncio.timeout(timeout): 7533s ~~~~~~~~~~~~~~~^^^^^^^^^ 7533s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7533s raise TimeoutError from exc_val 7533s TimeoutError 7533s 7533s The above exception was the direct cause of the following exception: 7533s 7533s Traceback (most recent call last): 7533s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 974, in _cluster_factory 7533s s, ws = await start_cluster( 7533s ^^^^^^^^^^^^^^^^^^^^ 7533s ...<9 lines>... 7533s ) 7533s ^ 7533s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 791, in start_cluster 7533s await asyncio.gather(*workers) 7533s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7533s return await awaitable 7533s ^^^^^^^^^^^^^^^ 7533s File "/usr/lib/python3/dist-packages/distributed/core.py", line 531, in start 7533s raise asyncio.TimeoutError( 7533s f"{type(self).__name__} start timed out after {timeout}s." 7533s ) from exc 7533s TimeoutError: Nanny start timed out after 0s. 7533s 2025-02-21 01:31:55,135 - distributed.scheduler - INFO - State start 7533s 2025-02-21 01:31:55,139 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:39993 7533s 2025-02-21 01:31:55,139 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:36863/status 7533s 2025-02-21 01:31:55,140 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7533s 2025-02-21 01:31:55,146 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:38335'. Reason: failure-to-start- 7533s 2025-02-21 01:31:55,147 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:38335' closed. 7533s 2025-02-21 01:31:55,147 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:43477'. Reason: failure-to-start- 7533s 2025-02-21 01:31:55,147 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:43477' closed. 7533s 2025-02-21 01:31:55,147 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39993': TLS handshake failed with remote 'tls://127.0.0.1:33602': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 7533s 2025-02-21 01:31:55,147 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39993': TLS handshake failed with remote 'tls://127.0.0.1:33618': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 7533s 2025-02-21 01:31:55,147 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 7533s Traceback (most recent call last): 7533s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 7533s return await fut 7533s ^^^^^^^^^ 7533s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 7533s comm = await self.rpc.connect(saddr) 7533s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7533s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1485, in connect 7533s return await self._connect(addr=addr, timeout=timeout) 7533s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7533s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1429, in _connect 7533s comm = await connect( 7533s ^^^^^^^^^^^^^^ 7533s ...<4 lines>... 7533s ) 7533s ^ 7533s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7533s comm = await wait_for( 7533s ^^^^^^^^^^^^^^^ 7533s ...<2 lines>... 7533s ) 7533s ^ 7533s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 7533s return await fut 7533s ^^^^^^^^^ 7533s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7533s stream = await self.client.connect( 7533s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7533s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7533s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7533s ) 7533s ^ 7533s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7533s af, addr, stream = await connector.start(connect_timeout=timeout) 7533s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7533s asyncio.exceptions.CancelledError 7533s 7533s The above exception was the direct cause of the following exception: 7533s 7533s Traceback (most recent call last): 7533s File "/usr/lib/python3/dist-packages/distributed/core.py", line 528, in start 7533s await wait_for(self.start_unsafe(), timeout=timeout) 7533s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1913, in wait_for 7533s async with asyncio.timeout(timeout): 7533s ~~~~~~~~~~~~~~~^^^^^^^^^ 7533s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7533s raise TimeoutError from exc_val 7533s TimeoutError 7533s 7533s The above exception was the direct cause of the following exception: 7533s 7533s Traceback (most recent call last): 7533s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 974, in _cluster_factory 7533s s, ws = await start_cluster( 7533s ^^^^^^^^^^^^^^^^^^^^ 7533s ...<9 lines>... 7533s ) 7533s ^ 7533s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 791, in start_cluster 7533s await asyncio.gather(*workers) 7533s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7533s return await awaitable 7533s ^^^^^^^^^^^^^^^ 7533s File "/usr/lib/python3/dist-packages/distributed/core.py", line 531, in start 7533s raise asyncio.TimeoutError( 7533s f"{type(self).__name__} start timed out after {timeout}s." 7533s ) from exc 7533s TimeoutError: Nanny start timed out after 0s. 7533s 2025-02-21 01:31:56,158 - distributed.scheduler - INFO - State start 7533s 2025-02-21 01:31:56,164 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:39547 7533s 2025-02-21 01:31:56,164 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:38731/status 7533s 2025-02-21 01:31:56,164 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7533s 2025-02-21 01:31:56,172 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:41295'. Reason: failure-to-start- 7533s 2025-02-21 01:31:56,172 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:41295' closed. 7533s 2025-02-21 01:31:56,172 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:39203'. Reason: failure-to-start- 7533s 2025-02-21 01:31:56,172 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:39203' closed. 7533s 2025-02-21 01:31:56,172 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39547': TLS handshake failed with remote 'tls://127.0.0.1:53508': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 7533s 2025-02-21 01:31:56,172 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39547': TLS handshake failed with remote 'tls://127.0.0.1:53514': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 7533s 2025-02-21 01:31:56,173 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 7533s Traceback (most recent call last): 7533s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 7533s return await fut 7533s ^^^^^^^^^ 7533s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 7533s comm = await self.rpc.connect(saddr) 7533s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7533s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1485, in connect 7533s return await self._connect(addr=addr, timeout=timeout) 7533s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7533s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1429, in _connect 7533s comm = await connect( 7533s ^^^^^^^^^^^^^^ 7533s ...<4 lines>... 7533s ) 7533s ^ 7533s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7533s comm = await wait_for( 7533s ^^^^^^^^^^^^^^^ 7533s ...<2 lines>... 7533s ) 7533s ^ 7533s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 7533s return await fut 7533s ^^^^^^^^^ 7533s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7533s stream = await self.client.connect( 7533s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7533s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7533s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7533s ) 7533s ^ 7533s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7533s af, addr, stream = await connector.start(connect_timeout=timeout) 7533s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7533s asyncio.exceptions.CancelledError 7533s 7533s The above exception was the direct cause of the following exception: 7533s 7533s Traceback (most recent call last): 7533s File "/usr/lib/python3/dist-packages/distributed/core.py", line 528, in start 7533s await wait_for(self.start_unsafe(), timeout=timeout) 7533s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1913, in wait_for 7533s async with asyncio.timeout(timeout): 7533s ~~~~~~~~~~~~~~~^^^^^^^^^ 7533s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7533s raise TimeoutError from exc_val 7533s TimeoutError 7533s 7533s The above exception was the direct cause of the following exception: 7533s 7533s Traceback (most recent call last): 7533s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 974, in _cluster_factory 7533s s, ws = await start_cluster( 7533s ^^^^^^^^^^^^^^^^^^^^ 7533s ...<9 lines>... 7533s ) 7533s ^ 7533s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 791, in start_cluster 7533s await asyncio.gather(*workers) 7533s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7533s return await awaitable 7533s ^^^^^^^^^^^^^^^ 7533s File "/usr/lib/python3/dist-packages/distributed/core.py", line 531, in start 7533s raise asyncio.TimeoutError( 7533s f"{type(self).__name__} start timed out after {timeout}s." 7533s ) from exc 7533s TimeoutError: Nanny start timed out after 0s. 7533s 2025-02-21 01:31:57,179 - distributed.scheduler - INFO - State start 7533s 2025-02-21 01:31:57,184 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:45715 7533s 2025-02-21 01:31:57,184 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:35327/status 7533s 2025-02-21 01:31:57,184 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7533s 2025-02-21 01:31:57,192 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:39831'. Reason: failure-to-start- 7533s 2025-02-21 01:31:57,193 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:39831' closed. 7533s 2025-02-21 01:31:57,193 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:40241'. Reason: failure-to-start- 7533s 2025-02-21 01:31:57,193 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:40241' closed. 7533s 2025-02-21 01:31:57,194 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45715': TLS handshake failed with remote 'tls://127.0.0.1:47616': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 7533s 2025-02-21 01:31:57,194 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45715': TLS handshake failed with remote 'tls://127.0.0.1:47630': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 7533s 2025-02-21 01:31:57,194 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 7533s Traceback (most recent call last): 7533s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 7533s return await fut 7533s ^^^^^^^^^ 7533s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 7533s comm = await self.rpc.connect(saddr) 7533s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7533s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1485, in connect 7533s return await self._connect(addr=addr, timeout=timeout) 7533s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7533s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1429, in _connect 7533s comm = await connect( 7533s ^^^^^^^^^^^^^^ 7533s ...<4 lines>... 7533s ) 7533s ^ 7533s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7533s comm = await wait_for( 7533s ^^^^^^^^^^^^^^^ 7533s ...<2 lines>... 7533s ) 7533s ^ 7533s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 7533s return await fut 7533s ^^^^^^^^^ 7533s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7533s stream = await self.client.connect( 7533s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7533s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7533s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7533s ) 7533s ^ 7533s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7533s af, addr, stream = await connector.start(connect_timeout=timeout) 7533s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7533s asyncio.exceptions.CancelledError 7533s 7533s The above exception was the direct cause of the following exception: 7533s 7533s Traceback (most recent call last): 7533s File "/usr/lib/python3/dist-packages/distributed/core.py", line 528, in start 7533s await wait_for(self.start_unsafe(), timeout=timeout) 7533s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1913, in wait_for 7533s async with asyncio.timeout(timeout): 7533s ~~~~~~~~~~~~~~~^^^^^^^^^ 7533s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7533s raise TimeoutError from exc_val 7533s TimeoutError 7533s 7533s The above exception was the direct cause of the following exception: 7533s 7533s Traceback (most recent call last): 7533s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 974, in _cluster_factory 7533s s, ws = await start_cluster( 7533s ^^^^^^^^^^^^^^^^^^^^ 7533s ...<9 lines>... 7533s ) 7533s ^ 7533s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 791, in start_cluster 7533s await asyncio.gather(*workers) 7533s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7533s return await awaitable 7533s ^^^^^^^^^^^^^^^ 7533s File "/usr/lib/python3/dist-packages/distributed/core.py", line 531, in start 7533s raise asyncio.TimeoutError( 7533s f"{type(self).__name__} start timed out after {timeout}s." 7533s ) from exc 7533s TimeoutError: Nanny start timed out after 0s. 7533s 2025-02-21 01:31:58,199 - distributed.scheduler - INFO - State start 7533s 2025-02-21 01:31:58,204 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:35559 7533s 2025-02-21 01:31:58,210 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:39351/status 7533s 2025-02-21 01:31:58,210 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7533s 2025-02-21 01:31:58,220 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:37553'. Reason: failure-to-start- 7533s 2025-02-21 01:31:58,220 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:37553' closed. 7533s 2025-02-21 01:31:58,220 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:38383'. Reason: failure-to-start- 7533s 2025-02-21 01:31:58,220 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:38383' closed. 7533s 2025-02-21 01:31:58,221 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35559': TLS handshake failed with remote 'tls://127.0.0.1:54194': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 7533s 2025-02-21 01:31:58,221 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35559': TLS handshake failed with remote 'tls://127.0.0.1:54198': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 7533s 2025-02-21 01:31:58,221 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 7533s Traceback (most recent call last): 7533s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 7533s return await fut 7533s ^^^^^^^^^ 7533s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 7533s comm = await self.rpc.connect(saddr) 7533s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7533s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1485, in connect 7533s return await self._connect(addr=addr, timeout=timeout) 7533s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7533s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1429, in _connect 7533s comm = await connect( 7533s ^^^^^^^^^^^^^^ 7533s ...<4 lines>... 7533s ) 7533s ^ 7533s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7533s comm = await wait_for( 7533s ^^^^^^^^^^^^^^^ 7533s ...<2 lines>... 7533s ) 7533s ^ 7533s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 7533s return await fut 7533s ^^^^^^^^^ 7533s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7533s stream = await self.client.connect( 7533s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7533s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7533s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7533s ) 7533s ^ 7533s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7533s af, addr, stream = await connector.start(connect_timeout=timeout) 7533s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7533s asyncio.exceptions.CancelledError 7533s 7533s The above exception was the direct cause of the following exception: 7533s 7533s Traceback (most recent call last): 7533s File "/usr/lib/python3/dist-packages/distributed/core.py", line 528, in start 7533s await wait_for(self.start_unsafe(), timeout=timeout) 7533s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1913, in wait_for 7533s async with asyncio.timeout(timeout): 7533s ~~~~~~~~~~~~~~~^^^^^^^^^ 7533s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7533s raise TimeoutError from exc_val 7533s TimeoutError 7533s 7533s The above exception was the direct cause of the following exception: 7533s 7533s Traceback (most recent call last): 7533s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 974, in _cluster_factory 7533s s, ws = await start_cluster( 7533s ^^^^^^^^^^^^^^^^^^^^ 7533s ...<9 lines>... 7533s ) 7533s ^ 7533s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 791, in start_cluster 7533s await asyncio.gather(*workers) 7533s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7533s return await awaitable 7533s ^^^^^^^^^^^^^^^ 7533s File "/usr/lib/python3/dist-packages/distributed/core.py", line 531, in start 7533s raise asyncio.TimeoutError( 7533s f"{type(self).__name__} start timed out after {timeout}s." 7533s ) from exc 7533s TimeoutError: Nanny start timed out after 0s. 7533s 2025-02-21 01:31:59,229 - distributed.scheduler - INFO - State start 7533s 2025-02-21 01:31:59,233 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:35683 7533s 2025-02-21 01:31:59,233 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:40337/status 7533s 2025-02-21 01:31:59,233 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7533s 2025-02-21 01:31:59,242 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:33261'. Reason: failure-to-start- 7533s 2025-02-21 01:31:59,242 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:33261' closed. 7533s 2025-02-21 01:31:59,242 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:33607'. Reason: failure-to-start- 7533s 2025-02-21 01:31:59,242 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:33607' closed. 7533s 2025-02-21 01:31:59,243 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35683': TLS handshake failed with remote 'tls://127.0.0.1:55336': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 7533s 2025-02-21 01:31:59,243 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35683': TLS handshake failed with remote 'tls://127.0.0.1:55346': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 7533s 2025-02-21 01:31:59,243 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 7533s Traceback (most recent call last): 7533s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 7533s return await fut 7533s ^^^^^^^^^ 7533s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 7533s comm = await self.rpc.connect(saddr) 7533s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7533s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1485, in connect 7533s return await self._connect(addr=addr, timeout=timeout) 7533s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7533s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1429, in _connect 7533s comm = await connect( 7533s ^^^^^^^^^^^^^^ 7533s ...<4 lines>... 7533s ) 7533s ^ 7533s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7533s comm = await wait_for( 7533s ^^^^^^^^^^^^^^^ 7533s ...<2 lines>... 7533s ) 7533s ^ 7533s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 7533s return await fut 7533s ^^^^^^^^^ 7533s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7533s stream = await self.client.connect( 7533s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7533s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7533s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7533s ) 7533s ^ 7533s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7533s af, addr, stream = await connector.start(connect_timeout=timeout) 7533s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7533s asyncio.exceptions.CancelledError 7533s 7533s The above exception was the direct cause of the following exception: 7533s 7533s Traceback (most recent call last): 7533s File "/usr/lib/python3/dist-packages/distributed/core.py", line 528, in start 7533s await wait_for(self.start_unsafe(), timeout=timeout) 7533s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1913, in wait_for 7533s async with asyncio.timeout(timeout): 7533s ~~~~~~~~~~~~~~~^^^^^^^^^ 7533s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7533s raise TimeoutError from exc_val 7533s TimeoutError 7533s 7533s The above exception was the direct cause of the following exception: 7533s 7533s Traceback (most recent call last): 7533s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 974, in _cluster_factory 7533s s, ws = await start_cluster( 7533s ^^^^^^^^^^^^^^^^^^^^ 7533s ...<9 lines>... 7533s ) 7533s ^ 7533s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 791, in start_cluster 7533s await asyncio.gather(*workers) 7533s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7533s return await awaitable 7533s ^^^^^^^^^^^^^^^ 7533s File "/usr/lib/python3/dist-packages/distributed/core.py", line 531, in start 7533s raise asyncio.TimeoutError( 7533s f"{type(self).__name__} start timed out after {timeout}s." 7533s ) from exc 7533s TimeoutError: Nanny start timed out after 0s. 7533s 2025-02-21 01:32:00,248 - distributed.scheduler - INFO - State start 7533s 2025-02-21 01:32:00,252 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:34593 7533s 2025-02-21 01:32:00,252 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:37771/status 7533s 2025-02-21 01:32:00,253 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7533s 2025-02-21 01:32:00,272 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:46633'. Reason: failure-to-start- 7533s 2025-02-21 01:32:00,272 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:46633' closed. 7533s 2025-02-21 01:32:00,273 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:36389'. Reason: failure-to-start- 7533s 2025-02-21 01:32:00,273 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:36389' closed. 7533s 2025-02-21 01:32:00,273 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34593': TLS handshake failed with remote 'tls://127.0.0.1:57874': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 7533s 2025-02-21 01:32:00,273 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34593': TLS handshake failed with remote 'tls://127.0.0.1:57890': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 7533s 2025-02-21 01:32:00,273 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 7533s Traceback (most recent call last): 7533s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 7533s return await fut 7533s ^^^^^^^^^ 7533s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 7533s comm = await self.rpc.connect(saddr) 7533s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7533s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1485, in connect 7533s return await self._connect(addr=addr, timeout=timeout) 7533s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7533s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1429, in _connect 7533s comm = await connect( 7533s ^^^^^^^^^^^^^^ 7533s ...<4 lines>... 7533s ) 7533s ^ 7533s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7533s comm = await wait_for( 7533s ^^^^^^^^^^^^^^^ 7533s ...<2 lines>... 7533s ) 7533s ^ 7533s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 7533s return await fut 7533s ^^^^^^^^^ 7533s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7533s stream = await self.client.connect( 7533s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7533s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7533s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7533s ) 7533s ^ 7533s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7533s af, addr, stream = await connector.start(connect_timeout=timeout) 7533s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7533s asyncio.exceptions.CancelledError 7533s 7533s The above exception was the direct cause of the following exception: 7533s 7533s Traceback (most recent call last): 7533s File "/usr/lib/python3/dist-packages/distributed/core.py", line 528, in start 7533s await wait_for(self.start_unsafe(), timeout=timeout) 7533s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1913, in wait_for 7533s async with asyncio.timeout(timeout): 7533s ~~~~~~~~~~~~~~~^^^^^^^^^ 7533s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7533s raise TimeoutError from exc_val 7533s TimeoutError 7533s 7533s The above exception was the direct cause of the following exception: 7533s 7533s Traceback (most recent call last): 7533s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 974, in _cluster_factory 7533s s, ws = await start_cluster( 7533s ^^^^^^^^^^^^^^^^^^^^ 7533s ...<9 lines>... 7533s ) 7533s ^ 7533s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 791, in start_cluster 7533s await asyncio.gather(*workers) 7533s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7533s return await awaitable 7533s ^^^^^^^^^^^^^^^ 7533s File "/usr/lib/python3/dist-packages/distributed/core.py", line 531, in start 7533s raise asyncio.TimeoutError( 7533s f"{type(self).__name__} start timed out after {timeout}s." 7533s ) from exc 7533s TimeoutError: Nanny start timed out after 0s. 7533s 2025-02-21 01:32:01,279 - distributed.scheduler - INFO - State start 7533s 2025-02-21 01:32:01,284 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:35617 7533s 2025-02-21 01:32:01,284 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:43045/status 7533s 2025-02-21 01:32:01,284 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7533s 2025-02-21 01:32:01,291 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:41861'. Reason: failure-to-start- 7533s 2025-02-21 01:32:01,291 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:41861' closed. 7533s 2025-02-21 01:32:01,292 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:39549'. Reason: failure-to-start- 7533s 2025-02-21 01:32:01,292 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:39549' closed. 7533s 2025-02-21 01:32:01,292 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35617': TLS handshake failed with remote 'tls://127.0.0.1:48098': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 7533s 2025-02-21 01:32:01,292 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35617': TLS handshake failed with remote 'tls://127.0.0.1:48112': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 7533s 2025-02-21 01:32:01,292 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 7533s Traceback (most recent call last): 7533s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 7533s return await fut 7533s ^^^^^^^^^ 7533s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 7533s comm = await self.rpc.connect(saddr) 7533s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7533s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1485, in connect 7533s return await self._connect(addr=addr, timeout=timeout) 7533s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7533s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1429, in _connect 7533s comm = await connect( 7533s ^^^^^^^^^^^^^^ 7533s ...<4 lines>... 7533s ) 7533s ^ 7533s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7533s comm = await wait_for( 7533s ^^^^^^^^^^^^^^^ 7533s ...<2 lines>... 7533s ) 7533s ^ 7533s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 7533s return await fut 7533s ^^^^^^^^^ 7533s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7533s stream = await self.client.connect( 7533s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7533s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7533s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7533s ) 7533s ^ 7533s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7533s af, addr, stream = await connector.start(connect_timeout=timeout) 7533s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7533s asyncio.exceptions.CancelledError 7533s 7533s The above exception was the direct cause of the following exception: 7533s 7533s Traceback (most recent call last): 7533s File "/usr/lib/python3/dist-packages/distributed/core.py", line 528, in start 7533s await wait_for(self.start_unsafe(), timeout=timeout) 7533s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1913, in wait_for 7533s async with asyncio.timeout(timeout): 7533s ~~~~~~~~~~~~~~~^^^^^^^^^ 7533s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7533s raise TimeoutError from exc_val 7533s TimeoutError 7533s 7533s The above exception was the direct cause of the following exception: 7533s 7533s Traceback (most recent call last): 7533s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 974, in _cluster_factory 7533s s, ws = await start_cluster( 7533s ^^^^^^^^^^^^^^^^^^^^ 7533s ...<9 lines>... 7533s ) 7533s ^ 7533s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 791, in start_cluster 7533s await asyncio.gather(*workers) 7533s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7533s return await awaitable 7533s ^^^^^^^^^^^^^^^ 7533s File "/usr/lib/python3/dist-packages/distributed/core.py", line 531, in start 7533s raise asyncio.TimeoutError( 7533s f"{type(self).__name__} start timed out after {timeout}s." 7533s ) from exc 7533s TimeoutError: Nanny start timed out after 0s. 7533s 2025-02-21 01:32:02,299 - distributed.scheduler - INFO - State start 7533s 2025-02-21 01:32:02,304 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44433 7533s 2025-02-21 01:32:02,304 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:38981/status 7533s 2025-02-21 01:32:02,305 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7533s 2025-02-21 01:32:02,317 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:39611'. Reason: failure-to-start- 7533s 2025-02-21 01:32:02,318 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:39611' closed. 7533s 2025-02-21 01:32:02,318 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:37965'. Reason: failure-to-start- 7533s 2025-02-21 01:32:02,318 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:37965' closed. 7533s 2025-02-21 01:32:02,319 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44433': TLS handshake failed with remote 'tls://127.0.0.1:49410': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 7533s 2025-02-21 01:32:02,319 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44433': TLS handshake failed with remote 'tls://127.0.0.1:49414': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 7533s 2025-02-21 01:32:02,319 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 7533s Traceback (most recent call last): 7533s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 7533s return await fut 7533s ^^^^^^^^^ 7533s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 7533s comm = await self.rpc.connect(saddr) 7533s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7533s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1485, in connect 7533s return await self._connect(addr=addr, timeout=timeout) 7533s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7533s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1429, in _connect 7533s comm = await connect( 7533s ^^^^^^^^^^^^^^ 7533s ...<4 lines>... 7533s ) 7533s ^ 7533s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7533s comm = await wait_for( 7533s ^^^^^^^^^^^^^^^ 7533s ...<2 lines>... 7533s ) 7533s ^ 7533s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 7533s return await fut 7533s ^^^^^^^^^ 7533s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7533s stream = await self.client.connect( 7533s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7533s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7533s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7533s ) 7533s ^ 7533s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7533s af, addr, stream = await connector.start(connect_timeout=timeout) 7533s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7533s asyncio.exceptions.CancelledError 7533s 7533s The above exception was the direct cause of the following exception: 7533s 7533s Traceback (most recent call last): 7533s File "/usr/lib/python3/dist-packages/distributed/core.py", line 528, in start 7533s await wait_for(self.start_unsafe(), timeout=timeout) 7533s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1913, in wait_for 7533s async with asyncio.timeout(timeout): 7533s ~~~~~~~~~~~~~~~^^^^^^^^^ 7533s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7533s raise TimeoutError from exc_val 7533s TimeoutError 7533s 7533s The above exception was the direct cause of the following exception: 7533s 7533s Traceback (most recent call last): 7533s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 974, in _cluster_factory 7533s s, ws = await start_cluster( 7533s ^^^^^^^^^^^^^^^^^^^^ 7533s ...<9 lines>... 7533s ) 7533s ^ 7533s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 791, in start_cluster 7533s await asyncio.gather(*workers) 7533s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7533s return await awaitable 7533s ^^^^^^^^^^^^^^^ 7533s File "/usr/lib/python3/dist-packages/distributed/core.py", line 531, in start 7533s raise asyncio.TimeoutError( 7533s f"{type(self).__name__} start timed out after {timeout}s." 7533s ) from exc 7533s TimeoutError: Nanny start timed out after 0s. 7533s 2025-02-21 01:32:03,327 - distributed.scheduler - INFO - State start 7533s 2025-02-21 01:32:03,334 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:40867 7533s 2025-02-21 01:32:03,334 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:32863/status 7533s 2025-02-21 01:32:03,334 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7533s 2025-02-21 01:32:03,351 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:34137'. Reason: failure-to-start- 7533s 2025-02-21 01:32:03,352 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:34137' closed. 7533s 2025-02-21 01:32:03,352 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:39105'. Reason: failure-to-start- 7533s 2025-02-21 01:32:03,352 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:39105' closed. 7533s 2025-02-21 01:32:03,352 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40867': TLS handshake failed with remote 'tls://127.0.0.1:38070': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 7533s 2025-02-21 01:32:03,352 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40867': TLS handshake failed with remote 'tls://127.0.0.1:38086': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 7533s 2025-02-21 01:32:03,353 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 7533s Traceback (most recent call last): 7533s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 7533s return await fut 7533s ^^^^^^^^^ 7533s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 7533s comm = await self.rpc.connect(saddr) 7533s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7533s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1485, in connect 7533s return await self._connect(addr=addr, timeout=timeout) 7533s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7533s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1429, in _connect 7533s comm = await connect( 7533s ^^^^^^^^^^^^^^ 7533s ...<4 lines>... 7533s ) 7533s ^ 7533s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7533s comm = await wait_for( 7533s ^^^^^^^^^^^^^^^ 7533s ...<2 lines>... 7533s ) 7533s ^ 7533s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 7533s return await fut 7533s ^^^^^^^^^ 7533s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7533s stream = await self.client.connect( 7533s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7533s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7533s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7533s ) 7533s ^ 7533s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7533s af, addr, stream = await connector.start(connect_timeout=timeout) 7533s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7533s asyncio.exceptions.CancelledError 7533s 7533s The above exception was the direct cause of the following exception: 7533s 7533s Traceback (most recent call last): 7533s File "/usr/lib/python3/dist-packages/distributed/core.py", line 528, in start 7533s await wait_for(self.start_unsafe(), timeout=timeout) 7533s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1913, in wait_for 7533s async with asyncio.timeout(timeout): 7533s ~~~~~~~~~~~~~~~^^^^^^^^^ 7533s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7533s raise TimeoutError from exc_val 7533s TimeoutError 7533s 7533s The above exception was the direct cause of the following exception: 7533s 7533s Traceback (most recent call last): 7533s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 974, in _cluster_factory 7533s s, ws = await start_cluster( 7533s ^^^^^^^^^^^^^^^^^^^^ 7533s ...<9 lines>... 7533s ) 7533s ^ 7533s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 791, in start_cluster 7533s await asyncio.gather(*workers) 7533s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7533s return await awaitable 7533s ^^^^^^^^^^^^^^^ 7533s File "/usr/lib/python3/dist-packages/distributed/core.py", line 531, in start 7533s raise asyncio.TimeoutError( 7533s f"{type(self).__name__} start timed out after {timeout}s." 7533s ) from exc 7533s TimeoutError: Nanny start timed out after 0s. 7533s 2025-02-21 01:32:04,361 - distributed.scheduler - INFO - State start 7533s 2025-02-21 01:32:04,370 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:38985 7533s 2025-02-21 01:32:04,370 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:37837/status 7533s 2025-02-21 01:32:04,371 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7533s 2025-02-21 01:32:04,387 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:44477'. Reason: failure-to-start- 7533s 2025-02-21 01:32:04,388 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:44477' closed. 7533s 2025-02-21 01:32:04,388 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:37595'. Reason: failure-to-start- 7533s 2025-02-21 01:32:04,388 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:37595' closed. 7533s 2025-02-21 01:32:04,388 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38985': TLS handshake failed with remote 'tls://127.0.0.1:34574': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 7533s 2025-02-21 01:32:04,388 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38985': TLS handshake failed with remote 'tls://127.0.0.1:34584': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 7533s 2025-02-21 01:32:04,388 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 7533s Traceback (most recent call last): 7533s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 7533s return await fut 7533s ^^^^^^^^^ 7533s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 7533s comm = await self.rpc.connect(saddr) 7533s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7533s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1485, in connect 7533s return await self._connect(addr=addr, timeout=timeout) 7533s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7533s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1429, in _connect 7533s comm = await connect( 7533s ^^^^^^^^^^^^^^ 7533s ...<4 lines>... 7533s ) 7533s ^ 7533s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7533s comm = await wait_for( 7533s ^^^^^^^^^^^^^^^ 7533s ...<2 lines>... 7533s ) 7533s ^ 7533s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 7533s return await fut 7533s ^^^^^^^^^ 7533s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7533s stream = await self.client.connect( 7533s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7533s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7533s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7533s ) 7533s ^ 7533s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7533s af, addr, stream = await connector.start(connect_timeout=timeout) 7533s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7533s asyncio.exceptions.CancelledError 7533s 7533s The above exception was the direct cause of the following exception: 7533s 7533s Traceback (most recent call last): 7533s File "/usr/lib/python3/dist-packages/distributed/core.py", line 528, in start 7533s await wait_for(self.start_unsafe(), timeout=timeout) 7533s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1913, in wait_for 7533s async with asyncio.timeout(timeout): 7533s ~~~~~~~~~~~~~~~^^^^^^^^^ 7533s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7533s raise TimeoutError from exc_val 7533s TimeoutError 7533s 7533s The above exception was the direct cause of the following exception: 7533s 7533s Traceback (most recent call last): 7533s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 974, in _cluster_factory 7533s s, ws = await start_cluster( 7533s ^^^^^^^^^^^^^^^^^^^^ 7533s ...<9 lines>... 7533s ) 7533s ^ 7533s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 791, in start_cluster 7533s await asyncio.gather(*workers) 7533s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7533s return await awaitable 7533s ^^^^^^^^^^^^^^^ 7533s File "/usr/lib/python3/dist-packages/distributed/core.py", line 531, in start 7533s raise asyncio.TimeoutError( 7533s f"{type(self).__name__} start timed out after {timeout}s." 7533s ) from exc 7533s TimeoutError: Nanny start timed out after 0s. 7533s 2025-02-21 01:32:05,395 - distributed.scheduler - INFO - State start 7533s 2025-02-21 01:32:05,399 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:44807 7533s 2025-02-21 01:32:05,399 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:46179/status 7533s 2025-02-21 01:32:05,400 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7533s 2025-02-21 01:32:05,413 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:45631'. Reason: failure-to-start- 7533s 2025-02-21 01:32:05,413 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:45631' closed. 7533s 2025-02-21 01:32:05,413 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:42811'. Reason: failure-to-start- 7533s 2025-02-21 01:32:05,413 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:42811' closed. 7533s 2025-02-21 01:32:05,414 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44807': TLS handshake failed with remote 'tls://127.0.0.1:41212': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 7533s 2025-02-21 01:32:05,414 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:44807': TLS handshake failed with remote 'tls://127.0.0.1:41214': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 7533s 2025-02-21 01:32:05,414 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 7533s Traceback (most recent call last): 7533s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 7533s return await fut 7533s ^^^^^^^^^ 7533s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 7533s comm = await self.rpc.connect(saddr) 7533s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7533s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1485, in connect 7533s return await self._connect(addr=addr, timeout=timeout) 7533s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7533s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1429, in _connect 7533s comm = await connect( 7533s ^^^^^^^^^^^^^^ 7533s ...<4 lines>... 7533s ) 7533s ^ 7533s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7533s comm = await wait_for( 7533s ^^^^^^^^^^^^^^^ 7533s ...<2 lines>... 7533s ) 7533s ^ 7533s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 7533s return await fut 7533s ^^^^^^^^^ 7533s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7533s stream = await self.client.connect( 7533s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7533s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7533s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7533s ) 7533s ^ 7533s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7533s af, addr, stream = await connector.start(connect_timeout=timeout) 7533s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7533s asyncio.exceptions.CancelledError 7533s 7533s The above exception was the direct cause of the following exception: 7533s 7533s Traceback (most recent call last): 7533s File "/usr/lib/python3/dist-packages/distributed/core.py", line 528, in start 7533s await wait_for(self.start_unsafe(), timeout=timeout) 7533s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1913, in wait_for 7533s async with asyncio.timeout(timeout): 7533s ~~~~~~~~~~~~~~~^^^^^^^^^ 7533s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7533s raise TimeoutError from exc_val 7533s TimeoutError 7533s 7533s The above exception was the direct cause of the following exception: 7533s 7533s Traceback (most recent call last): 7533s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 974, in _cluster_factory 7533s s, ws = await start_cluster( 7533s ^^^^^^^^^^^^^^^^^^^^ 7533s ...<9 lines>... 7533s ) 7533s ^ 7533s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 791, in start_cluster 7533s await asyncio.gather(*workers) 7533s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7533s return await awaitable 7533s ^^^^^^^^^^^^^^^ 7533s File "/usr/lib/python3/dist-packages/distributed/core.py", line 531, in start 7533s raise asyncio.TimeoutError( 7533s f"{type(self).__name__} start timed out after {timeout}s." 7533s ) from exc 7533s TimeoutError: Nanny start timed out after 0s. 7533s 2025-02-21 01:32:06,420 - distributed.scheduler - INFO - State start 7533s 2025-02-21 01:32:06,433 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:46291 7533s 2025-02-21 01:32:06,433 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:40217/status 7533s 2025-02-21 01:32:06,434 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7533s 2025-02-21 01:32:06,446 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:38203'. Reason: failure-to-start- 7533s 2025-02-21 01:32:06,446 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:38203' closed. 7533s 2025-02-21 01:32:06,446 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:44149'. Reason: failure-to-start- 7533s 2025-02-21 01:32:06,447 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:44149' closed. 7533s 2025-02-21 01:32:06,447 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:46038': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 7533s 2025-02-21 01:32:06,447 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46291': TLS handshake failed with remote 'tls://127.0.0.1:46044': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 7533s 2025-02-21 01:32:06,447 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 7533s Traceback (most recent call last): 7533s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 7533s return await fut 7533s ^^^^^^^^^ 7533s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 7533s comm = await self.rpc.connect(saddr) 7533s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7533s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1485, in connect 7533s return await self._connect(addr=addr, timeout=timeout) 7533s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7533s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1429, in _connect 7533s comm = await connect( 7533s ^^^^^^^^^^^^^^ 7533s ...<4 lines>... 7533s ) 7533s ^ 7533s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7533s comm = await wait_for( 7533s ^^^^^^^^^^^^^^^ 7533s ...<2 lines>... 7533s ) 7533s ^ 7533s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 7533s return await fut 7533s ^^^^^^^^^ 7533s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7533s stream = await self.client.connect( 7533s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7533s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7533s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7533s ) 7533s ^ 7533s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7533s af, addr, stream = await connector.start(connect_timeout=timeout) 7533s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7533s asyncio.exceptions.CancelledError 7533s 7533s The above exception was the direct cause of the following exception: 7533s 7533s Traceback (most recent call last): 7533s File "/usr/lib/python3/dist-packages/distributed/core.py", line 528, in start 7533s await wait_for(self.start_unsafe(), timeout=timeout) 7533s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1913, in wait_for 7533s async with asyncio.timeout(timeout): 7533s ~~~~~~~~~~~~~~~^^^^^^^^^ 7533s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7533s raise TimeoutError from exc_val 7533s TimeoutError 7533s 7533s The above exception was the direct cause of the following exception: 7533s 7533s Traceback (most recent call last): 7533s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 974, in _cluster_factory 7533s s, ws = await start_cluster( 7533s ^^^^^^^^^^^^^^^^^^^^ 7533s ...<9 lines>... 7533s ) 7533s ^ 7533s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 791, in start_cluster 7533s await asyncio.gather(*workers) 7533s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7533s return await awaitable 7533s ^^^^^^^^^^^^^^^ 7533s File "/usr/lib/python3/dist-packages/distributed/core.py", line 531, in start 7533s raise asyncio.TimeoutError( 7533s f"{type(self).__name__} start timed out after {timeout}s." 7533s ) from exc 7533s TimeoutError: Nanny start timed out after 0s. 7533s 2025-02-21 01:32:07,456 - distributed.scheduler - INFO - State start 7533s 2025-02-21 01:32:07,460 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:46447 7533s 2025-02-21 01:32:07,460 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:42867/status 7533s 2025-02-21 01:32:07,460 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7533s 2025-02-21 01:32:07,470 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:46617'. Reason: failure-to-start- 7533s 2025-02-21 01:32:07,470 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:46617' closed. 7533s 2025-02-21 01:32:07,470 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:36181'. Reason: failure-to-start- 7533s 2025-02-21 01:32:07,470 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:36181' closed. 7533s 2025-02-21 01:32:07,471 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46447': TLS handshake failed with remote 'tls://127.0.0.1:46020': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 7533s 2025-02-21 01:32:07,471 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46447': TLS handshake failed with remote 'tls://127.0.0.1:46024': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 7533s 2025-02-21 01:32:07,471 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 7533s Traceback (most recent call last): 7533s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 7533s return await fut 7533s ^^^^^^^^^ 7533s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 7533s comm = await self.rpc.connect(saddr) 7533s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7533s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1485, in connect 7533s return await self._connect(addr=addr, timeout=timeout) 7533s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7533s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1429, in _connect 7533s comm = await connect( 7533s ^^^^^^^^^^^^^^ 7533s ...<4 lines>... 7533s ) 7533s ^ 7533s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7533s comm = await wait_for( 7533s ^^^^^^^^^^^^^^^ 7533s ...<2 lines>... 7533s ) 7533s ^ 7533s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 7533s return await fut 7533s ^^^^^^^^^ 7533s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7533s stream = await self.client.connect( 7533s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7533s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7533s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7533s ) 7533s ^ 7533s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7533s af, addr, stream = await connector.start(connect_timeout=timeout) 7533s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7533s asyncio.exceptions.CancelledError 7533s 7533s The above exception was the direct cause of the following exception: 7533s 7533s Traceback (most recent call last): 7533s File "/usr/lib/python3/dist-packages/distributed/core.py", line 528, in start 7533s await wait_for(self.start_unsafe(), timeout=timeout) 7533s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1913, in wait_for 7533s async with asyncio.timeout(timeout): 7533s ~~~~~~~~~~~~~~~^^^^^^^^^ 7533s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7533s raise TimeoutError from exc_val 7533s TimeoutError 7533s 7533s The above exception was the direct cause of the following exception: 7533s 7533s Traceback (most recent call last): 7533s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 974, in _cluster_factory 7533s s, ws = await start_cluster( 7533s ^^^^^^^^^^^^^^^^^^^^ 7533s ...<9 lines>... 7533s ) 7533s ^ 7533s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 791, in start_cluster 7533s await asyncio.gather(*workers) 7533s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7533s return await awaitable 7533s ^^^^^^^^^^^^^^^ 7533s File "/usr/lib/python3/dist-packages/distributed/core.py", line 531, in start 7533s raise asyncio.TimeoutError( 7533s f"{type(self).__name__} start timed out after {timeout}s." 7533s ) from exc 7533s TimeoutError: Nanny start timed out after 0s. 7533s 2025-02-21 01:32:08,478 - distributed.scheduler - INFO - State start 7533s 2025-02-21 01:32:08,482 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:38773 7533s 2025-02-21 01:32:08,483 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:35087/status 7533s 2025-02-21 01:32:08,483 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7533s 2025-02-21 01:32:08,492 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:44105'. Reason: failure-to-start- 7533s 2025-02-21 01:32:08,492 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:44105' closed. 7533s 2025-02-21 01:32:08,492 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:34331'. Reason: failure-to-start- 7533s 2025-02-21 01:32:08,492 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:34331' closed. 7533s 2025-02-21 01:32:08,493 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38773': TLS handshake failed with remote 'tls://127.0.0.1:36932': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 7533s 2025-02-21 01:32:08,493 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38773': TLS handshake failed with remote 'tls://127.0.0.1:36938': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 7533s 2025-02-21 01:32:08,493 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 7533s Traceback (most recent call last): 7533s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 7533s return await fut 7533s ^^^^^^^^^ 7533s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 7533s comm = await self.rpc.connect(saddr) 7533s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7533s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1485, in connect 7533s return await self._connect(addr=addr, timeout=timeout) 7533s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7533s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1429, in _connect 7533s comm = await connect( 7533s ^^^^^^^^^^^^^^ 7533s ...<4 lines>... 7533s ) 7533s ^ 7533s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7533s comm = await wait_for( 7533s ^^^^^^^^^^^^^^^ 7533s ...<2 lines>... 7533s ) 7533s ^ 7533s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 7533s return await fut 7533s ^^^^^^^^^ 7533s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7533s stream = await self.client.connect( 7533s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7533s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7533s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7533s ) 7533s ^ 7533s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7533s af, addr, stream = await connector.start(connect_timeout=timeout) 7533s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7533s asyncio.exceptions.CancelledError 7533s 7533s The above exception was the direct cause of the following exception: 7533s 7533s Traceback (most recent call last): 7533s File "/usr/lib/python3/dist-packages/distributed/core.py", line 528, in start 7533s await wait_for(self.start_unsafe(), timeout=timeout) 7533s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1913, in wait_for 7533s async with asyncio.timeout(timeout): 7533s ~~~~~~~~~~~~~~~^^^^^^^^^ 7533s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7533s raise TimeoutError from exc_val 7533s TimeoutError 7533s 7533s The above exception was the direct cause of the following exception: 7533s 7533s Traceback (most recent call last): 7533s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 974, in _cluster_factory 7533s s, ws = await start_cluster( 7533s ^^^^^^^^^^^^^^^^^^^^ 7533s ...<9 lines>... 7533s ) 7533s ^ 7533s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 791, in start_cluster 7533s await asyncio.gather(*workers) 7533s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7533s return await awaitable 7533s ^^^^^^^^^^^^^^^ 7533s File "/usr/lib/python3/dist-packages/distributed/core.py", line 531, in start 7533s raise asyncio.TimeoutError( 7533s f"{type(self).__name__} start timed out after {timeout}s." 7533s ) from exc 7533s TimeoutError: Nanny start timed out after 0s. 7533s 2025-02-21 01:32:09,498 - distributed.scheduler - INFO - State start 7533s 2025-02-21 01:32:09,503 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:46001 7533s 2025-02-21 01:32:09,503 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:45287/status 7533s 2025-02-21 01:32:09,503 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7533s 2025-02-21 01:32:09,514 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:37119'. Reason: failure-to-start- 7533s 2025-02-21 01:32:09,514 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:37119' closed. 7533s 2025-02-21 01:32:09,514 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:44863'. Reason: failure-to-start- 7533s 2025-02-21 01:32:09,514 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:44863' closed. 7533s 2025-02-21 01:32:09,515 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46001': TLS handshake failed with remote 'tls://127.0.0.1:35410': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 7533s 2025-02-21 01:32:09,515 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46001': TLS handshake failed with remote 'tls://127.0.0.1:35420': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 7533s 2025-02-21 01:32:09,515 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 7533s Traceback (most recent call last): 7533s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 7533s return await fut 7533s ^^^^^^^^^ 7533s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 7533s comm = await self.rpc.connect(saddr) 7533s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7533s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1485, in connect 7533s return await self._connect(addr=addr, timeout=timeout) 7533s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7533s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1429, in _connect 7533s comm = await connect( 7533s ^^^^^^^^^^^^^^ 7533s ...<4 lines>... 7533s ) 7533s ^ 7533s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7533s comm = await wait_for( 7533s ^^^^^^^^^^^^^^^ 7533s ...<2 lines>... 7533s ) 7533s ^ 7533s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 7533s return await fut 7533s ^^^^^^^^^ 7533s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7533s stream = await self.client.connect( 7533s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7533s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7533s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7533s ) 7533s ^ 7533s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7533s af, addr, stream = await connector.start(connect_timeout=timeout) 7533s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7533s asyncio.exceptions.CancelledError 7533s 7533s The above exception was the direct cause of the following exception: 7533s 7533s Traceback (most recent call last): 7533s File "/usr/lib/python3/dist-packages/distributed/core.py", line 528, in start 7533s await wait_for(self.start_unsafe(), timeout=timeout) 7533s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1913, in wait_for 7533s async with asyncio.timeout(timeout): 7533s ~~~~~~~~~~~~~~~^^^^^^^^^ 7533s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7533s raise TimeoutError from exc_val 7533s TimeoutError 7533s 7533s The above exception was the direct cause of the following exception: 7533s 7533s Traceback (most recent call last): 7533s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 974, in _cluster_factory 7533s s, ws = await start_cluster( 7533s ^^^^^^^^^^^^^^^^^^^^ 7533s ...<9 lines>... 7533s ) 7533s ^ 7533s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 791, in start_cluster 7533s await asyncio.gather(*workers) 7533s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7533s return await awaitable 7533s ^^^^^^^^^^^^^^^ 7533s File "/usr/lib/python3/dist-packages/distributed/core.py", line 531, in start 7533s raise asyncio.TimeoutError( 7533s f"{type(self).__name__} start timed out after {timeout}s." 7533s ) from exc 7533s TimeoutError: Nanny start timed out after 0s. 7533s 2025-02-21 01:32:10,524 - distributed.scheduler - INFO - State start 7533s 2025-02-21 01:32:10,531 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:34437 7533s 2025-02-21 01:32:10,531 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:38419/status 7533s 2025-02-21 01:32:10,532 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7533s 2025-02-21 01:32:10,543 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:38429'. Reason: failure-to-start- 7533s 2025-02-21 01:32:10,544 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:38429' closed. 7533s 2025-02-21 01:32:10,544 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:40069'. Reason: failure-to-start- 7533s 2025-02-21 01:32:10,544 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:40069' closed. 7533s 2025-02-21 01:32:10,545 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34437': TLS handshake failed with remote 'tls://127.0.0.1:55688': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 7533s 2025-02-21 01:32:10,545 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34437': TLS handshake failed with remote 'tls://127.0.0.1:55690': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 7533s 2025-02-21 01:32:10,545 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 7533s Traceback (most recent call last): 7533s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 7533s return await fut 7533s ^^^^^^^^^ 7533s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 7533s comm = await self.rpc.connect(saddr) 7533s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7533s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1485, in connect 7533s return await self._connect(addr=addr, timeout=timeout) 7533s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7533s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1429, in _connect 7533s comm = await connect( 7533s ^^^^^^^^^^^^^^ 7533s ...<4 lines>... 7533s ) 7533s ^ 7533s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7533s comm = await wait_for( 7533s ^^^^^^^^^^^^^^^ 7533s ...<2 lines>... 7533s ) 7533s ^ 7533s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 7533s return await fut 7533s ^^^^^^^^^ 7533s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7533s stream = await self.client.connect( 7533s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7533s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7533s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7533s ) 7533s ^ 7533s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7533s af, addr, stream = await connector.start(connect_timeout=timeout) 7533s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7533s asyncio.exceptions.CancelledError 7533s 7533s The above exception was the direct cause of the following exception: 7533s 7533s Traceback (most recent call last): 7533s File "/usr/lib/python3/dist-packages/distributed/core.py", line 528, in start 7533s await wait_for(self.start_unsafe(), timeout=timeout) 7533s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1913, in wait_for 7533s async with asyncio.timeout(timeout): 7533s ~~~~~~~~~~~~~~~^^^^^^^^^ 7533s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7533s raise TimeoutError from exc_val 7533s TimeoutError 7533s 7533s The above exception was the direct cause of the following exception: 7533s 7533s Traceback (most recent call last): 7533s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 974, in _cluster_factory 7533s s, ws = await start_cluster( 7533s ^^^^^^^^^^^^^^^^^^^^ 7533s ...<9 lines>... 7533s ) 7533s ^ 7533s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 791, in start_cluster 7533s await asyncio.gather(*workers) 7533s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7533s return await awaitable 7533s ^^^^^^^^^^^^^^^ 7533s File "/usr/lib/python3/dist-packages/distributed/core.py", line 531, in start 7533s raise asyncio.TimeoutError( 7533s f"{type(self).__name__} start timed out after {timeout}s." 7533s ) from exc 7533s TimeoutError: Nanny start timed out after 0s. 7533s 2025-02-21 01:32:11,564 - distributed.scheduler - INFO - State start 7533s 2025-02-21 01:32:11,570 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:33987 7533s 2025-02-21 01:32:11,570 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:40645/status 7533s 2025-02-21 01:32:11,571 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7533s 2025-02-21 01:32:11,583 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:41679'. Reason: failure-to-start- 7533s 2025-02-21 01:32:11,583 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:41679' closed. 7533s 2025-02-21 01:32:11,583 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:44181'. Reason: failure-to-start- 7533s 2025-02-21 01:32:11,583 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:44181' closed. 7533s 2025-02-21 01:32:11,584 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33987': TLS handshake failed with remote 'tls://127.0.0.1:32808': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 7533s 2025-02-21 01:32:11,584 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33987': TLS handshake failed with remote 'tls://127.0.0.1:32818': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 7533s 2025-02-21 01:32:11,584 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 7533s Traceback (most recent call last): 7533s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 7533s return await fut 7533s ^^^^^^^^^ 7533s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 7533s comm = await self.rpc.connect(saddr) 7533s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7533s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1485, in connect 7533s return await self._connect(addr=addr, timeout=timeout) 7533s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7533s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1429, in _connect 7533s comm = await connect( 7533s ^^^^^^^^^^^^^^ 7533s ...<4 lines>... 7533s ) 7533s ^ 7533s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7533s comm = await wait_for( 7533s ^^^^^^^^^^^^^^^ 7533s ...<2 lines>... 7533s ) 7533s ^ 7533s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 7533s return await fut 7533s ^^^^^^^^^ 7533s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7533s stream = await self.client.connect( 7533s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7533s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7533s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7533s ) 7533s ^ 7533s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7533s af, addr, stream = await connector.start(connect_timeout=timeout) 7533s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7533s asyncio.exceptions.CancelledError 7533s 7533s The above exception was the direct cause of the following exception: 7533s 7533s Traceback (most recent call last): 7533s File "/usr/lib/python3/dist-packages/distributed/core.py", line 528, in start 7533s await wait_for(self.start_unsafe(), timeout=timeout) 7533s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1913, in wait_for 7533s async with asyncio.timeout(timeout): 7533s ~~~~~~~~~~~~~~~^^^^^^^^^ 7533s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7533s raise TimeoutError from exc_val 7533s TimeoutError 7533s 7533s The above exception was the direct cause of the following exception: 7533s 7533s Traceback (most recent call last): 7533s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 974, in _cluster_factory 7533s s, ws = await start_cluster( 7533s ^^^^^^^^^^^^^^^^^^^^ 7533s ...<9 lines>... 7533s ) 7533s ^ 7533s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 791, in start_cluster 7533s await asyncio.gather(*workers) 7533s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7533s return await awaitable 7533s ^^^^^^^^^^^^^^^ 7533s File "/usr/lib/python3/dist-packages/distributed/core.py", line 531, in start 7533s raise asyncio.TimeoutError( 7533s f"{type(self).__name__} start timed out after {timeout}s." 7533s ) from exc 7533s TimeoutError: Nanny start timed out after 0s. 7533s 2025-02-21 01:32:12,593 - distributed.scheduler - INFO - State start 7533s 2025-02-21 01:32:12,597 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:40055 7533s 2025-02-21 01:32:12,597 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:41245/status 7533s 2025-02-21 01:32:12,597 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7533s 2025-02-21 01:32:12,606 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:44669'. Reason: failure-to-start- 7533s 2025-02-21 01:32:12,606 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:44669' closed. 7533s 2025-02-21 01:32:12,607 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:44179'. Reason: failure-to-start- 7533s 2025-02-21 01:32:12,607 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:44179' closed. 7533s 2025-02-21 01:32:12,607 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40055': TLS handshake failed with remote 'tls://127.0.0.1:44958': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 7533s 2025-02-21 01:32:12,607 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40055': TLS handshake failed with remote 'tls://127.0.0.1:44966': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 7533s 2025-02-21 01:32:12,607 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 7533s Traceback (most recent call last): 7533s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 7533s return await fut 7533s ^^^^^^^^^ 7533s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 7533s comm = await self.rpc.connect(saddr) 7533s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7533s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1485, in connect 7533s return await self._connect(addr=addr, timeout=timeout) 7533s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7533s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1429, in _connect 7533s comm = await connect( 7533s ^^^^^^^^^^^^^^ 7533s ...<4 lines>... 7533s ) 7533s ^ 7533s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7533s comm = await wait_for( 7533s ^^^^^^^^^^^^^^^ 7533s ...<2 lines>... 7533s ) 7533s ^ 7533s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 7533s return await fut 7533s ^^^^^^^^^ 7533s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7533s stream = await self.client.connect( 7533s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7533s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7533s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7533s ) 7533s ^ 7533s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7533s af, addr, stream = await connector.start(connect_timeout=timeout) 7533s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7533s asyncio.exceptions.CancelledError 7533s 7533s The above exception was the direct cause of the following exception: 7533s 7533s Traceback (most recent call last): 7533s File "/usr/lib/python3/dist-packages/distributed/core.py", line 528, in start 7533s await wait_for(self.start_unsafe(), timeout=timeout) 7533s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1913, in wait_for 7533s async with asyncio.timeout(timeout): 7533s ~~~~~~~~~~~~~~~^^^^^^^^^ 7533s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7533s raise TimeoutError from exc_val 7533s TimeoutError 7533s 7533s The above exception was the direct cause of the following exception: 7533s 7533s Traceback (most recent call last): 7533s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 974, in _cluster_factory 7533s s, ws = await start_cluster( 7533s ^^^^^^^^^^^^^^^^^^^^ 7533s ...<9 lines>... 7533s ) 7533s ^ 7533s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 791, in start_cluster 7533s await asyncio.gather(*workers) 7533s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7533s return await awaitable 7533s ^^^^^^^^^^^^^^^ 7533s File "/usr/lib/python3/dist-packages/distributed/core.py", line 531, in start 7533s raise asyncio.TimeoutError( 7533s f"{type(self).__name__} start timed out after {timeout}s." 7533s ) from exc 7533s TimeoutError: Nanny start timed out after 0s. 7533s 2025-02-21 01:32:13,613 - distributed.scheduler - INFO - State start 7533s 2025-02-21 01:32:13,619 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:41349 7533s 2025-02-21 01:32:13,619 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:41467/status 7533s 2025-02-21 01:32:13,619 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7533s 2025-02-21 01:32:13,630 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:46271'. Reason: failure-to-start- 7533s 2025-02-21 01:32:13,631 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:46271' closed. 7533s 2025-02-21 01:32:13,631 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:41247'. Reason: failure-to-start- 7533s 2025-02-21 01:32:13,631 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:41247' closed. 7533s 2025-02-21 01:32:13,632 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41349': TLS handshake failed with remote 'tls://127.0.0.1:37106': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 7533s 2025-02-21 01:32:13,632 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41349': TLS handshake failed with remote 'tls://127.0.0.1:37110': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 7533s 2025-02-21 01:32:13,632 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 7533s Traceback (most recent call last): 7533s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 7533s return await fut 7533s ^^^^^^^^^ 7533s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 7533s comm = await self.rpc.connect(saddr) 7533s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7533s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1485, in connect 7533s return await self._connect(addr=addr, timeout=timeout) 7533s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7533s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1429, in _connect 7533s comm = await connect( 7533s ^^^^^^^^^^^^^^ 7533s ...<4 lines>... 7533s ) 7533s ^ 7533s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7533s comm = await wait_for( 7533s ^^^^^^^^^^^^^^^ 7533s ...<2 lines>... 7533s ) 7533s ^ 7533s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 7533s return await fut 7533s ^^^^^^^^^ 7533s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7533s stream = await self.client.connect( 7533s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7533s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7533s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7533s ) 7533s ^ 7533s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7533s af, addr, stream = await connector.start(connect_timeout=timeout) 7533s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7533s asyncio.exceptions.CancelledError 7533s 7533s The above exception was the direct cause of the following exception: 7533s 7533s Traceback (most recent call last): 7533s File "/usr/lib/python3/dist-packages/distributed/core.py", line 528, in start 7533s await wait_for(self.start_unsafe(), timeout=timeout) 7533s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1913, in wait_for 7533s async with asyncio.timeout(timeout): 7533s ~~~~~~~~~~~~~~~^^^^^^^^^ 7533s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7533s raise TimeoutError from exc_val 7533s TimeoutError 7533s 7533s The above exception was the direct cause of the following exception: 7533s 7533s Traceback (most recent call last): 7533s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 974, in _cluster_factory 7533s s, ws = await start_cluster( 7533s ^^^^^^^^^^^^^^^^^^^^ 7533s ...<9 lines>... 7533s ) 7533s ^ 7533s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 791, in start_cluster 7533s await asyncio.gather(*workers) 7533s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7533s return await awaitable 7533s ^^^^^^^^^^^^^^^ 7533s File "/usr/lib/python3/dist-packages/distributed/core.py", line 531, in start 7533s raise asyncio.TimeoutError( 7533s f"{type(self).__name__} start timed out after {timeout}s." 7533s ) from exc 7533s TimeoutError: Nanny start timed out after 0s. 7533s 2025-02-21 01:32:14,638 - distributed.scheduler - INFO - State start 7533s 2025-02-21 01:32:14,641 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:33273 7533s 2025-02-21 01:32:14,642 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:39695/status 7533s 2025-02-21 01:32:14,643 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7533s 2025-02-21 01:32:14,651 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:36695'. Reason: failure-to-start- 7533s 2025-02-21 01:32:14,651 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:36695' closed. 7533s 2025-02-21 01:32:14,651 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:41549'. Reason: failure-to-start- 7533s 2025-02-21 01:32:14,652 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:41549' closed. 7533s 2025-02-21 01:32:14,652 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33273': TLS handshake failed with remote 'tls://127.0.0.1:45910': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 7533s 2025-02-21 01:32:14,652 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33273': TLS handshake failed with remote 'tls://127.0.0.1:45926': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 7533s 2025-02-21 01:32:14,652 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 7533s Traceback (most recent call last): 7533s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 7533s return await fut 7533s ^^^^^^^^^ 7533s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 7533s comm = await self.rpc.connect(saddr) 7533s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7533s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1485, in connect 7533s return await self._connect(addr=addr, timeout=timeout) 7533s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7533s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1429, in _connect 7533s comm = await connect( 7533s ^^^^^^^^^^^^^^ 7533s ...<4 lines>... 7533s ) 7533s ^ 7533s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7533s comm = await wait_for( 7533s ^^^^^^^^^^^^^^^ 7533s ...<2 lines>... 7533s ) 7533s ^ 7533s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 7533s return await fut 7533s ^^^^^^^^^ 7533s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7533s stream = await self.client.connect( 7533s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7533s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7533s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7533s ) 7533s ^ 7533s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7533s af, addr, stream = await connector.start(connect_timeout=timeout) 7533s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7533s asyncio.exceptions.CancelledError 7533s 7533s The above exception was the direct cause of the following exception: 7533s 7533s Traceback (most recent call last): 7533s File "/usr/lib/python3/dist-packages/distributed/core.py", line 528, in start 7533s await wait_for(self.start_unsafe(), timeout=timeout) 7533s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1913, in wait_for 7533s async with asyncio.timeout(timeout): 7533s ~~~~~~~~~~~~~~~^^^^^^^^^ 7533s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7533s raise TimeoutError from exc_val 7533s TimeoutError 7533s 7533s The above exception was the direct cause of the following exception: 7533s 7533s Traceback (most recent call last): 7533s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 974, in _cluster_factory 7533s s, ws = await start_cluster( 7533s ^^^^^^^^^^^^^^^^^^^^ 7533s ...<9 lines>... 7533s ) 7533s ^ 7533s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 791, in start_cluster 7533s await asyncio.gather(*workers) 7533s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7533s return await awaitable 7533s ^^^^^^^^^^^^^^^ 7533s File "/usr/lib/python3/dist-packages/distributed/core.py", line 531, in start 7533s raise asyncio.TimeoutError( 7533s f"{type(self).__name__} start timed out after {timeout}s." 7533s ) from exc 7533s TimeoutError: Nanny start timed out after 0s. 7533s ============================= slowest 20 durations ============================= 7533s 60.01s call tests/test_tls_functional.py::test_retire_workers 7533s 0.00s setup tests/test_tls_functional.py::test_retire_workers 7533s 0.00s teardown tests/test_tls_functional.py::test_retire_workers 7533s =========================== short test summary info ============================ 7533s FAILED tests/test_tls_functional.py::test_retire_workers - TimeoutError 7533s ========== 1 failed, 30 skipped, 3391 deselected in 71.56s (0:01:11) =========== 7534s *** END OF RUN 2: NOT ALL TESTS HAVE YET PASSED/XFAILED *** 7534s *** STARTING RUN 3: python3.13 -m pytest --pyargs distributed --verbose --color=no --timeout-method=signal --timeout=300 -m not avoid_ci -rfE --last-failed --last-failed-no-failures none --ignore=../../../../../usr/lib/python3/dist-packages/distributed/comm/tests/test_comms.py --ignore=../../../../../usr/lib/python3/dist-packages/distributed/comm/tests/test_ws.py --ignore=../../../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_adaptive.py --ignore=../../../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_local.py --ignore=../../../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_slow_adaptive.py --ignore=../../../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_spec_cluster.py --deselect=cli/tests/test_dask_scheduler.py::test_no_dashboard --deselect=deploy/tests/test_local.py::test_localcluster_get_client --deselect=deploy/tests/test_old_ssh.py::test_cluster --deselect=deploy/tests/test_old_ssh.py::test_old_ssh_nprocs_renamed_to_n_workers --deselect=deploy/tests/test_old_ssh.py::test_nprocs_attribute_is_deprecated --deselect=deploy/tests/test_ssh.py::test_nprocs_attribute_is_deprecated --deselect=http/tests/test_core.py::test_prometheus_api_doc --deselect=tests/test_init.py::test_git_revision --deselect=tests/test_jupyter.py::test_jupyter_idle_timeout --deselect=tests/test_jupyter.py::test_jupyter_idle_timeout_returned --deselect=tests/test_jupyter.py::test_jupyter_server --deselect=tests/test_jupyter.py::test_shutsdown_cleanly --deselect=tests/test_profile.py::test_stack_overflow --deselect=tests/test_pubsub.py::test_client_worker --deselect=tests/test_queues.py::test_queue_in_task --deselect=tests/test_spill.py::test_spillbuffer_oserror --deselect=tests/test_steal.py::test_steal_twice --deselect=tests/test_utils_test.py::test_cluster --deselect=tests/test_variable.py::test_variable_in_task --deselect=tests/test_worker.py::test_process_executor_kills_process --deselect=tests/test_worker_memory.py::test_fail_to_pickle_execute_1 --deselect=tests/test_worker_state_machine.py::test_task_state_instance_are_garbage_collected --deselect=protocol/tests/test_protocol.py::test_deeply_nested_structures --deselect=protocol/tests/test_serialize.py::test_deeply_nested_structures --deselect=cli/tests/test_dask_scheduler.py::test_defaults --deselect=cli/tests/test_dask_scheduler.py::test_hostport --deselect=cli/tests/test_dask_spec.py::test_errors --deselect=cli/tests/test_dask_worker.py::test_scheduler_file --deselect=cli/tests/test_dask_worker.py::test_scheduler_file --deselect=cli/tests/test_dask_worker.py::test_scheduler_file --deselect=dashboard/tests/test_scheduler_bokeh.py::test_counters --deselect=dashboard/tests/test_worker_bokeh.py::test_counters --deselect=deploy/tests/test_local.py::test_adapt_then_manual --deselect=deploy/tests/test_local.py::test_async_with --deselect=deploy/tests/test_local.py::test_close_twice --deselect=deploy/tests/test_local.py::test_cluster_info_sync --deselect=deploy/tests/test_local.py::test_local_tls --deselect=deploy/tests/test_local.py::test_no_dangling_asyncio_tasks --deselect=deploy/tests/test_local.py::test_only_local_access --deselect=deploy/tests/test_local.py::test_remote_access --deselect=diagnostics/tests/test_progress_widgets.py::test_serializers --deselect=diagnostics/tests/test_scheduler_plugin.py::test_lifecycle --deselect=http/scheduler/tests/test_missing_bokeh.py::test_missing_bokeh --deselect=http/scheduler/tests/test_scheduler_http.py::test_metrics_when_prometheus_client_not_installed --deselect=protocol/tests/test_serialize.py::test_errors --deselect=tests/test_batched.py::test_BatchedSend --deselect=tests/test_batched.py::test_close_closed --deselect=tests/test_batched.py::test_close_twice --deselect=tests/test_batched.py::test_send_after_stream_start --deselect=tests/test_batched.py::test_send_before_close --deselect=tests/test_batched.py::test_send_before_start --deselect=tests/test_batched.py::test_sending_traffic_jam --deselect=tests/test_batched.py::test_serializers --deselect=tests/test_client.py::TestClientSecurityLoader::test_security_loader --deselect=tests/test_client.py::TestClientSecurityLoader::test_security_loader_ignored_if_explicit_security_provided --deselect=tests/test_client.py::TestClientSecurityLoader::test_security_loader_ignored_if_returns_none --deselect=tests/test_client.py::test_async_with --deselect=tests/test_client.py::test_client_is_quiet_cluster_close --deselect=tests/test_client.py::test_dashboard_link_cluster --deselect=tests/test_client.py::test_dashboard_link_inproc --deselect=tests/test_client.py::test_file_descriptors_dont_leak --deselect=tests/test_client.py::test_mixing_clients_different_scheduler --deselect=tests/test_client.py::test_quiet_client_close --deselect=tests/test_client.py::test_rebalance_sync --deselect=tests/test_client.py::test_repr_localcluster --deselect=tests/test_client.py::test_security_loader --deselect=tests/test_client.py::test_security_loader_ignored_if_explicit_security_provided --deselect=tests/test_client.py::test_security_loader_ignored_if_returns_none --deselect=tests/test_client.py::test_shutdown --deselect=tests/test_client.py::test_shutdown_is_quiet_with_cluster --deselect=tests/test_client.py::test_shutdown_localcluster --deselect=tests/test_client.py::test_shutdown_stops_callbacks --deselect=tests/test_client_loop.py::test_close_loop_sync_start_new_loop --deselect=tests/test_client_loop.py::test_close_loop_sync_use_running_loop --deselect=tests/test_core.py::test_close_fast_without_active_handlers --deselect=tests/test_core.py::test_close_grace_period_for_handlers --deselect=tests/test_core.py::test_close_properly --deselect=tests/test_core.py::test_compression --deselect=tests/test_core.py::test_connection_pool --deselect=tests/test_core.py::test_connection_pool_close_while_connecting --deselect=tests/test_core.py::test_connection_pool_detects_remote_close --deselect=tests/test_core.py::test_connection_pool_outside_cancellation --deselect=tests/test_core.py::test_connection_pool_remove --deselect=tests/test_core.py::test_connection_pool_respects_limit --deselect=tests/test_core.py::test_connection_pool_tls --deselect=tests/test_core.py::test_counters --deselect=tests/test_core.py::test_deserialize_error --deselect=tests/test_core.py::test_errors --deselect=tests/test_core.py::test_identity_inproc --deselect=tests/test_core.py::test_identity_tcp --deselect=tests/test_core.py::test_large_packets_inproc --deselect=tests/test_core.py::test_messages_are_ordered_bsend --deselect=tests/test_core.py::test_messages_are_ordered_raw --deselect=tests/test_core.py::test_ports --deselect=tests/test_core.py::test_rpc_default --deselect=tests/test_core.py::test_rpc_inproc --deselect=tests/test_core.py::test_rpc_message_lifetime_default --deselect=tests/test_core.py::test_rpc_message_lifetime_inproc --deselect=tests/test_core.py::test_rpc_message_lifetime_tcp --deselect=tests/test_core.py::test_rpc_serialization --deselect=tests/test_core.py::test_rpc_tcp --deselect=tests/test_core.py::test_rpc_tls --deselect=tests/test_core.py::test_rpc_with_many_connections_inproc --deselect=tests/test_core.py::test_rpc_with_many_connections_tcp --deselect=tests/test_core.py::test_send_recv_args --deselect=tests/test_core.py::test_send_recv_cancelled --deselect=tests/test_core.py::test_server --deselect=tests/test_core.py::test_server_comms_mark_active_handlers --deselect=tests/test_core.py::test_server_raises_on_blocked_handlers --deselect=tests/test_jupyter.py::test_jupyter_idle_timeout --deselect=tests/test_jupyter.py::test_jupyter_server --deselect=tests/test_locks.py::test_errors --deselect=tests/test_nanny.py::test_scheduler_file --deselect=tests/test_nanny.py::test_scheduler_file --deselect=tests/test_nanny.py::test_scheduler_file --deselect=tests/test_nanny.py::test_worker_uses_same_host_as_nanny --deselect=tests/test_preload.py::test_failure_doesnt_crash_scheduler --deselect=tests/test_preload.py::test_preload_import_time --deselect=tests/test_preload.py::test_preload_manager_sequence --deselect=tests/test_preload.py::test_worker_preload_text --deselect=tests/test_scheduler.py::test_allowed_failures_config --deselect=tests/test_scheduler.py::test_async_context_manager --deselect=tests/test_scheduler.py::test_dashboard_host --deselect=tests/test_scheduler.py::test_file_descriptors_dont_leak --deselect=tests/test_scheduler.py::test_finished --deselect=tests/test_scheduler.py::test_multiple_listeners --deselect=tests/test_scheduler.py::test_no_dangling_asyncio_tasks --deselect=tests/test_scheduler.py::test_scheduler_file --deselect=tests/test_scheduler.py::test_scheduler_file --deselect=tests/test_scheduler.py::test_scheduler_file --deselect=tests/test_security.py::test_require_encryption --deselect=tests/test_security.py::test_tls_listen_connect --deselect=tests/test_security.py::test_tls_temporary_credentials_functional --deselect=tests/test_semaphore.py::test_threadpoolworkers_pick_correct_ioloop --deselect=tests/test_tls_functional.py::test_security_dict_input_no_security --deselect=tests/test_utils_test.py::test_ensure_no_new_clients --deselect=tests/test_utils_test.py::test_freeze_batched_send --deselect=tests/test_utils_test.py::test_locked_comm_drop_in_replacement --deselect=tests/test_utils_test.py::test_locked_comm_intercept_read --deselect=tests/test_utils_test.py::test_locked_comm_intercept_write --deselect=tests/test_worker.py::test_host_uses_scheduler_protocol --deselect=tests/test_worker.py::test_plugin_exception --deselect=tests/test_worker.py::test_plugin_internal_exception --deselect=tests/test_worker.py::test_plugin_multiple_exceptions --deselect=tests/test_worker.py::test_scheduler_file --deselect=tests/test_worker.py::test_scheduler_file --deselect=tests/test_worker.py::test_scheduler_file --deselect=tests/test_worker_client.py::test_dont_override_default_get 7535s ============================= test session starts ============================== 7535s platform linux -- Python 3.13.2, pytest-8.3.4, pluggy-1.5.0 -- /usr/bin/python3.13 7535s cachedir: .pytest_cache 7535s rootdir: /tmp/autopkgtest.4PKwEm/autopkgtest_tmp/build 7535s configfile: pyproject.toml 7535s plugins: timeout-2.3.1, rerunfailures-15.0, anyio-4.7.0, typeguard-4.4.1 7535s timeout: 300.0s 7535s timeout method: signal 7535s timeout func_only: False 7546s collecting ... collected 3392 items / 3391 deselected / 30 skipped / 1 selected 7546s run-last-failure: rerun previous 1 failure 7546s 7607s tests/test_tls_functional.py::test_retire_workers <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_tls_functional.py FAILED [100%] 7607s 7607s =================================== FAILURES =================================== 7607s _____________________________ test_retire_workers ______________________________ 7607s 7607s fut = , timeout = 0 7607s 7607s async def wait_for(fut: Awaitable[T], timeout: float) -> T: 7607s async with asyncio.timeout(timeout): 7607s > return await fut 7607s 7607s /usr/lib/python3/dist-packages/distributed/utils.py:1914: 7607s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 7607s /usr/lib/python3/dist-packages/distributed/nanny.py:358: in start_unsafe 7607s comm = await self.rpc.connect(saddr) 7607s /usr/lib/python3/dist-packages/distributed/core.py:1485: in connect 7607s return await self._connect(addr=addr, timeout=timeout) 7607s /usr/lib/python3/dist-packages/distributed/core.py:1429: in _connect 7607s comm = await connect( 7607s /usr/lib/python3/dist-packages/distributed/comm/core.py:342: in connect 7607s comm = await wait_for( 7607s /usr/lib/python3/dist-packages/distributed/utils.py:1914: in wait_for 7607s return await fut 7607s /usr/lib/python3/dist-packages/distributed/comm/tcp.py:546: in connect 7607s stream = await self.client.connect( 7607s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 7607s 7607s self = 7607s host = '127.0.0.1', port = 37897, af = 7607s ssl_options = 7607s max_buffer_size = 4163037184.0, source_ip = None, source_port = None 7607s timeout = None 7607s 7607s async def connect( 7607s self, 7607s host: str, 7607s port: int, 7607s af: socket.AddressFamily = socket.AF_UNSPEC, 7607s ssl_options: Optional[Union[Dict[str, Any], ssl.SSLContext]] = None, 7607s max_buffer_size: Optional[int] = None, 7607s source_ip: Optional[str] = None, 7607s source_port: Optional[int] = None, 7607s timeout: Optional[Union[float, datetime.timedelta]] = None, 7607s ) -> IOStream: 7607s """Connect to the given host and port. 7607s 7607s Asynchronously returns an `.IOStream` (or `.SSLIOStream` if 7607s ``ssl_options`` is not None). 7607s 7607s Using the ``source_ip`` kwarg, one can specify the source 7607s IP address to use when establishing the connection. 7607s In case the user needs to resolve and 7607s use a specific interface, it has to be handled outside 7607s of Tornado as this depends very much on the platform. 7607s 7607s Raises `TimeoutError` if the input future does not complete before 7607s ``timeout``, which may be specified in any form allowed by 7607s `.IOLoop.add_timeout` (i.e. a `datetime.timedelta` or an absolute time 7607s relative to `.IOLoop.time`) 7607s 7607s Similarly, when the user requires a certain source port, it can 7607s be specified using the ``source_port`` arg. 7607s 7607s .. versionchanged:: 4.5 7607s Added the ``source_ip`` and ``source_port`` arguments. 7607s 7607s .. versionchanged:: 5.0 7607s Added the ``timeout`` argument. 7607s """ 7607s if timeout is not None: 7607s if isinstance(timeout, numbers.Real): 7607s timeout = IOLoop.current().time() + timeout 7607s elif isinstance(timeout, datetime.timedelta): 7607s timeout = IOLoop.current().time() + timeout.total_seconds() 7607s else: 7607s raise TypeError("Unsupported timeout %r" % timeout) 7607s if timeout is not None: 7607s addrinfo = await gen.with_timeout( 7607s timeout, self.resolver.resolve(host, port, af) 7607s ) 7607s else: 7607s addrinfo = await self.resolver.resolve(host, port, af) 7607s connector = _Connector( 7607s addrinfo, 7607s functools.partial( 7607s self._create_stream, 7607s max_buffer_size, 7607s source_ip=source_ip, 7607s source_port=source_port, 7607s ), 7607s ) 7607s > af, addr, stream = await connector.start(connect_timeout=timeout) 7607s E asyncio.exceptions.CancelledError 7607s 7607s /usr/lib/python3/dist-packages/tornado/tcpclient.py:279: CancelledError 7607s 7607s The above exception was the direct cause of the following exception: 7607s 7607s self = 7607s 7607s @final 7607s async def start(self): 7607s async with self._startup_lock: 7607s if self.status == Status.failed: 7607s assert self.__startup_exc is not None 7607s raise self.__startup_exc 7607s elif self.status != Status.init: 7607s return self 7607s timeout = getattr(self, "death_timeout", None) 7607s 7607s async def _close_on_failure(exc: Exception) -> None: 7607s await self.close(reason=f"failure-to-start-{str(type(exc))}") 7607s self.status = Status.failed 7607s self.__startup_exc = exc 7607s 7607s try: 7607s > await wait_for(self.start_unsafe(), timeout=timeout) 7607s 7607s /usr/lib/python3/dist-packages/distributed/core.py:528: 7607s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 7607s /usr/lib/python3/dist-packages/distributed/utils.py:1913: in wait_for 7607s async with asyncio.timeout(timeout): 7607s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 7607s 7607s self = 7607s exc_type = 7607s exc_val = CancelledError(), exc_tb = 7607s 7607s async def __aexit__( 7607s self, 7607s exc_type: Optional[Type[BaseException]], 7607s exc_val: Optional[BaseException], 7607s exc_tb: Optional[TracebackType], 7607s ) -> Optional[bool]: 7607s assert self._state in (_State.ENTERED, _State.EXPIRING) 7607s 7607s if self._timeout_handler is not None: 7607s self._timeout_handler.cancel() 7607s self._timeout_handler = None 7607s 7607s if self._state is _State.EXPIRING: 7607s self._state = _State.EXPIRED 7607s 7607s if self._task.uncancel() <= self._cancelling and exc_type is not None: 7607s # Since there are no new cancel requests, we're 7607s # handling this. 7607s if issubclass(exc_type, exceptions.CancelledError): 7607s > raise TimeoutError from exc_val 7607s E TimeoutError 7607s 7607s /usr/lib/python3.13/asyncio/timeouts.py:116: TimeoutError 7607s 7607s The above exception was the direct cause of the following exception: 7607s 7607s @contextlib.asynccontextmanager 7607s async def _cluster_factory(): 7607s workers = [] 7607s s = None 7607s try: 7607s for _ in range(60): 7607s try: 7607s > s, ws = await start_cluster( 7607s nthreads, 7607s scheduler, 7607s security=security, 7607s Worker=Worker, 7607s scheduler_kwargs=scheduler_kwargs, 7607s worker_kwargs=merge( 7607s {"death_timeout": min(15, int(deadline.remaining))}, 7607s worker_kwargs, 7607s ), 7607s ) 7607s 7607s /usr/lib/python3/dist-packages/distributed/utils_test.py:974: 7607s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 7607s /usr/lib/python3/dist-packages/distributed/utils_test.py:791: in start_cluster 7607s await asyncio.gather(*workers) 7607s /usr/lib/python3.13/asyncio/tasks.py:737: in _wrap_awaitable 7607s return await awaitable 7607s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 7607s 7607s self = 7607s 7607s @final 7607s async def start(self): 7607s async with self._startup_lock: 7607s if self.status == Status.failed: 7607s assert self.__startup_exc is not None 7607s raise self.__startup_exc 7607s elif self.status != Status.init: 7607s return self 7607s timeout = getattr(self, "death_timeout", None) 7607s 7607s async def _close_on_failure(exc: Exception) -> None: 7607s await self.close(reason=f"failure-to-start-{str(type(exc))}") 7607s self.status = Status.failed 7607s self.__startup_exc = exc 7607s 7607s try: 7607s await wait_for(self.start_unsafe(), timeout=timeout) 7607s except asyncio.TimeoutError as exc: 7607s await _close_on_failure(exc) 7607s > raise asyncio.TimeoutError( 7607s f"{type(self).__name__} start timed out after {timeout}s." 7607s ) from exc 7607s E TimeoutError: Nanny start timed out after 0s. 7607s 7607s /usr/lib/python3/dist-packages/distributed/core.py:531: TimeoutError 7607s 7607s During handling of the above exception, another exception occurred: 7607s 7607s fut = ._..test_func..async_fn at 0x738868bd7840> 7607s timeout = 60 7607s 7607s async def wait_for(fut: Awaitable[T], timeout: float) -> T: 7607s async with asyncio.timeout(timeout): 7607s > return await fut 7607s 7607s /usr/lib/python3/dist-packages/distributed/utils.py:1914: 7607s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 7607s /usr/lib/python3/dist-packages/distributed/utils_test.py:1007: in async_fn 7607s _cluster_factory() as (s, workers), 7607s /usr/lib/python3.13/contextlib.py:214: in __aenter__ 7607s return await anext(self.gen) 7607s /usr/lib/python3/dist-packages/distributed/utils_test.py:991: in _cluster_factory 7607s await asyncio.sleep(1) 7607s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 7607s 7607s delay = 1, result = None 7607s 7607s async def sleep(delay, result=None): 7607s """Coroutine that completes after a given time (in seconds).""" 7607s if delay <= 0: 7607s await __sleep0() 7607s return result 7607s 7607s if math.isnan(delay): 7607s raise ValueError("Invalid delay: NaN (not a number)") 7607s 7607s loop = events.get_running_loop() 7607s future = loop.create_future() 7607s h = loop.call_later(delay, 7607s futures._set_result_unless_cancelled, 7607s future, result) 7607s try: 7607s > return await future 7607s E asyncio.exceptions.CancelledError 7607s 7607s /usr/lib/python3.13/asyncio/tasks.py:718: CancelledError 7607s 7607s The above exception was the direct cause of the following exception: 7607s 7607s args = (), kwds = {} 7607s 7607s @wraps(func) 7607s def inner(*args, **kwds): 7607s with self._recreate_cm(): 7607s > return func(*args, **kwds) 7607s 7607s /usr/lib/python3.13/contextlib.py:85: 7607s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 7607s /usr/lib/python3.13/contextlib.py:85: in inner 7607s return func(*args, **kwds) 7607s /usr/lib/python3/dist-packages/distributed/utils_test.py:1090: in test_func 7607s return _run_and_close_tornado(async_fn_outer) 7607s /usr/lib/python3/dist-packages/distributed/utils_test.py:380: in _run_and_close_tornado 7607s return asyncio_run(inner_fn(), loop_factory=get_loop_factory()) 7607s /usr/lib/python3.13/asyncio/runners.py:195: in run 7607s return runner.run(main) 7607s /usr/lib/python3.13/asyncio/runners.py:118: in run 7607s return self._loop.run_until_complete(task) 7607s /usr/lib/python3.13/asyncio/base_events.py:725: in run_until_complete 7607s return future.result() 7607s /usr/lib/python3/dist-packages/distributed/utils_test.py:377: in inner_fn 7607s return await async_fn(*args, **kwargs) 7607s /usr/lib/python3/dist-packages/distributed/utils_test.py:1087: in async_fn_outer 7607s return await utils_wait_for(async_fn(), timeout=timeout * 2) 7607s /usr/lib/python3/dist-packages/distributed/utils.py:1913: in wait_for 7607s async with asyncio.timeout(timeout): 7607s _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 7607s 7607s self = 7607s exc_type = 7607s exc_val = CancelledError(), exc_tb = 7607s 7607s async def __aexit__( 7607s self, 7607s exc_type: Optional[Type[BaseException]], 7607s exc_val: Optional[BaseException], 7607s exc_tb: Optional[TracebackType], 7607s ) -> Optional[bool]: 7607s assert self._state in (_State.ENTERED, _State.EXPIRING) 7607s 7607s if self._timeout_handler is not None: 7607s self._timeout_handler.cancel() 7607s self._timeout_handler = None 7607s 7607s if self._state is _State.EXPIRING: 7607s self._state = _State.EXPIRED 7607s 7607s if self._task.uncancel() <= self._cancelling and exc_type is not None: 7607s # Since there are no new cancel requests, we're 7607s # handling this. 7607s if issubclass(exc_type, exceptions.CancelledError): 7607s > raise TimeoutError from exc_val 7607s E TimeoutError 7607s 7607s /usr/lib/python3.13/asyncio/timeouts.py:116: TimeoutError 7607s ----------------------------- Captured stderr call ----------------------------- 7607s 2025-02-21 01:32:29,886 - distributed.http.proxy - INFO - To route to workers diagnostics web server please install jupyter-server-proxy: python -m pip install jupyter-server-proxy 7607s 2025-02-21 01:32:29,888 - distributed.scheduler - INFO - State start 7607s 2025-02-21 01:32:29,892 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:38073 7607s 2025-02-21 01:32:29,892 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:35907/status 7607s 2025-02-21 01:32:29,892 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7607s 2025-02-21 01:32:29,912 - distributed.nanny - INFO - Start Nanny at: 'tls://127.0.0.1:34259' 7607s 2025-02-21 01:32:29,916 - distributed.nanny - INFO - Start Nanny at: 'tls://127.0.0.1:44135' 7607s 2025-02-21 01:32:30,606 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:37875 7607s 2025-02-21 01:32:30,607 - distributed.worker - INFO - Listening to: tls://127.0.0.1:37875 7607s 2025-02-21 01:32:30,607 - distributed.worker - INFO - Worker name: 0 7607s 2025-02-21 01:32:30,607 - distributed.worker - INFO - dashboard at: 127.0.0.1:33911 7607s 2025-02-21 01:32:30,607 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38073 7607s 2025-02-21 01:32:30,607 - distributed.worker - INFO - ------------------------------------------------- 7607s 2025-02-21 01:32:30,607 - distributed.worker - INFO - Threads: 1 7607s 2025-02-21 01:32:30,607 - distributed.worker - INFO - Memory: 7.75 GiB 7607s 2025-02-21 01:32:30,607 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-mu5pazwz 7607s 2025-02-21 01:32:30,607 - distributed.worker - INFO - ------------------------------------------------- 7607s 2025-02-21 01:32:30,662 - distributed.worker - INFO - Start worker at: tls://127.0.0.1:34117 7607s 2025-02-21 01:32:30,662 - distributed.worker - INFO - Listening to: tls://127.0.0.1:34117 7607s 2025-02-21 01:32:30,662 - distributed.worker - INFO - Worker name: 1 7607s 2025-02-21 01:32:30,662 - distributed.worker - INFO - dashboard at: 127.0.0.1:39983 7607s 2025-02-21 01:32:30,662 - distributed.worker - INFO - Waiting to connect to: tls://127.0.0.1:38073 7607s 2025-02-21 01:32:30,662 - distributed.worker - INFO - ------------------------------------------------- 7607s 2025-02-21 01:32:30,662 - distributed.worker - INFO - Threads: 2 7607s 2025-02-21 01:32:30,663 - distributed.worker - INFO - Memory: 7.75 GiB 7607s 2025-02-21 01:32:30,663 - distributed.worker - INFO - Local Directory: /tmp/dask-scratch-space/worker-g4k6ag33 7607s 2025-02-21 01:32:30,663 - distributed.worker - INFO - ------------------------------------------------- 7607s 2025-02-21 01:32:30,963 - distributed.scheduler - INFO - Register worker addr: tls://127.0.0.1:37875 name: 0 7607s 2025-02-21 01:32:30,964 - distributed.scheduler - INFO - Starting worker compute stream, tls://127.0.0.1:37875 7607s 2025-02-21 01:32:30,964 - distributed.core - INFO - Starting established connection to tls://127.0.0.1:40014 7607s 2025-02-21 01:32:30,965 - distributed.worker - INFO - Starting Worker plugin shuffle 7607s 2025-02-21 01:32:30,966 - distributed.worker - INFO - Registered to: tls://127.0.0.1:38073 7607s 2025-02-21 01:32:30,966 - distributed.worker - INFO - ------------------------------------------------- 7607s 2025-02-21 01:32:30,967 - distributed.core - INFO - Starting established connection to tls://127.0.0.1:38073 7607s 2025-02-21 01:32:30,994 - distributed.scheduler - INFO - Register worker addr: tls://127.0.0.1:34117 name: 1 7607s 2025-02-21 01:32:30,995 - distributed.scheduler - INFO - Starting worker compute stream, tls://127.0.0.1:34117 7607s 2025-02-21 01:32:30,995 - distributed.core - INFO - Starting established connection to tls://127.0.0.1:40016 7607s 2025-02-21 01:32:30,995 - distributed.core - INFO - Connection to tls://127.0.0.1:40016 has been closed. 7607s 2025-02-21 01:32:30,995 - distributed.scheduler - INFO - Remove worker addr: tls://127.0.0.1:34117 name: 1 (stimulus_id='handle-worker-cleanup-1740101550.9957242') 7607s 2025-02-21 01:32:30,996 - distributed.worker - INFO - Starting Worker plugin shuffle 7607s 2025-02-21 01:32:30,997 - distributed.batched - INFO - Batched Comm Closed Scheduler local=tls://127.0.0.1:40016 remote=tls://127.0.0.1:38073> 7607s Traceback (most recent call last): 7607s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 297, in write 7607s raise StreamClosedError() 7607s tornado.iostream.StreamClosedError: Stream is closed 7607s 7607s The above exception was the direct cause of the following exception: 7607s 7607s Traceback (most recent call last): 7607s File "/usr/lib/python3/dist-packages/distributed/batched.py", line 115, in _background_send 7607s nbytes = yield coro 7607s ^^^^^^^^^^ 7607s File "/usr/lib/python3/dist-packages/tornado/gen.py", line 766, in run 7607s value = future.result() 7607s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 307, in write 7607s convert_stream_closed_error(self, e) 7607s ~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^ 7607s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 142, in convert_stream_closed_error 7607s raise CommClosedError(f"in {obj}: {exc}") from exc 7607s distributed.comm.core.CommClosedError: in Scheduler local=tls://127.0.0.1:40016 remote=tls://127.0.0.1:38073>: Stream is closed 7607s 2025-02-21 01:32:30,999 - distributed.worker - INFO - Registered to: tls://127.0.0.1:38073 7607s 2025-02-21 01:32:30,999 - distributed.worker - INFO - ------------------------------------------------- 7607s 2025-02-21 01:32:31,000 - distributed.core - INFO - Starting established connection to tls://127.0.0.1:38073 7607s 2025-02-21 01:32:31,000 - distributed.core - INFO - Connection to tls://127.0.0.1:38073 has been closed. 7607s 2025-02-21 01:32:31,000 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:34117. Reason: worker-handle-scheduler-connection-broken 7607s 2025-02-21 01:32:31,050 - distributed.nanny - INFO - Closing Nanny gracefully at 'tls://127.0.0.1:44135'. Reason: worker-handle-scheduler-connection-broken 7607s 2025-02-21 01:32:31,052 - distributed.worker - INFO - Removing Worker plugin shuffle 7607s 2025-02-21 01:32:31,058 - distributed.nanny - INFO - Worker closed 7607s 2025-02-21 01:32:33,060 - distributed.nanny - ERROR - Worker process died unexpectedly 7607s 2025-02-21 01:32:33,304 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:44135'. Reason: nanny-close-gracefully 7607s 2025-02-21 01:32:33,304 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:44135' closed. 7607s 2025-02-21 01:33:01,052 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:34259'. Reason: nanny-close 7607s 2025-02-21 01:33:01,053 - distributed.nanny - INFO - Nanny asking worker to close. Reason: nanny-close 7607s 2025-02-21 01:33:01,054 - distributed.worker - INFO - Stopping worker at tls://127.0.0.1:37875. Reason: nanny-close 7607s 2025-02-21 01:33:01,054 - distributed.worker - INFO - Removing Worker plugin shuffle 7607s 2025-02-21 01:33:01,056 - distributed.core - INFO - Connection to tls://127.0.0.1:38073 has been closed. 7607s 2025-02-21 01:33:01,058 - distributed.core - INFO - Received 'close-stream' from tls://127.0.0.1:40014; closing. 7607s 2025-02-21 01:33:01,058 - distributed.nanny - INFO - Worker closed 7607s 2025-02-21 01:33:01,059 - distributed.scheduler - INFO - Remove worker addr: tls://127.0.0.1:37875 name: 0 (stimulus_id='handle-worker-cleanup-1740101581.0591033') 7607s 2025-02-21 01:33:01,059 - distributed.scheduler - INFO - Lost all workers 7607s 2025-02-21 01:33:01,323 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:34259' closed. 7607s 2025-02-21 01:33:01,323 - distributed.scheduler - INFO - Closing scheduler. Reason: unknown 7607s 2025-02-21 01:33:01,323 - distributed.scheduler - INFO - Scheduler closing all comms 7607s 2025-02-21 01:33:01,324 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Cluster creation timeout; retrying 7607s Traceback (most recent call last): 7607s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 974, in _cluster_factory 7607s s, ws = await start_cluster( 7607s ^^^^^^^^^^^^^^^^^^^^ 7607s ...<9 lines>... 7607s ) 7607s ^ 7607s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 806, in start_cluster 7607s raise TimeoutError("Cluster creation timeout") 7607s TimeoutError: Cluster creation timeout 7607s 2025-02-21 01:33:02,330 - distributed.scheduler - INFO - State start 7607s 2025-02-21 01:33:02,338 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:45573 7607s 2025-02-21 01:33:02,338 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:42873/status 7607s 2025-02-21 01:33:02,338 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7607s 2025-02-21 01:33:02,349 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:35703'. Reason: failure-to-start- 7607s 2025-02-21 01:33:02,350 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:35703' closed. 7607s 2025-02-21 01:33:02,350 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:34481'. Reason: failure-to-start- 7607s 2025-02-21 01:33:02,350 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:34481' closed. 7607s 2025-02-21 01:33:02,351 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45573': TLS handshake failed with remote 'tls://127.0.0.1:59042': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 7607s 2025-02-21 01:33:02,351 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:45573': TLS handshake failed with remote 'tls://127.0.0.1:59052': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 7607s 2025-02-21 01:33:02,351 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 7607s Traceback (most recent call last): 7607s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 7607s return await fut 7607s ^^^^^^^^^ 7607s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 7607s comm = await self.rpc.connect(saddr) 7607s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7607s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1485, in connect 7607s return await self._connect(addr=addr, timeout=timeout) 7607s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7607s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1429, in _connect 7607s comm = await connect( 7607s ^^^^^^^^^^^^^^ 7607s ...<4 lines>... 7607s ) 7607s ^ 7607s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7607s comm = await wait_for( 7607s ^^^^^^^^^^^^^^^ 7607s ...<2 lines>... 7607s ) 7607s ^ 7607s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 7607s return await fut 7607s ^^^^^^^^^ 7607s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7607s stream = await self.client.connect( 7607s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7607s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7607s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7607s ) 7607s ^ 7607s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7607s af, addr, stream = await connector.start(connect_timeout=timeout) 7607s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7607s asyncio.exceptions.CancelledError 7607s 7607s The above exception was the direct cause of the following exception: 7607s 7607s Traceback (most recent call last): 7607s File "/usr/lib/python3/dist-packages/distributed/core.py", line 528, in start 7607s await wait_for(self.start_unsafe(), timeout=timeout) 7607s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1913, in wait_for 7607s async with asyncio.timeout(timeout): 7607s ~~~~~~~~~~~~~~~^^^^^^^^^ 7607s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7607s raise TimeoutError from exc_val 7607s TimeoutError 7607s 7607s The above exception was the direct cause of the following exception: 7607s 7607s Traceback (most recent call last): 7607s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 974, in _cluster_factory 7607s s, ws = await start_cluster( 7607s ^^^^^^^^^^^^^^^^^^^^ 7607s ...<9 lines>... 7607s ) 7607s ^ 7607s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 791, in start_cluster 7607s await asyncio.gather(*workers) 7607s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7607s return await awaitable 7607s ^^^^^^^^^^^^^^^ 7607s File "/usr/lib/python3/dist-packages/distributed/core.py", line 531, in start 7607s raise asyncio.TimeoutError( 7607s f"{type(self).__name__} start timed out after {timeout}s." 7607s ) from exc 7607s TimeoutError: Nanny start timed out after 0s. 7607s 2025-02-21 01:33:03,358 - distributed.scheduler - INFO - State start 7607s 2025-02-21 01:33:03,363 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:40121 7607s 2025-02-21 01:33:03,363 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:38403/status 7607s 2025-02-21 01:33:03,363 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7607s 2025-02-21 01:33:03,372 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:43501'. Reason: failure-to-start- 7607s 2025-02-21 01:33:03,372 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:43501' closed. 7607s 2025-02-21 01:33:03,373 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:44901'. Reason: failure-to-start- 7607s 2025-02-21 01:33:03,373 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:44901' closed. 7607s 2025-02-21 01:33:03,373 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40121': TLS handshake failed with remote 'tls://127.0.0.1:55540': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 7607s 2025-02-21 01:33:03,374 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:40121': TLS handshake failed with remote 'tls://127.0.0.1:55554': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 7607s 2025-02-21 01:33:03,374 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 7607s Traceback (most recent call last): 7607s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 7607s return await fut 7607s ^^^^^^^^^ 7607s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 7607s comm = await self.rpc.connect(saddr) 7607s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7607s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1485, in connect 7607s return await self._connect(addr=addr, timeout=timeout) 7607s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7607s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1429, in _connect 7607s comm = await connect( 7607s ^^^^^^^^^^^^^^ 7607s ...<4 lines>... 7607s ) 7607s ^ 7607s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7607s comm = await wait_for( 7607s ^^^^^^^^^^^^^^^ 7607s ...<2 lines>... 7607s ) 7607s ^ 7607s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 7607s return await fut 7607s ^^^^^^^^^ 7607s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7607s stream = await self.client.connect( 7607s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7607s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7607s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7607s ) 7607s ^ 7607s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7607s af, addr, stream = await connector.start(connect_timeout=timeout) 7607s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7607s asyncio.exceptions.CancelledError 7607s 7607s The above exception was the direct cause of the following exception: 7607s 7607s Traceback (most recent call last): 7607s File "/usr/lib/python3/dist-packages/distributed/core.py", line 528, in start 7607s await wait_for(self.start_unsafe(), timeout=timeout) 7607s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1913, in wait_for 7607s async with asyncio.timeout(timeout): 7607s ~~~~~~~~~~~~~~~^^^^^^^^^ 7607s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7607s raise TimeoutError from exc_val 7607s TimeoutError 7607s 7607s The above exception was the direct cause of the following exception: 7607s 7607s Traceback (most recent call last): 7607s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 974, in _cluster_factory 7607s s, ws = await start_cluster( 7607s ^^^^^^^^^^^^^^^^^^^^ 7607s ...<9 lines>... 7607s ) 7607s ^ 7607s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 791, in start_cluster 7607s await asyncio.gather(*workers) 7607s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7607s return await awaitable 7607s ^^^^^^^^^^^^^^^ 7607s File "/usr/lib/python3/dist-packages/distributed/core.py", line 531, in start 7607s raise asyncio.TimeoutError( 7607s f"{type(self).__name__} start timed out after {timeout}s." 7607s ) from exc 7607s TimeoutError: Nanny start timed out after 0s. 7607s 2025-02-21 01:33:04,385 - distributed.scheduler - INFO - State start 7607s 2025-02-21 01:33:04,399 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:41349 7607s 2025-02-21 01:33:04,400 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:39615/status 7607s 2025-02-21 01:33:04,400 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7607s 2025-02-21 01:33:04,416 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:34091'. Reason: failure-to-start- 7607s 2025-02-21 01:33:04,416 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:34091' closed. 7607s 2025-02-21 01:33:04,416 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:43483'. Reason: failure-to-start- 7607s 2025-02-21 01:33:04,416 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:43483' closed. 7607s 2025-02-21 01:33:04,417 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41349': TLS handshake failed with remote 'tls://127.0.0.1:55436': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 7607s 2025-02-21 01:33:04,418 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41349': TLS handshake failed with remote 'tls://127.0.0.1:55450': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 7607s 2025-02-21 01:33:04,419 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 7607s Traceback (most recent call last): 7607s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 7607s return await fut 7607s ^^^^^^^^^ 7607s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 7607s comm = await self.rpc.connect(saddr) 7607s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7607s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1485, in connect 7607s return await self._connect(addr=addr, timeout=timeout) 7607s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7607s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1429, in _connect 7607s comm = await connect( 7607s ^^^^^^^^^^^^^^ 7607s ...<4 lines>... 7607s ) 7607s ^ 7607s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7607s comm = await wait_for( 7607s ^^^^^^^^^^^^^^^ 7607s ...<2 lines>... 7607s ) 7607s ^ 7607s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 7607s return await fut 7607s ^^^^^^^^^ 7607s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7607s stream = await self.client.connect( 7607s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7607s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7607s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7607s ) 7607s ^ 7607s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7607s af, addr, stream = await connector.start(connect_timeout=timeout) 7607s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7607s asyncio.exceptions.CancelledError 7607s 7607s The above exception was the direct cause of the following exception: 7607s 7607s Traceback (most recent call last): 7607s File "/usr/lib/python3/dist-packages/distributed/core.py", line 528, in start 7607s await wait_for(self.start_unsafe(), timeout=timeout) 7607s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1913, in wait_for 7607s async with asyncio.timeout(timeout): 7607s ~~~~~~~~~~~~~~~^^^^^^^^^ 7607s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7607s raise TimeoutError from exc_val 7607s TimeoutError 7607s 7607s The above exception was the direct cause of the following exception: 7607s 7607s Traceback (most recent call last): 7607s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 974, in _cluster_factory 7607s s, ws = await start_cluster( 7607s ^^^^^^^^^^^^^^^^^^^^ 7607s ...<9 lines>... 7607s ) 7607s ^ 7607s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 791, in start_cluster 7607s await asyncio.gather(*workers) 7607s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7607s return await awaitable 7607s ^^^^^^^^^^^^^^^ 7607s File "/usr/lib/python3/dist-packages/distributed/core.py", line 531, in start 7607s raise asyncio.TimeoutError( 7607s f"{type(self).__name__} start timed out after {timeout}s." 7607s ) from exc 7607s TimeoutError: Nanny start timed out after 0s. 7607s 2025-02-21 01:33:05,425 - distributed.scheduler - INFO - State start 7607s 2025-02-21 01:33:05,430 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:39051 7607s 2025-02-21 01:33:05,431 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:41371/status 7607s 2025-02-21 01:33:05,431 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7607s 2025-02-21 01:33:05,438 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:39299'. Reason: failure-to-start- 7607s 2025-02-21 01:33:05,438 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:39299' closed. 7607s 2025-02-21 01:33:05,438 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:36071'. Reason: failure-to-start- 7607s 2025-02-21 01:33:05,438 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:36071' closed. 7607s 2025-02-21 01:33:05,439 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39051': TLS handshake failed with remote 'tls://127.0.0.1:52666': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 7607s 2025-02-21 01:33:05,439 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:39051': TLS handshake failed with remote 'tls://127.0.0.1:52682': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 7607s 2025-02-21 01:33:05,439 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 7607s Traceback (most recent call last): 7607s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 7607s return await fut 7607s ^^^^^^^^^ 7607s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 7607s comm = await self.rpc.connect(saddr) 7607s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7607s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1485, in connect 7607s return await self._connect(addr=addr, timeout=timeout) 7607s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7607s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1429, in _connect 7607s comm = await connect( 7607s ^^^^^^^^^^^^^^ 7607s ...<4 lines>... 7607s ) 7607s ^ 7607s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7607s comm = await wait_for( 7607s ^^^^^^^^^^^^^^^ 7607s ...<2 lines>... 7607s ) 7607s ^ 7607s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 7607s return await fut 7607s ^^^^^^^^^ 7607s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7607s stream = await self.client.connect( 7607s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7607s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7607s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7607s ) 7607s ^ 7607s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7607s af, addr, stream = await connector.start(connect_timeout=timeout) 7607s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7607s asyncio.exceptions.CancelledError 7607s 7607s The above exception was the direct cause of the following exception: 7607s 7607s Traceback (most recent call last): 7607s File "/usr/lib/python3/dist-packages/distributed/core.py", line 528, in start 7607s await wait_for(self.start_unsafe(), timeout=timeout) 7607s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1913, in wait_for 7607s async with asyncio.timeout(timeout): 7607s ~~~~~~~~~~~~~~~^^^^^^^^^ 7607s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7607s raise TimeoutError from exc_val 7607s TimeoutError 7607s 7607s The above exception was the direct cause of the following exception: 7607s 7607s Traceback (most recent call last): 7607s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 974, in _cluster_factory 7607s s, ws = await start_cluster( 7607s ^^^^^^^^^^^^^^^^^^^^ 7607s ...<9 lines>... 7607s ) 7607s ^ 7607s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 791, in start_cluster 7607s await asyncio.gather(*workers) 7607s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7607s return await awaitable 7607s ^^^^^^^^^^^^^^^ 7607s File "/usr/lib/python3/dist-packages/distributed/core.py", line 531, in start 7607s raise asyncio.TimeoutError( 7607s f"{type(self).__name__} start timed out after {timeout}s." 7607s ) from exc 7607s TimeoutError: Nanny start timed out after 0s. 7607s 2025-02-21 01:33:06,444 - distributed.scheduler - INFO - State start 7607s 2025-02-21 01:33:06,450 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:46563 7607s 2025-02-21 01:33:06,451 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:37659/status 7607s 2025-02-21 01:33:06,451 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7607s 2025-02-21 01:33:06,460 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:42795'. Reason: failure-to-start- 7607s 2025-02-21 01:33:06,460 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:42795' closed. 7607s 2025-02-21 01:33:06,460 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:44089'. Reason: failure-to-start- 7607s 2025-02-21 01:33:06,460 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:44089' closed. 7607s 2025-02-21 01:33:06,461 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46563': TLS handshake failed with remote 'tls://127.0.0.1:37846': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 7607s 2025-02-21 01:33:06,461 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46563': TLS handshake failed with remote 'tls://127.0.0.1:37860': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 7607s 2025-02-21 01:33:06,461 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 7607s Traceback (most recent call last): 7607s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 7607s return await fut 7607s ^^^^^^^^^ 7607s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 7607s comm = await self.rpc.connect(saddr) 7607s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7607s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1485, in connect 7607s return await self._connect(addr=addr, timeout=timeout) 7607s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7607s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1429, in _connect 7607s comm = await connect( 7607s ^^^^^^^^^^^^^^ 7607s ...<4 lines>... 7607s ) 7607s ^ 7607s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7607s comm = await wait_for( 7607s ^^^^^^^^^^^^^^^ 7607s ...<2 lines>... 7607s ) 7607s ^ 7607s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 7607s return await fut 7607s ^^^^^^^^^ 7607s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7607s stream = await self.client.connect( 7607s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7607s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7607s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7607s ) 7607s ^ 7607s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7607s af, addr, stream = await connector.start(connect_timeout=timeout) 7607s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7607s asyncio.exceptions.CancelledError 7607s 7607s The above exception was the direct cause of the following exception: 7607s 7607s Traceback (most recent call last): 7607s File "/usr/lib/python3/dist-packages/distributed/core.py", line 528, in start 7607s await wait_for(self.start_unsafe(), timeout=timeout) 7607s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1913, in wait_for 7607s async with asyncio.timeout(timeout): 7607s ~~~~~~~~~~~~~~~^^^^^^^^^ 7607s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7607s raise TimeoutError from exc_val 7607s TimeoutError 7607s 7607s The above exception was the direct cause of the following exception: 7607s 7607s Traceback (most recent call last): 7607s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 974, in _cluster_factory 7607s s, ws = await start_cluster( 7607s ^^^^^^^^^^^^^^^^^^^^ 7607s ...<9 lines>... 7607s ) 7607s ^ 7607s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 791, in start_cluster 7607s await asyncio.gather(*workers) 7607s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7607s return await awaitable 7607s ^^^^^^^^^^^^^^^ 7607s File "/usr/lib/python3/dist-packages/distributed/core.py", line 531, in start 7607s raise asyncio.TimeoutError( 7607s f"{type(self).__name__} start timed out after {timeout}s." 7607s ) from exc 7607s TimeoutError: Nanny start timed out after 0s. 7607s 2025-02-21 01:33:07,469 - distributed.scheduler - INFO - State start 7607s 2025-02-21 01:33:07,474 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:35473 7607s 2025-02-21 01:33:07,475 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:38025/status 7607s 2025-02-21 01:33:07,475 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7607s 2025-02-21 01:33:07,486 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:42689'. Reason: failure-to-start- 7607s 2025-02-21 01:33:07,486 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:42689' closed. 7607s 2025-02-21 01:33:07,486 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:39841'. Reason: failure-to-start- 7607s 2025-02-21 01:33:07,486 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:39841' closed. 7607s 2025-02-21 01:33:07,487 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35473': TLS handshake failed with remote 'tls://127.0.0.1:54858': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 7607s 2025-02-21 01:33:07,487 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35473': TLS handshake failed with remote 'tls://127.0.0.1:54862': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 7607s 2025-02-21 01:33:07,487 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 7607s Traceback (most recent call last): 7607s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 7607s return await fut 7607s ^^^^^^^^^ 7607s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 7607s comm = await self.rpc.connect(saddr) 7607s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7607s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1485, in connect 7607s return await self._connect(addr=addr, timeout=timeout) 7607s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7607s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1429, in _connect 7607s comm = await connect( 7607s ^^^^^^^^^^^^^^ 7607s ...<4 lines>... 7607s ) 7607s ^ 7607s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7607s comm = await wait_for( 7607s ^^^^^^^^^^^^^^^ 7607s ...<2 lines>... 7607s ) 7607s ^ 7607s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 7607s return await fut 7607s ^^^^^^^^^ 7607s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7607s stream = await self.client.connect( 7607s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7607s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7607s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7607s ) 7607s ^ 7607s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7607s af, addr, stream = await connector.start(connect_timeout=timeout) 7607s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7607s asyncio.exceptions.CancelledError 7607s 7607s The above exception was the direct cause of the following exception: 7607s 7607s Traceback (most recent call last): 7607s File "/usr/lib/python3/dist-packages/distributed/core.py", line 528, in start 7607s await wait_for(self.start_unsafe(), timeout=timeout) 7607s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1913, in wait_for 7607s async with asyncio.timeout(timeout): 7607s ~~~~~~~~~~~~~~~^^^^^^^^^ 7607s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7607s raise TimeoutError from exc_val 7607s TimeoutError 7607s 7607s The above exception was the direct cause of the following exception: 7607s 7607s Traceback (most recent call last): 7607s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 974, in _cluster_factory 7607s s, ws = await start_cluster( 7607s ^^^^^^^^^^^^^^^^^^^^ 7607s ...<9 lines>... 7607s ) 7607s ^ 7607s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 791, in start_cluster 7607s await asyncio.gather(*workers) 7607s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7607s return await awaitable 7607s ^^^^^^^^^^^^^^^ 7607s File "/usr/lib/python3/dist-packages/distributed/core.py", line 531, in start 7607s raise asyncio.TimeoutError( 7607s f"{type(self).__name__} start timed out after {timeout}s." 7607s ) from exc 7607s TimeoutError: Nanny start timed out after 0s. 7607s 2025-02-21 01:33:08,494 - distributed.scheduler - INFO - State start 7607s 2025-02-21 01:33:08,501 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:34595 7607s 2025-02-21 01:33:08,501 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:43689/status 7607s 2025-02-21 01:33:08,501 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7607s 2025-02-21 01:33:08,509 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:33587'. Reason: failure-to-start- 7607s 2025-02-21 01:33:08,509 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:33587' closed. 7607s 2025-02-21 01:33:08,509 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:36215'. Reason: failure-to-start- 7607s 2025-02-21 01:33:08,510 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:36215' closed. 7607s 2025-02-21 01:33:08,510 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34595': TLS handshake failed with remote 'tls://127.0.0.1:48734': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 7607s 2025-02-21 01:33:08,510 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34595': TLS handshake failed with remote 'tls://127.0.0.1:48736': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 7607s 2025-02-21 01:33:08,510 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 7607s Traceback (most recent call last): 7607s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 7607s return await fut 7607s ^^^^^^^^^ 7607s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 7607s comm = await self.rpc.connect(saddr) 7607s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7607s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1485, in connect 7607s return await self._connect(addr=addr, timeout=timeout) 7607s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7607s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1429, in _connect 7607s comm = await connect( 7607s ^^^^^^^^^^^^^^ 7607s ...<4 lines>... 7607s ) 7607s ^ 7607s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7607s comm = await wait_for( 7607s ^^^^^^^^^^^^^^^ 7607s ...<2 lines>... 7607s ) 7607s ^ 7607s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 7607s return await fut 7607s ^^^^^^^^^ 7607s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7607s stream = await self.client.connect( 7607s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7607s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7607s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7607s ) 7607s ^ 7607s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7607s af, addr, stream = await connector.start(connect_timeout=timeout) 7607s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7607s asyncio.exceptions.CancelledError 7607s 7607s The above exception was the direct cause of the following exception: 7607s 7607s Traceback (most recent call last): 7607s File "/usr/lib/python3/dist-packages/distributed/core.py", line 528, in start 7607s await wait_for(self.start_unsafe(), timeout=timeout) 7607s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1913, in wait_for 7607s async with asyncio.timeout(timeout): 7607s ~~~~~~~~~~~~~~~^^^^^^^^^ 7607s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7607s raise TimeoutError from exc_val 7607s TimeoutError 7607s 7607s The above exception was the direct cause of the following exception: 7607s 7607s Traceback (most recent call last): 7607s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 974, in _cluster_factory 7607s s, ws = await start_cluster( 7607s ^^^^^^^^^^^^^^^^^^^^ 7607s ...<9 lines>... 7607s ) 7607s ^ 7607s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 791, in start_cluster 7607s await asyncio.gather(*workers) 7607s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7607s return await awaitable 7607s ^^^^^^^^^^^^^^^ 7607s File "/usr/lib/python3/dist-packages/distributed/core.py", line 531, in start 7607s raise asyncio.TimeoutError( 7607s f"{type(self).__name__} start timed out after {timeout}s." 7607s ) from exc 7607s TimeoutError: Nanny start timed out after 0s. 7607s 2025-02-21 01:33:09,518 - distributed.scheduler - INFO - State start 7607s 2025-02-21 01:33:09,522 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37967 7607s 2025-02-21 01:33:09,523 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:45617/status 7607s 2025-02-21 01:33:09,523 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7607s 2025-02-21 01:33:09,532 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:35561'. Reason: failure-to-start- 7607s 2025-02-21 01:33:09,532 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:35561' closed. 7607s 2025-02-21 01:33:09,532 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:39743'. Reason: failure-to-start- 7607s 2025-02-21 01:33:09,532 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:39743' closed. 7607s 2025-02-21 01:33:09,532 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37967': TLS handshake failed with remote 'tls://127.0.0.1:57590': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 7607s 2025-02-21 01:33:09,533 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37967': TLS handshake failed with remote 'tls://127.0.0.1:57598': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 7607s 2025-02-21 01:33:09,533 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 7607s Traceback (most recent call last): 7607s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 7607s return await fut 7607s ^^^^^^^^^ 7607s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 7607s comm = await self.rpc.connect(saddr) 7607s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7607s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1485, in connect 7607s return await self._connect(addr=addr, timeout=timeout) 7607s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7607s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1429, in _connect 7607s comm = await connect( 7607s ^^^^^^^^^^^^^^ 7607s ...<4 lines>... 7607s ) 7607s ^ 7607s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7607s comm = await wait_for( 7607s ^^^^^^^^^^^^^^^ 7607s ...<2 lines>... 7607s ) 7607s ^ 7607s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 7607s return await fut 7607s ^^^^^^^^^ 7607s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7607s stream = await self.client.connect( 7607s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7607s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7607s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7607s ) 7607s ^ 7607s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7607s af, addr, stream = await connector.start(connect_timeout=timeout) 7607s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7607s asyncio.exceptions.CancelledError 7607s 7607s The above exception was the direct cause of the following exception: 7607s 7607s Traceback (most recent call last): 7607s File "/usr/lib/python3/dist-packages/distributed/core.py", line 528, in start 7607s await wait_for(self.start_unsafe(), timeout=timeout) 7607s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1913, in wait_for 7607s async with asyncio.timeout(timeout): 7607s ~~~~~~~~~~~~~~~^^^^^^^^^ 7607s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7607s raise TimeoutError from exc_val 7607s TimeoutError 7607s 7607s The above exception was the direct cause of the following exception: 7607s 7607s Traceback (most recent call last): 7607s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 974, in _cluster_factory 7607s s, ws = await start_cluster( 7607s ^^^^^^^^^^^^^^^^^^^^ 7607s ...<9 lines>... 7607s ) 7607s ^ 7607s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 791, in start_cluster 7607s await asyncio.gather(*workers) 7607s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7607s return await awaitable 7607s ^^^^^^^^^^^^^^^ 7607s File "/usr/lib/python3/dist-packages/distributed/core.py", line 531, in start 7607s raise asyncio.TimeoutError( 7607s f"{type(self).__name__} start timed out after {timeout}s." 7607s ) from exc 7607s TimeoutError: Nanny start timed out after 0s. 7607s 2025-02-21 01:33:10,539 - distributed.scheduler - INFO - State start 7607s 2025-02-21 01:33:10,544 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:43457 7607s 2025-02-21 01:33:10,544 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:33703/status 7607s 2025-02-21 01:33:10,544 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7607s 2025-02-21 01:33:10,553 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:44531'. Reason: failure-to-start- 7607s 2025-02-21 01:33:10,553 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:44531' closed. 7607s 2025-02-21 01:33:10,553 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:37289'. Reason: failure-to-start- 7607s 2025-02-21 01:33:10,553 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:37289' closed. 7607s 2025-02-21 01:33:10,554 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43457': TLS handshake failed with remote 'tls://127.0.0.1:45584': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 7607s 2025-02-21 01:33:10,554 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43457': TLS handshake failed with remote 'tls://127.0.0.1:45586': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 7607s 2025-02-21 01:33:10,554 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 7607s Traceback (most recent call last): 7607s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 7607s return await fut 7607s ^^^^^^^^^ 7607s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 7607s comm = await self.rpc.connect(saddr) 7607s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7607s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1485, in connect 7607s return await self._connect(addr=addr, timeout=timeout) 7607s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7607s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1429, in _connect 7607s comm = await connect( 7607s ^^^^^^^^^^^^^^ 7607s ...<4 lines>... 7607s ) 7607s ^ 7607s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7607s comm = await wait_for( 7607s ^^^^^^^^^^^^^^^ 7607s ...<2 lines>... 7607s ) 7607s ^ 7607s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 7607s return await fut 7607s ^^^^^^^^^ 7607s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7607s stream = await self.client.connect( 7607s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7607s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7607s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7607s ) 7607s ^ 7607s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7607s af, addr, stream = await connector.start(connect_timeout=timeout) 7607s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7607s asyncio.exceptions.CancelledError 7607s 7607s The above exception was the direct cause of the following exception: 7607s 7607s Traceback (most recent call last): 7607s File "/usr/lib/python3/dist-packages/distributed/core.py", line 528, in start 7607s await wait_for(self.start_unsafe(), timeout=timeout) 7607s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1913, in wait_for 7607s async with asyncio.timeout(timeout): 7607s ~~~~~~~~~~~~~~~^^^^^^^^^ 7607s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7607s raise TimeoutError from exc_val 7607s TimeoutError 7607s 7607s The above exception was the direct cause of the following exception: 7607s 7607s Traceback (most recent call last): 7607s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 974, in _cluster_factory 7607s s, ws = await start_cluster( 7607s ^^^^^^^^^^^^^^^^^^^^ 7607s ...<9 lines>... 7607s ) 7607s ^ 7607s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 791, in start_cluster 7607s await asyncio.gather(*workers) 7607s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7607s return await awaitable 7607s ^^^^^^^^^^^^^^^ 7607s File "/usr/lib/python3/dist-packages/distributed/core.py", line 531, in start 7607s raise asyncio.TimeoutError( 7607s f"{type(self).__name__} start timed out after {timeout}s." 7607s ) from exc 7607s TimeoutError: Nanny start timed out after 0s. 7607s 2025-02-21 01:33:11,560 - distributed.scheduler - INFO - State start 7607s 2025-02-21 01:33:11,565 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:41239 7607s 2025-02-21 01:33:11,565 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:39435/status 7607s 2025-02-21 01:33:11,566 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7607s 2025-02-21 01:33:11,576 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:43409'. Reason: failure-to-start- 7607s 2025-02-21 01:33:11,576 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:43409' closed. 7607s 2025-02-21 01:33:11,576 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:43757'. Reason: failure-to-start- 7607s 2025-02-21 01:33:11,576 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:43757' closed. 7607s 2025-02-21 01:33:11,577 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41239': TLS handshake failed with remote 'tls://127.0.0.1:59820': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 7607s 2025-02-21 01:33:11,577 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41239': TLS handshake failed with remote 'tls://127.0.0.1:59832': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 7607s 2025-02-21 01:33:11,577 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 7607s Traceback (most recent call last): 7607s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 7607s return await fut 7607s ^^^^^^^^^ 7607s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 7607s comm = await self.rpc.connect(saddr) 7607s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7607s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1485, in connect 7607s return await self._connect(addr=addr, timeout=timeout) 7607s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7607s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1429, in _connect 7607s comm = await connect( 7607s ^^^^^^^^^^^^^^ 7607s ...<4 lines>... 7607s ) 7607s ^ 7607s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7607s comm = await wait_for( 7607s ^^^^^^^^^^^^^^^ 7607s ...<2 lines>... 7607s ) 7607s ^ 7607s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 7607s return await fut 7607s ^^^^^^^^^ 7607s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7607s stream = await self.client.connect( 7607s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7607s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7607s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7607s ) 7607s ^ 7607s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7607s af, addr, stream = await connector.start(connect_timeout=timeout) 7607s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7607s asyncio.exceptions.CancelledError 7607s 7607s The above exception was the direct cause of the following exception: 7607s 7607s Traceback (most recent call last): 7607s File "/usr/lib/python3/dist-packages/distributed/core.py", line 528, in start 7607s await wait_for(self.start_unsafe(), timeout=timeout) 7607s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1913, in wait_for 7607s async with asyncio.timeout(timeout): 7607s ~~~~~~~~~~~~~~~^^^^^^^^^ 7607s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7607s raise TimeoutError from exc_val 7607s TimeoutError 7607s 7607s The above exception was the direct cause of the following exception: 7607s 7607s Traceback (most recent call last): 7607s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 974, in _cluster_factory 7607s s, ws = await start_cluster( 7607s ^^^^^^^^^^^^^^^^^^^^ 7607s ...<9 lines>... 7607s ) 7607s ^ 7607s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 791, in start_cluster 7607s await asyncio.gather(*workers) 7607s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7607s return await awaitable 7607s ^^^^^^^^^^^^^^^ 7607s File "/usr/lib/python3/dist-packages/distributed/core.py", line 531, in start 7607s raise asyncio.TimeoutError( 7607s f"{type(self).__name__} start timed out after {timeout}s." 7607s ) from exc 7607s TimeoutError: Nanny start timed out after 0s. 7607s 2025-02-21 01:33:12,583 - distributed.scheduler - INFO - State start 7607s 2025-02-21 01:33:12,592 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:43293 7607s 2025-02-21 01:33:12,593 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:35781/status 7607s 2025-02-21 01:33:12,593 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7607s 2025-02-21 01:33:12,601 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:35373'. Reason: failure-to-start- 7607s 2025-02-21 01:33:12,601 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:35373' closed. 7607s 2025-02-21 01:33:12,601 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:44921'. Reason: failure-to-start- 7607s 2025-02-21 01:33:12,602 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:44921' closed. 7607s 2025-02-21 01:33:12,602 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43293': TLS handshake failed with remote 'tls://127.0.0.1:45612': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 7607s 2025-02-21 01:33:12,602 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:43293': TLS handshake failed with remote 'tls://127.0.0.1:45616': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 7607s 2025-02-21 01:33:12,602 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 7607s Traceback (most recent call last): 7607s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 7607s return await fut 7607s ^^^^^^^^^ 7607s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 7607s comm = await self.rpc.connect(saddr) 7607s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7607s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1485, in connect 7607s return await self._connect(addr=addr, timeout=timeout) 7607s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7607s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1429, in _connect 7607s comm = await connect( 7607s ^^^^^^^^^^^^^^ 7607s ...<4 lines>... 7607s ) 7607s ^ 7607s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7607s comm = await wait_for( 7607s ^^^^^^^^^^^^^^^ 7607s ...<2 lines>... 7607s ) 7607s ^ 7607s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 7607s return await fut 7607s ^^^^^^^^^ 7607s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7607s stream = await self.client.connect( 7607s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7607s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7607s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7607s ) 7607s ^ 7607s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7607s af, addr, stream = await connector.start(connect_timeout=timeout) 7607s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7607s asyncio.exceptions.CancelledError 7607s 7607s The above exception was the direct cause of the following exception: 7607s 7607s Traceback (most recent call last): 7607s File "/usr/lib/python3/dist-packages/distributed/core.py", line 528, in start 7607s await wait_for(self.start_unsafe(), timeout=timeout) 7607s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1913, in wait_for 7607s async with asyncio.timeout(timeout): 7607s ~~~~~~~~~~~~~~~^^^^^^^^^ 7607s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7607s raise TimeoutError from exc_val 7607s TimeoutError 7607s 7607s The above exception was the direct cause of the following exception: 7607s 7607s Traceback (most recent call last): 7607s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 974, in _cluster_factory 7607s s, ws = await start_cluster( 7607s ^^^^^^^^^^^^^^^^^^^^ 7607s ...<9 lines>... 7607s ) 7607s ^ 7607s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 791, in start_cluster 7607s await asyncio.gather(*workers) 7607s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7607s return await awaitable 7607s ^^^^^^^^^^^^^^^ 7607s File "/usr/lib/python3/dist-packages/distributed/core.py", line 531, in start 7607s raise asyncio.TimeoutError( 7607s f"{type(self).__name__} start timed out after {timeout}s." 7607s ) from exc 7607s TimeoutError: Nanny start timed out after 0s. 7607s 2025-02-21 01:33:13,607 - distributed.scheduler - INFO - State start 7607s 2025-02-21 01:33:13,611 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:34589 7607s 2025-02-21 01:33:13,611 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:38619/status 7607s 2025-02-21 01:33:13,611 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7607s 2025-02-21 01:33:13,619 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:39023'. Reason: failure-to-start- 7607s 2025-02-21 01:33:13,620 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:39023' closed. 7607s 2025-02-21 01:33:13,620 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:35911'. Reason: failure-to-start- 7607s 2025-02-21 01:33:13,620 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:35911' closed. 7607s 2025-02-21 01:33:13,620 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34589': TLS handshake failed with remote 'tls://127.0.0.1:55024': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 7607s 2025-02-21 01:33:13,620 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34589': TLS handshake failed with remote 'tls://127.0.0.1:55038': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 7607s 2025-02-21 01:33:13,621 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 7607s Traceback (most recent call last): 7607s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 7607s return await fut 7607s ^^^^^^^^^ 7607s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 7607s comm = await self.rpc.connect(saddr) 7607s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7607s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1485, in connect 7607s return await self._connect(addr=addr, timeout=timeout) 7607s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7607s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1429, in _connect 7607s comm = await connect( 7607s ^^^^^^^^^^^^^^ 7607s ...<4 lines>... 7607s ) 7607s ^ 7607s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7607s comm = await wait_for( 7607s ^^^^^^^^^^^^^^^ 7607s ...<2 lines>... 7607s ) 7607s ^ 7607s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 7607s return await fut 7607s ^^^^^^^^^ 7607s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7607s stream = await self.client.connect( 7607s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7607s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7607s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7607s ) 7607s ^ 7607s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7607s af, addr, stream = await connector.start(connect_timeout=timeout) 7607s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7607s asyncio.exceptions.CancelledError 7607s 7607s The above exception was the direct cause of the following exception: 7607s 7607s Traceback (most recent call last): 7607s File "/usr/lib/python3/dist-packages/distributed/core.py", line 528, in start 7607s await wait_for(self.start_unsafe(), timeout=timeout) 7607s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1913, in wait_for 7607s async with asyncio.timeout(timeout): 7607s ~~~~~~~~~~~~~~~^^^^^^^^^ 7607s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7607s raise TimeoutError from exc_val 7607s TimeoutError 7607s 7607s The above exception was the direct cause of the following exception: 7607s 7607s Traceback (most recent call last): 7607s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 974, in _cluster_factory 7607s s, ws = await start_cluster( 7607s ^^^^^^^^^^^^^^^^^^^^ 7607s ...<9 lines>... 7607s ) 7607s ^ 7607s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 791, in start_cluster 7607s await asyncio.gather(*workers) 7607s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7607s return await awaitable 7607s ^^^^^^^^^^^^^^^ 7607s File "/usr/lib/python3/dist-packages/distributed/core.py", line 531, in start 7607s raise asyncio.TimeoutError( 7607s f"{type(self).__name__} start timed out after {timeout}s." 7607s ) from exc 7607s TimeoutError: Nanny start timed out after 0s. 7607s 2025-02-21 01:33:14,627 - distributed.scheduler - INFO - State start 7607s 2025-02-21 01:33:14,631 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:46819 7607s 2025-02-21 01:33:14,631 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:34447/status 7607s 2025-02-21 01:33:14,632 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7607s 2025-02-21 01:33:14,643 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:41611'. Reason: failure-to-start- 7607s 2025-02-21 01:33:14,644 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:41611' closed. 7607s 2025-02-21 01:33:14,644 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:41635'. Reason: failure-to-start- 7607s 2025-02-21 01:33:14,645 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:41635' closed. 7607s 2025-02-21 01:33:14,645 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46819': TLS handshake failed with remote 'tls://127.0.0.1:39690': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 7607s 2025-02-21 01:33:14,645 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46819': TLS handshake failed with remote 'tls://127.0.0.1:39704': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 7607s 2025-02-21 01:33:14,645 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 7607s Traceback (most recent call last): 7607s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 7607s return await fut 7607s ^^^^^^^^^ 7607s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 7607s comm = await self.rpc.connect(saddr) 7607s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7607s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1485, in connect 7607s return await self._connect(addr=addr, timeout=timeout) 7607s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7607s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1429, in _connect 7607s comm = await connect( 7607s ^^^^^^^^^^^^^^ 7607s ...<4 lines>... 7607s ) 7607s ^ 7607s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7607s comm = await wait_for( 7607s ^^^^^^^^^^^^^^^ 7607s ...<2 lines>... 7607s ) 7607s ^ 7607s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 7607s return await fut 7607s ^^^^^^^^^ 7607s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7607s stream = await self.client.connect( 7607s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7607s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7607s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7607s ) 7607s ^ 7607s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7607s af, addr, stream = await connector.start(connect_timeout=timeout) 7607s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7607s asyncio.exceptions.CancelledError 7607s 7607s The above exception was the direct cause of the following exception: 7607s 7607s Traceback (most recent call last): 7607s File "/usr/lib/python3/dist-packages/distributed/core.py", line 528, in start 7607s await wait_for(self.start_unsafe(), timeout=timeout) 7607s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1913, in wait_for 7607s async with asyncio.timeout(timeout): 7607s ~~~~~~~~~~~~~~~^^^^^^^^^ 7607s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7607s raise TimeoutError from exc_val 7607s TimeoutError 7607s 7607s The above exception was the direct cause of the following exception: 7607s 7607s Traceback (most recent call last): 7607s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 974, in _cluster_factory 7607s s, ws = await start_cluster( 7607s ^^^^^^^^^^^^^^^^^^^^ 7607s ...<9 lines>... 7607s ) 7607s ^ 7607s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 791, in start_cluster 7607s await asyncio.gather(*workers) 7607s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7607s return await awaitable 7607s ^^^^^^^^^^^^^^^ 7607s File "/usr/lib/python3/dist-packages/distributed/core.py", line 531, in start 7607s raise asyncio.TimeoutError( 7607s f"{type(self).__name__} start timed out after {timeout}s." 7607s ) from exc 7607s TimeoutError: Nanny start timed out after 0s. 7607s 2025-02-21 01:33:15,652 - distributed.scheduler - INFO - State start 7607s 2025-02-21 01:33:15,656 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:41271 7607s 2025-02-21 01:33:15,657 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:43189/status 7607s 2025-02-21 01:33:15,657 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7607s 2025-02-21 01:33:15,665 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:45825'. Reason: failure-to-start- 7607s 2025-02-21 01:33:15,666 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:45825' closed. 7607s 2025-02-21 01:33:15,666 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:37627'. Reason: failure-to-start- 7607s 2025-02-21 01:33:15,666 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:37627' closed. 7607s 2025-02-21 01:33:15,667 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41271': TLS handshake failed with remote 'tls://127.0.0.1:33412': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 7607s 2025-02-21 01:33:15,667 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41271': TLS handshake failed with remote 'tls://127.0.0.1:33418': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 7607s 2025-02-21 01:33:15,667 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 7607s Traceback (most recent call last): 7607s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 7607s return await fut 7607s ^^^^^^^^^ 7607s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 7607s comm = await self.rpc.connect(saddr) 7607s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7607s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1485, in connect 7607s return await self._connect(addr=addr, timeout=timeout) 7607s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7607s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1429, in _connect 7607s comm = await connect( 7607s ^^^^^^^^^^^^^^ 7607s ...<4 lines>... 7607s ) 7607s ^ 7607s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7607s comm = await wait_for( 7607s ^^^^^^^^^^^^^^^ 7607s ...<2 lines>... 7607s ) 7607s ^ 7607s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 7607s return await fut 7607s ^^^^^^^^^ 7607s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7607s stream = await self.client.connect( 7607s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7607s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7607s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7607s ) 7607s ^ 7607s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7607s af, addr, stream = await connector.start(connect_timeout=timeout) 7607s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7607s asyncio.exceptions.CancelledError 7607s 7607s The above exception was the direct cause of the following exception: 7607s 7607s Traceback (most recent call last): 7607s File "/usr/lib/python3/dist-packages/distributed/core.py", line 528, in start 7607s await wait_for(self.start_unsafe(), timeout=timeout) 7607s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1913, in wait_for 7607s async with asyncio.timeout(timeout): 7607s ~~~~~~~~~~~~~~~^^^^^^^^^ 7607s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7607s raise TimeoutError from exc_val 7607s TimeoutError 7607s 7607s The above exception was the direct cause of the following exception: 7607s 7607s Traceback (most recent call last): 7607s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 974, in _cluster_factory 7607s s, ws = await start_cluster( 7607s ^^^^^^^^^^^^^^^^^^^^ 7607s ...<9 lines>... 7607s ) 7607s ^ 7607s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 791, in start_cluster 7607s await asyncio.gather(*workers) 7607s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7607s return await awaitable 7607s ^^^^^^^^^^^^^^^ 7607s File "/usr/lib/python3/dist-packages/distributed/core.py", line 531, in start 7607s raise asyncio.TimeoutError( 7607s f"{type(self).__name__} start timed out after {timeout}s." 7607s ) from exc 7607s TimeoutError: Nanny start timed out after 0s. 7607s 2025-02-21 01:33:16,672 - distributed.scheduler - INFO - State start 7607s 2025-02-21 01:33:16,676 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:36237 7607s 2025-02-21 01:33:16,676 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:40103/status 7607s 2025-02-21 01:33:16,676 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7607s 2025-02-21 01:33:16,683 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:39243'. Reason: failure-to-start- 7607s 2025-02-21 01:33:16,683 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:39243' closed. 7607s 2025-02-21 01:33:16,683 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:40665'. Reason: failure-to-start- 7607s 2025-02-21 01:33:16,684 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:40665' closed. 7607s 2025-02-21 01:33:16,684 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36237': TLS handshake failed with remote 'tls://127.0.0.1:35750': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 7607s 2025-02-21 01:33:16,684 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:36237': TLS handshake failed with remote 'tls://127.0.0.1:35760': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 7607s 2025-02-21 01:33:16,684 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 7607s Traceback (most recent call last): 7607s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 7607s return await fut 7607s ^^^^^^^^^ 7607s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 7607s comm = await self.rpc.connect(saddr) 7607s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7607s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1485, in connect 7607s return await self._connect(addr=addr, timeout=timeout) 7607s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7607s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1429, in _connect 7607s comm = await connect( 7607s ^^^^^^^^^^^^^^ 7607s ...<4 lines>... 7607s ) 7607s ^ 7607s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7607s comm = await wait_for( 7607s ^^^^^^^^^^^^^^^ 7607s ...<2 lines>... 7607s ) 7607s ^ 7607s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 7607s return await fut 7607s ^^^^^^^^^ 7607s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7607s stream = await self.client.connect( 7607s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7607s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7607s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7607s ) 7607s ^ 7607s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7607s af, addr, stream = await connector.start(connect_timeout=timeout) 7607s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7607s asyncio.exceptions.CancelledError 7607s 7607s The above exception was the direct cause of the following exception: 7607s 7607s Traceback (most recent call last): 7607s File "/usr/lib/python3/dist-packages/distributed/core.py", line 528, in start 7607s await wait_for(self.start_unsafe(), timeout=timeout) 7607s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1913, in wait_for 7607s async with asyncio.timeout(timeout): 7607s ~~~~~~~~~~~~~~~^^^^^^^^^ 7607s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7607s raise TimeoutError from exc_val 7607s TimeoutError 7607s 7607s The above exception was the direct cause of the following exception: 7607s 7607s Traceback (most recent call last): 7607s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 974, in _cluster_factory 7607s s, ws = await start_cluster( 7607s ^^^^^^^^^^^^^^^^^^^^ 7607s ...<9 lines>... 7607s ) 7607s ^ 7607s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 791, in start_cluster 7607s await asyncio.gather(*workers) 7607s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7607s return await awaitable 7607s ^^^^^^^^^^^^^^^ 7607s File "/usr/lib/python3/dist-packages/distributed/core.py", line 531, in start 7607s raise asyncio.TimeoutError( 7607s f"{type(self).__name__} start timed out after {timeout}s." 7607s ) from exc 7607s TimeoutError: Nanny start timed out after 0s. 7607s 2025-02-21 01:33:17,689 - distributed.scheduler - INFO - State start 7607s 2025-02-21 01:33:17,693 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:42689 7607s 2025-02-21 01:33:17,694 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:42567/status 7607s 2025-02-21 01:33:17,694 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7607s 2025-02-21 01:33:17,703 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:36215'. Reason: failure-to-start- 7607s 2025-02-21 01:33:17,703 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:36215' closed. 7607s 2025-02-21 01:33:17,703 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:45793'. Reason: failure-to-start- 7607s 2025-02-21 01:33:17,703 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:45793' closed. 7607s 2025-02-21 01:33:17,703 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42689': TLS handshake failed with remote 'tls://127.0.0.1:47250': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 7607s 2025-02-21 01:33:17,704 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42689': TLS handshake failed with remote 'tls://127.0.0.1:47258': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 7607s 2025-02-21 01:33:17,704 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 7607s Traceback (most recent call last): 7607s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 7607s return await fut 7607s ^^^^^^^^^ 7607s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 7607s comm = await self.rpc.connect(saddr) 7607s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7607s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1485, in connect 7607s return await self._connect(addr=addr, timeout=timeout) 7607s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7607s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1429, in _connect 7607s comm = await connect( 7607s ^^^^^^^^^^^^^^ 7607s ...<4 lines>... 7607s ) 7607s ^ 7607s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7607s comm = await wait_for( 7607s ^^^^^^^^^^^^^^^ 7607s ...<2 lines>... 7607s ) 7607s ^ 7607s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 7607s return await fut 7607s ^^^^^^^^^ 7607s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7607s stream = await self.client.connect( 7607s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7607s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7607s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7607s ) 7607s ^ 7607s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7607s af, addr, stream = await connector.start(connect_timeout=timeout) 7607s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7607s asyncio.exceptions.CancelledError 7607s 7607s The above exception was the direct cause of the following exception: 7607s 7607s Traceback (most recent call last): 7607s File "/usr/lib/python3/dist-packages/distributed/core.py", line 528, in start 7607s await wait_for(self.start_unsafe(), timeout=timeout) 7607s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1913, in wait_for 7607s async with asyncio.timeout(timeout): 7607s ~~~~~~~~~~~~~~~^^^^^^^^^ 7607s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7607s raise TimeoutError from exc_val 7607s TimeoutError 7607s 7607s The above exception was the direct cause of the following exception: 7607s 7607s Traceback (most recent call last): 7607s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 974, in _cluster_factory 7607s s, ws = await start_cluster( 7607s ^^^^^^^^^^^^^^^^^^^^ 7607s ...<9 lines>... 7607s ) 7607s ^ 7607s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 791, in start_cluster 7607s await asyncio.gather(*workers) 7607s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7607s return await awaitable 7607s ^^^^^^^^^^^^^^^ 7607s File "/usr/lib/python3/dist-packages/distributed/core.py", line 531, in start 7607s raise asyncio.TimeoutError( 7607s f"{type(self).__name__} start timed out after {timeout}s." 7607s ) from exc 7607s TimeoutError: Nanny start timed out after 0s. 7607s 2025-02-21 01:33:18,708 - distributed.scheduler - INFO - State start 7607s 2025-02-21 01:33:18,712 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:34841 7607s 2025-02-21 01:33:18,712 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:39479/status 7607s 2025-02-21 01:33:18,712 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7607s 2025-02-21 01:33:18,720 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:40887'. Reason: failure-to-start- 7607s 2025-02-21 01:33:18,720 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:40887' closed. 7607s 2025-02-21 01:33:18,720 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:35007'. Reason: failure-to-start- 7607s 2025-02-21 01:33:18,720 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:35007' closed. 7607s 2025-02-21 01:33:18,721 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34841': TLS handshake failed with remote 'tls://127.0.0.1:56284': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 7607s 2025-02-21 01:33:18,721 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34841': TLS handshake failed with remote 'tls://127.0.0.1:56292': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 7607s 2025-02-21 01:33:18,721 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 7607s Traceback (most recent call last): 7607s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 7607s return await fut 7607s ^^^^^^^^^ 7607s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 7607s comm = await self.rpc.connect(saddr) 7607s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7607s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1485, in connect 7607s return await self._connect(addr=addr, timeout=timeout) 7607s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7607s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1429, in _connect 7607s comm = await connect( 7607s ^^^^^^^^^^^^^^ 7607s ...<4 lines>... 7607s ) 7607s ^ 7607s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7607s comm = await wait_for( 7607s ^^^^^^^^^^^^^^^ 7607s ...<2 lines>... 7607s ) 7607s ^ 7607s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 7607s return await fut 7607s ^^^^^^^^^ 7607s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7607s stream = await self.client.connect( 7607s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7607s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7607s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7607s ) 7607s ^ 7607s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7607s af, addr, stream = await connector.start(connect_timeout=timeout) 7607s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7607s asyncio.exceptions.CancelledError 7607s 7607s The above exception was the direct cause of the following exception: 7607s 7607s Traceback (most recent call last): 7607s File "/usr/lib/python3/dist-packages/distributed/core.py", line 528, in start 7607s await wait_for(self.start_unsafe(), timeout=timeout) 7607s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1913, in wait_for 7607s async with asyncio.timeout(timeout): 7607s ~~~~~~~~~~~~~~~^^^^^^^^^ 7607s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7607s raise TimeoutError from exc_val 7607s TimeoutError 7607s 7607s The above exception was the direct cause of the following exception: 7607s 7607s Traceback (most recent call last): 7607s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 974, in _cluster_factory 7607s s, ws = await start_cluster( 7607s ^^^^^^^^^^^^^^^^^^^^ 7607s ...<9 lines>... 7607s ) 7607s ^ 7607s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 791, in start_cluster 7607s await asyncio.gather(*workers) 7607s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7607s return await awaitable 7607s ^^^^^^^^^^^^^^^ 7607s File "/usr/lib/python3/dist-packages/distributed/core.py", line 531, in start 7607s raise asyncio.TimeoutError( 7607s f"{type(self).__name__} start timed out after {timeout}s." 7607s ) from exc 7607s TimeoutError: Nanny start timed out after 0s. 7607s 2025-02-21 01:33:19,726 - distributed.scheduler - INFO - State start 7607s 2025-02-21 01:33:19,730 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:38863 7607s 2025-02-21 01:33:19,730 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:39821/status 7607s 2025-02-21 01:33:19,730 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7607s 2025-02-21 01:33:19,741 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:38397'. Reason: failure-to-start- 7607s 2025-02-21 01:33:19,741 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:38397' closed. 7607s 2025-02-21 01:33:19,741 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:34027'. Reason: failure-to-start- 7607s 2025-02-21 01:33:19,742 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:34027' closed. 7607s 2025-02-21 01:33:19,743 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38863': TLS handshake failed with remote 'tls://127.0.0.1:57112': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 7607s 2025-02-21 01:33:19,743 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:38863': TLS handshake failed with remote 'tls://127.0.0.1:57116': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 7607s 2025-02-21 01:33:19,743 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 7607s Traceback (most recent call last): 7607s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 7607s return await fut 7607s ^^^^^^^^^ 7607s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 7607s comm = await self.rpc.connect(saddr) 7607s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7607s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1485, in connect 7607s return await self._connect(addr=addr, timeout=timeout) 7607s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7607s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1429, in _connect 7607s comm = await connect( 7607s ^^^^^^^^^^^^^^ 7607s ...<4 lines>... 7607s ) 7607s ^ 7607s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7607s comm = await wait_for( 7607s ^^^^^^^^^^^^^^^ 7607s ...<2 lines>... 7607s ) 7607s ^ 7607s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 7607s return await fut 7607s ^^^^^^^^^ 7607s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7607s stream = await self.client.connect( 7607s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7607s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7607s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7607s ) 7607s ^ 7607s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7607s af, addr, stream = await connector.start(connect_timeout=timeout) 7607s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7607s asyncio.exceptions.CancelledError 7607s 7607s The above exception was the direct cause of the following exception: 7607s 7607s Traceback (most recent call last): 7607s File "/usr/lib/python3/dist-packages/distributed/core.py", line 528, in start 7607s await wait_for(self.start_unsafe(), timeout=timeout) 7607s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1913, in wait_for 7607s async with asyncio.timeout(timeout): 7607s ~~~~~~~~~~~~~~~^^^^^^^^^ 7607s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7607s raise TimeoutError from exc_val 7607s TimeoutError 7607s 7607s The above exception was the direct cause of the following exception: 7607s 7607s Traceback (most recent call last): 7607s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 974, in _cluster_factory 7607s s, ws = await start_cluster( 7607s ^^^^^^^^^^^^^^^^^^^^ 7607s ...<9 lines>... 7607s ) 7607s ^ 7607s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 791, in start_cluster 7607s await asyncio.gather(*workers) 7607s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7607s return await awaitable 7607s ^^^^^^^^^^^^^^^ 7607s File "/usr/lib/python3/dist-packages/distributed/core.py", line 531, in start 7607s raise asyncio.TimeoutError( 7607s f"{type(self).__name__} start timed out after {timeout}s." 7607s ) from exc 7607s TimeoutError: Nanny start timed out after 0s. 7607s 2025-02-21 01:33:20,758 - distributed.scheduler - INFO - State start 7607s 2025-02-21 01:33:20,763 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:33885 7607s 2025-02-21 01:33:20,763 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:35543/status 7607s 2025-02-21 01:33:20,763 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7607s 2025-02-21 01:33:20,773 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:39201'. Reason: failure-to-start- 7607s 2025-02-21 01:33:20,773 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:39201' closed. 7607s 2025-02-21 01:33:20,773 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:35841'. Reason: failure-to-start- 7607s 2025-02-21 01:33:20,774 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:35841' closed. 7607s 2025-02-21 01:33:20,774 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33885': TLS handshake failed with remote 'tls://127.0.0.1:34526': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 7607s 2025-02-21 01:33:20,774 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33885': TLS handshake failed with remote 'tls://127.0.0.1:34540': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 7607s 2025-02-21 01:33:20,774 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 7607s Traceback (most recent call last): 7607s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 7607s return await fut 7607s ^^^^^^^^^ 7607s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 7607s comm = await self.rpc.connect(saddr) 7607s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7607s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1485, in connect 7607s return await self._connect(addr=addr, timeout=timeout) 7607s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7607s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1429, in _connect 7607s comm = await connect( 7607s ^^^^^^^^^^^^^^ 7607s ...<4 lines>... 7607s ) 7607s ^ 7607s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7607s comm = await wait_for( 7607s ^^^^^^^^^^^^^^^ 7607s ...<2 lines>... 7607s ) 7607s ^ 7607s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 7607s return await fut 7607s ^^^^^^^^^ 7607s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7607s stream = await self.client.connect( 7607s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7607s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7607s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7607s ) 7607s ^ 7607s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7607s af, addr, stream = await connector.start(connect_timeout=timeout) 7607s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7607s asyncio.exceptions.CancelledError 7607s 7607s The above exception was the direct cause of the following exception: 7607s 7607s Traceback (most recent call last): 7607s File "/usr/lib/python3/dist-packages/distributed/core.py", line 528, in start 7607s await wait_for(self.start_unsafe(), timeout=timeout) 7607s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1913, in wait_for 7607s async with asyncio.timeout(timeout): 7607s ~~~~~~~~~~~~~~~^^^^^^^^^ 7607s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7607s raise TimeoutError from exc_val 7607s TimeoutError 7607s 7607s The above exception was the direct cause of the following exception: 7607s 7607s Traceback (most recent call last): 7607s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 974, in _cluster_factory 7607s s, ws = await start_cluster( 7607s ^^^^^^^^^^^^^^^^^^^^ 7607s ...<9 lines>... 7607s ) 7607s ^ 7607s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 791, in start_cluster 7607s await asyncio.gather(*workers) 7607s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7607s return await awaitable 7607s ^^^^^^^^^^^^^^^ 7607s File "/usr/lib/python3/dist-packages/distributed/core.py", line 531, in start 7607s raise asyncio.TimeoutError( 7607s f"{type(self).__name__} start timed out after {timeout}s." 7607s ) from exc 7607s TimeoutError: Nanny start timed out after 0s. 7607s 2025-02-21 01:33:21,782 - distributed.scheduler - INFO - State start 7607s 2025-02-21 01:33:21,787 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:34439 7607s 2025-02-21 01:33:21,788 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:42765/status 7607s 2025-02-21 01:33:21,788 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7607s 2025-02-21 01:33:21,803 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:37073'. Reason: failure-to-start- 7607s 2025-02-21 01:33:21,804 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:37073' closed. 7607s 2025-02-21 01:33:21,804 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:35745'. Reason: failure-to-start- 7607s 2025-02-21 01:33:21,804 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:35745' closed. 7607s 2025-02-21 01:33:21,805 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34439': TLS handshake failed with remote 'tls://127.0.0.1:49680': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 7607s 2025-02-21 01:33:21,805 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:34439': TLS handshake failed with remote 'tls://127.0.0.1:49690': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 7607s 2025-02-21 01:33:21,805 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 7607s Traceback (most recent call last): 7607s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 7607s return await fut 7607s ^^^^^^^^^ 7607s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 7607s comm = await self.rpc.connect(saddr) 7607s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7607s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1485, in connect 7607s return await self._connect(addr=addr, timeout=timeout) 7607s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7607s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1429, in _connect 7607s comm = await connect( 7607s ^^^^^^^^^^^^^^ 7607s ...<4 lines>... 7607s ) 7607s ^ 7607s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7607s comm = await wait_for( 7607s ^^^^^^^^^^^^^^^ 7607s ...<2 lines>... 7607s ) 7607s ^ 7607s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 7607s return await fut 7607s ^^^^^^^^^ 7607s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7607s stream = await self.client.connect( 7607s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7607s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7607s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7607s ) 7607s ^ 7607s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7607s af, addr, stream = await connector.start(connect_timeout=timeout) 7607s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7607s asyncio.exceptions.CancelledError 7607s 7607s The above exception was the direct cause of the following exception: 7607s 7607s Traceback (most recent call last): 7607s File "/usr/lib/python3/dist-packages/distributed/core.py", line 528, in start 7607s await wait_for(self.start_unsafe(), timeout=timeout) 7607s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1913, in wait_for 7607s async with asyncio.timeout(timeout): 7607s ~~~~~~~~~~~~~~~^^^^^^^^^ 7607s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7607s raise TimeoutError from exc_val 7607s TimeoutError 7607s 7607s The above exception was the direct cause of the following exception: 7607s 7607s Traceback (most recent call last): 7607s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 974, in _cluster_factory 7607s s, ws = await start_cluster( 7607s ^^^^^^^^^^^^^^^^^^^^ 7607s ...<9 lines>... 7607s ) 7607s ^ 7607s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 791, in start_cluster 7607s await asyncio.gather(*workers) 7607s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7607s return await awaitable 7607s ^^^^^^^^^^^^^^^ 7607s File "/usr/lib/python3/dist-packages/distributed/core.py", line 531, in start 7607s raise asyncio.TimeoutError( 7607s f"{type(self).__name__} start timed out after {timeout}s." 7607s ) from exc 7607s TimeoutError: Nanny start timed out after 0s. 7607s 2025-02-21 01:33:22,811 - distributed.scheduler - INFO - State start 7607s 2025-02-21 01:33:22,815 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37233 7607s 2025-02-21 01:33:22,815 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:37461/status 7607s 2025-02-21 01:33:22,816 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7607s 2025-02-21 01:33:22,826 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:41599'. Reason: failure-to-start- 7607s 2025-02-21 01:33:22,827 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:41599' closed. 7607s 2025-02-21 01:33:22,827 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:46413'. Reason: failure-to-start- 7607s 2025-02-21 01:33:22,827 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:46413' closed. 7607s 2025-02-21 01:33:22,827 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37233': TLS handshake failed with remote 'tls://127.0.0.1:48468': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 7607s 2025-02-21 01:33:22,827 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37233': TLS handshake failed with remote 'tls://127.0.0.1:48474': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 7607s 2025-02-21 01:33:22,827 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 7607s Traceback (most recent call last): 7607s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 7607s return await fut 7607s ^^^^^^^^^ 7607s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 7607s comm = await self.rpc.connect(saddr) 7607s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7607s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1485, in connect 7607s return await self._connect(addr=addr, timeout=timeout) 7607s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7607s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1429, in _connect 7607s comm = await connect( 7607s ^^^^^^^^^^^^^^ 7607s ...<4 lines>... 7607s ) 7607s ^ 7607s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7607s comm = await wait_for( 7607s ^^^^^^^^^^^^^^^ 7607s ...<2 lines>... 7607s ) 7607s ^ 7607s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 7607s return await fut 7607s ^^^^^^^^^ 7607s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7607s stream = await self.client.connect( 7607s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7607s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7607s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7607s ) 7607s ^ 7607s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7607s af, addr, stream = await connector.start(connect_timeout=timeout) 7607s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7607s asyncio.exceptions.CancelledError 7607s 7607s The above exception was the direct cause of the following exception: 7607s 7607s Traceback (most recent call last): 7607s File "/usr/lib/python3/dist-packages/distributed/core.py", line 528, in start 7607s await wait_for(self.start_unsafe(), timeout=timeout) 7607s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1913, in wait_for 7607s async with asyncio.timeout(timeout): 7607s ~~~~~~~~~~~~~~~^^^^^^^^^ 7607s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7607s raise TimeoutError from exc_val 7607s TimeoutError 7607s 7607s The above exception was the direct cause of the following exception: 7607s 7607s Traceback (most recent call last): 7607s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 974, in _cluster_factory 7607s s, ws = await start_cluster( 7607s ^^^^^^^^^^^^^^^^^^^^ 7607s ...<9 lines>... 7607s ) 7607s ^ 7607s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 791, in start_cluster 7607s await asyncio.gather(*workers) 7607s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7607s return await awaitable 7607s ^^^^^^^^^^^^^^^ 7607s File "/usr/lib/python3/dist-packages/distributed/core.py", line 531, in start 7607s raise asyncio.TimeoutError( 7607s f"{type(self).__name__} start timed out after {timeout}s." 7607s ) from exc 7607s TimeoutError: Nanny start timed out after 0s. 7607s 2025-02-21 01:33:23,834 - distributed.scheduler - INFO - State start 7607s 2025-02-21 01:33:23,837 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:33877 7607s 2025-02-21 01:33:23,838 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:43239/status 7607s 2025-02-21 01:33:23,838 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7607s 2025-02-21 01:33:23,849 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:39909'. Reason: failure-to-start- 7607s 2025-02-21 01:33:23,849 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:39909' closed. 7607s 2025-02-21 01:33:23,849 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:34651'. Reason: failure-to-start- 7607s 2025-02-21 01:33:23,849 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:34651' closed. 7607s 2025-02-21 01:33:23,850 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33877': TLS handshake failed with remote 'tls://127.0.0.1:46282': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 7607s 2025-02-21 01:33:23,850 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:33877': TLS handshake failed with remote 'tls://127.0.0.1:46286': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 7607s 2025-02-21 01:33:23,850 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 7607s Traceback (most recent call last): 7607s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 7607s return await fut 7607s ^^^^^^^^^ 7607s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 7607s comm = await self.rpc.connect(saddr) 7607s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7607s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1485, in connect 7607s return await self._connect(addr=addr, timeout=timeout) 7607s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7607s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1429, in _connect 7607s comm = await connect( 7607s ^^^^^^^^^^^^^^ 7607s ...<4 lines>... 7607s ) 7607s ^ 7607s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7607s comm = await wait_for( 7607s ^^^^^^^^^^^^^^^ 7607s ...<2 lines>... 7607s ) 7607s ^ 7607s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 7607s return await fut 7607s ^^^^^^^^^ 7607s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7607s stream = await self.client.connect( 7607s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7607s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7607s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7607s ) 7607s ^ 7607s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7607s af, addr, stream = await connector.start(connect_timeout=timeout) 7607s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7607s asyncio.exceptions.CancelledError 7607s 7607s The above exception was the direct cause of the following exception: 7607s 7607s Traceback (most recent call last): 7607s File "/usr/lib/python3/dist-packages/distributed/core.py", line 528, in start 7607s await wait_for(self.start_unsafe(), timeout=timeout) 7607s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1913, in wait_for 7607s async with asyncio.timeout(timeout): 7607s ~~~~~~~~~~~~~~~^^^^^^^^^ 7607s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7607s raise TimeoutError from exc_val 7607s TimeoutError 7607s 7607s The above exception was the direct cause of the following exception: 7607s 7607s Traceback (most recent call last): 7607s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 974, in _cluster_factory 7607s s, ws = await start_cluster( 7607s ^^^^^^^^^^^^^^^^^^^^ 7607s ...<9 lines>... 7607s ) 7607s ^ 7607s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 791, in start_cluster 7607s await asyncio.gather(*workers) 7607s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7607s return await awaitable 7607s ^^^^^^^^^^^^^^^ 7607s File "/usr/lib/python3/dist-packages/distributed/core.py", line 531, in start 7607s raise asyncio.TimeoutError( 7607s f"{type(self).__name__} start timed out after {timeout}s." 7607s ) from exc 7607s TimeoutError: Nanny start timed out after 0s. 7607s 2025-02-21 01:33:24,857 - distributed.scheduler - INFO - State start 7607s 2025-02-21 01:33:24,862 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:42139 7607s 2025-02-21 01:33:24,862 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:34109/status 7607s 2025-02-21 01:33:24,862 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7607s 2025-02-21 01:33:24,888 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:45261'. Reason: failure-to-start- 7607s 2025-02-21 01:33:24,888 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:45261' closed. 7607s 2025-02-21 01:33:24,888 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:42605'. Reason: failure-to-start- 7607s 2025-02-21 01:33:24,888 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:42605' closed. 7607s 2025-02-21 01:33:24,888 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42139': TLS handshake failed with remote 'tls://127.0.0.1:52268': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 7607s 2025-02-21 01:33:24,888 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:42139': TLS handshake failed with remote 'tls://127.0.0.1:52278': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 7607s 2025-02-21 01:33:24,889 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 7607s Traceback (most recent call last): 7607s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 7607s return await fut 7607s ^^^^^^^^^ 7607s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 7607s comm = await self.rpc.connect(saddr) 7607s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7607s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1485, in connect 7607s return await self._connect(addr=addr, timeout=timeout) 7607s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7607s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1429, in _connect 7607s comm = await connect( 7607s ^^^^^^^^^^^^^^ 7607s ...<4 lines>... 7607s ) 7607s ^ 7607s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7607s comm = await wait_for( 7607s ^^^^^^^^^^^^^^^ 7607s ...<2 lines>... 7607s ) 7607s ^ 7607s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 7607s return await fut 7607s ^^^^^^^^^ 7607s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7607s stream = await self.client.connect( 7607s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7607s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7607s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7607s ) 7607s ^ 7607s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7607s af, addr, stream = await connector.start(connect_timeout=timeout) 7607s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7607s asyncio.exceptions.CancelledError 7607s 7607s The above exception was the direct cause of the following exception: 7607s 7607s Traceback (most recent call last): 7607s File "/usr/lib/python3/dist-packages/distributed/core.py", line 528, in start 7607s await wait_for(self.start_unsafe(), timeout=timeout) 7607s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1913, in wait_for 7607s async with asyncio.timeout(timeout): 7607s ~~~~~~~~~~~~~~~^^^^^^^^^ 7607s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7607s raise TimeoutError from exc_val 7607s TimeoutError 7607s 7607s The above exception was the direct cause of the following exception: 7607s 7607s Traceback (most recent call last): 7607s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 974, in _cluster_factory 7607s s, ws = await start_cluster( 7607s ^^^^^^^^^^^^^^^^^^^^ 7607s ...<9 lines>... 7607s ) 7607s ^ 7607s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 791, in start_cluster 7607s await asyncio.gather(*workers) 7607s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7607s return await awaitable 7607s ^^^^^^^^^^^^^^^ 7607s File "/usr/lib/python3/dist-packages/distributed/core.py", line 531, in start 7607s raise asyncio.TimeoutError( 7607s f"{type(self).__name__} start timed out after {timeout}s." 7607s ) from exc 7607s TimeoutError: Nanny start timed out after 0s. 7607s 2025-02-21 01:33:25,894 - distributed.scheduler - INFO - State start 7607s 2025-02-21 01:33:25,899 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:35683 7607s 2025-02-21 01:33:25,899 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:41163/status 7607s 2025-02-21 01:33:25,899 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7607s 2025-02-21 01:33:25,910 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:35751'. Reason: failure-to-start- 7607s 2025-02-21 01:33:25,911 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:35751' closed. 7607s 2025-02-21 01:33:25,911 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:45499'. Reason: failure-to-start- 7607s 2025-02-21 01:33:25,911 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:45499' closed. 7607s 2025-02-21 01:33:25,912 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35683': TLS handshake failed with remote 'tls://127.0.0.1:46460': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 7607s 2025-02-21 01:33:25,912 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:35683': TLS handshake failed with remote 'tls://127.0.0.1:46472': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 7607s 2025-02-21 01:33:25,912 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 7607s Traceback (most recent call last): 7607s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 7607s return await fut 7607s ^^^^^^^^^ 7607s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 7607s comm = await self.rpc.connect(saddr) 7607s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7607s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1485, in connect 7607s return await self._connect(addr=addr, timeout=timeout) 7607s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7607s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1429, in _connect 7607s comm = await connect( 7607s ^^^^^^^^^^^^^^ 7607s ...<4 lines>... 7607s ) 7607s ^ 7607s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7607s comm = await wait_for( 7607s ^^^^^^^^^^^^^^^ 7607s ...<2 lines>... 7607s ) 7607s ^ 7607s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 7607s return await fut 7607s ^^^^^^^^^ 7607s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7607s stream = await self.client.connect( 7607s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7607s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7607s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7607s ) 7607s ^ 7607s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7607s af, addr, stream = await connector.start(connect_timeout=timeout) 7607s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7607s asyncio.exceptions.CancelledError 7607s 7607s The above exception was the direct cause of the following exception: 7607s 7607s Traceback (most recent call last): 7607s File "/usr/lib/python3/dist-packages/distributed/core.py", line 528, in start 7607s await wait_for(self.start_unsafe(), timeout=timeout) 7607s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1913, in wait_for 7607s async with asyncio.timeout(timeout): 7607s ~~~~~~~~~~~~~~~^^^^^^^^^ 7607s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7607s raise TimeoutError from exc_val 7607s TimeoutError 7607s 7607s The above exception was the direct cause of the following exception: 7607s 7607s Traceback (most recent call last): 7607s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 974, in _cluster_factory 7607s s, ws = await start_cluster( 7607s ^^^^^^^^^^^^^^^^^^^^ 7607s ...<9 lines>... 7607s ) 7607s ^ 7607s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 791, in start_cluster 7607s await asyncio.gather(*workers) 7607s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7607s return await awaitable 7607s ^^^^^^^^^^^^^^^ 7607s File "/usr/lib/python3/dist-packages/distributed/core.py", line 531, in start 7607s raise asyncio.TimeoutError( 7607s f"{type(self).__name__} start timed out after {timeout}s." 7607s ) from exc 7607s TimeoutError: Nanny start timed out after 0s. 7607s 2025-02-21 01:33:26,918 - distributed.scheduler - INFO - State start 7607s 2025-02-21 01:33:26,922 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:41759 7607s 2025-02-21 01:33:26,923 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:35887/status 7607s 2025-02-21 01:33:26,925 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7607s 2025-02-21 01:33:26,936 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:37519'. Reason: failure-to-start- 7607s 2025-02-21 01:33:26,936 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:37519' closed. 7607s 2025-02-21 01:33:26,936 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:42311'. Reason: failure-to-start- 7607s 2025-02-21 01:33:26,937 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:42311' closed. 7607s 2025-02-21 01:33:26,937 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41759': TLS handshake failed with remote 'tls://127.0.0.1:48936': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 7607s 2025-02-21 01:33:26,937 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:41759': TLS handshake failed with remote 'tls://127.0.0.1:48950': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 7607s 2025-02-21 01:33:26,937 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 7607s Traceback (most recent call last): 7607s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 7607s return await fut 7607s ^^^^^^^^^ 7607s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 7607s comm = await self.rpc.connect(saddr) 7607s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7607s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1485, in connect 7607s return await self._connect(addr=addr, timeout=timeout) 7607s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7607s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1429, in _connect 7607s comm = await connect( 7607s ^^^^^^^^^^^^^^ 7607s ...<4 lines>... 7607s ) 7607s ^ 7607s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7607s comm = await wait_for( 7607s ^^^^^^^^^^^^^^^ 7607s ...<2 lines>... 7607s ) 7607s ^ 7607s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 7607s return await fut 7607s ^^^^^^^^^ 7607s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7607s stream = await self.client.connect( 7607s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7607s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7607s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7607s ) 7607s ^ 7607s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7607s af, addr, stream = await connector.start(connect_timeout=timeout) 7607s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7607s asyncio.exceptions.CancelledError 7607s 7607s The above exception was the direct cause of the following exception: 7607s 7607s Traceback (most recent call last): 7607s File "/usr/lib/python3/dist-packages/distributed/core.py", line 528, in start 7607s await wait_for(self.start_unsafe(), timeout=timeout) 7607s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1913, in wait_for 7607s async with asyncio.timeout(timeout): 7607s ~~~~~~~~~~~~~~~^^^^^^^^^ 7607s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7607s raise TimeoutError from exc_val 7607s TimeoutError 7607s 7607s The above exception was the direct cause of the following exception: 7607s 7607s Traceback (most recent call last): 7607s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 974, in _cluster_factory 7607s s, ws = await start_cluster( 7607s ^^^^^^^^^^^^^^^^^^^^ 7607s ...<9 lines>... 7607s ) 7607s ^ 7607s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 791, in start_cluster 7607s await asyncio.gather(*workers) 7607s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7607s return await awaitable 7607s ^^^^^^^^^^^^^^^ 7607s File "/usr/lib/python3/dist-packages/distributed/core.py", line 531, in start 7607s raise asyncio.TimeoutError( 7607s f"{type(self).__name__} start timed out after {timeout}s." 7607s ) from exc 7607s TimeoutError: Nanny start timed out after 0s. 7607s 2025-02-21 01:33:27,943 - distributed.scheduler - INFO - State start 7607s 2025-02-21 01:33:27,948 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:46759 7607s 2025-02-21 01:33:27,948 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:37091/status 7607s 2025-02-21 01:33:27,948 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7607s 2025-02-21 01:33:27,959 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:41985'. Reason: failure-to-start- 7607s 2025-02-21 01:33:27,959 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:41985' closed. 7607s 2025-02-21 01:33:27,959 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:41451'. Reason: failure-to-start- 7607s 2025-02-21 01:33:27,959 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:41451' closed. 7607s 2025-02-21 01:33:27,960 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46759': TLS handshake failed with remote 'tls://127.0.0.1:45640': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 7607s 2025-02-21 01:33:27,960 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:46759': TLS handshake failed with remote 'tls://127.0.0.1:45650': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 7607s 2025-02-21 01:33:27,960 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 7607s Traceback (most recent call last): 7607s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 7607s return await fut 7607s ^^^^^^^^^ 7607s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 7607s comm = await self.rpc.connect(saddr) 7607s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7607s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1485, in connect 7607s return await self._connect(addr=addr, timeout=timeout) 7607s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7607s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1429, in _connect 7607s comm = await connect( 7607s ^^^^^^^^^^^^^^ 7607s ...<4 lines>... 7607s ) 7607s ^ 7607s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7607s comm = await wait_for( 7607s ^^^^^^^^^^^^^^^ 7607s ...<2 lines>... 7607s ) 7607s ^ 7607s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 7607s return await fut 7607s ^^^^^^^^^ 7607s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7607s stream = await self.client.connect( 7607s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7607s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7607s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7607s ) 7607s ^ 7607s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7607s af, addr, stream = await connector.start(connect_timeout=timeout) 7607s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7607s asyncio.exceptions.CancelledError 7607s 7607s The above exception was the direct cause of the following exception: 7607s 7607s Traceback (most recent call last): 7607s File "/usr/lib/python3/dist-packages/distributed/core.py", line 528, in start 7607s await wait_for(self.start_unsafe(), timeout=timeout) 7607s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1913, in wait_for 7607s async with asyncio.timeout(timeout): 7607s ~~~~~~~~~~~~~~~^^^^^^^^^ 7607s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7607s raise TimeoutError from exc_val 7607s TimeoutError 7607s 7607s The above exception was the direct cause of the following exception: 7607s 7607s Traceback (most recent call last): 7607s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 974, in _cluster_factory 7607s s, ws = await start_cluster( 7607s ^^^^^^^^^^^^^^^^^^^^ 7607s ...<9 lines>... 7607s ) 7607s ^ 7607s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 791, in start_cluster 7607s await asyncio.gather(*workers) 7607s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7607s return await awaitable 7607s ^^^^^^^^^^^^^^^ 7607s File "/usr/lib/python3/dist-packages/distributed/core.py", line 531, in start 7607s raise asyncio.TimeoutError( 7607s f"{type(self).__name__} start timed out after {timeout}s." 7607s ) from exc 7607s TimeoutError: Nanny start timed out after 0s. 7607s 2025-02-21 01:33:28,966 - distributed.scheduler - INFO - State start 7607s 2025-02-21 01:33:28,978 - distributed.scheduler - INFO - Scheduler at: tls://127.0.0.1:37897 7607s 2025-02-21 01:33:28,978 - distributed.scheduler - INFO - dashboard at: http://127.0.0.1:44995/status 7607s 2025-02-21 01:33:28,979 - distributed.scheduler - INFO - Registering Worker plugin shuffle 7607s 2025-02-21 01:33:28,993 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:46219'. Reason: failure-to-start- 7607s 2025-02-21 01:33:28,994 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:46219' closed. 7607s 2025-02-21 01:33:28,994 - distributed.nanny - INFO - Closing Nanny at 'tls://127.0.0.1:41433'. Reason: failure-to-start- 7607s 2025-02-21 01:33:28,994 - distributed.nanny - INFO - Nanny at 'tls://127.0.0.1:41433' closed. 7607s 2025-02-21 01:33:28,995 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37897': TLS handshake failed with remote 'tls://127.0.0.1:46488': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 7607s 2025-02-21 01:33:28,995 - distributed.comm.tcp - WARNING - Listener on 'tls://127.0.0.1:37897': TLS handshake failed with remote 'tls://127.0.0.1:46502': [SSL: UNEXPECTED_EOF_WHILE_READING] EOF occurred in violation of protocol (_ssl.c:1029) 7607s 2025-02-21 01:33:28,995 - distributed.utils_test - ERROR - Failed to start gen_cluster: TimeoutError: Nanny start timed out after 0s.; retrying 7607s Traceback (most recent call last): 7607s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 7607s return await fut 7607s ^^^^^^^^^ 7607s File "/usr/lib/python3/dist-packages/distributed/nanny.py", line 358, in start_unsafe 7607s comm = await self.rpc.connect(saddr) 7607s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7607s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1485, in connect 7607s return await self._connect(addr=addr, timeout=timeout) 7607s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7607s File "/usr/lib/python3/dist-packages/distributed/core.py", line 1429, in _connect 7607s comm = await connect( 7607s ^^^^^^^^^^^^^^ 7607s ...<4 lines>... 7607s ) 7607s ^ 7607s File "/usr/lib/python3/dist-packages/distributed/comm/core.py", line 342, in connect 7607s comm = await wait_for( 7607s ^^^^^^^^^^^^^^^ 7607s ...<2 lines>... 7607s ) 7607s ^ 7607s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1914, in wait_for 7607s return await fut 7607s ^^^^^^^^^ 7607s File "/usr/lib/python3/dist-packages/distributed/comm/tcp.py", line 546, in connect 7607s stream = await self.client.connect( 7607s ^^^^^^^^^^^^^^^^^^^^^^^^^^ 7607s ip, port, max_buffer_size=MAX_BUFFER_SIZE, **kwargs 7607s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7607s ) 7607s ^ 7607s File "/usr/lib/python3/dist-packages/tornado/tcpclient.py", line 279, in connect 7607s af, addr, stream = await connector.start(connect_timeout=timeout) 7607s ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 7607s asyncio.exceptions.CancelledError 7607s 7607s The above exception was the direct cause of the following exception: 7607s 7607s Traceback (most recent call last): 7607s File "/usr/lib/python3/dist-packages/distributed/core.py", line 528, in start 7607s await wait_for(self.start_unsafe(), timeout=timeout) 7607s File "/usr/lib/python3/dist-packages/distributed/utils.py", line 1913, in wait_for 7607s async with asyncio.timeout(timeout): 7607s ~~~~~~~~~~~~~~~^^^^^^^^^ 7607s File "/usr/lib/python3.13/asyncio/timeouts.py", line 116, in __aexit__ 7607s raise TimeoutError from exc_val 7607s TimeoutError 7607s 7607s The above exception was the direct cause of the following exception: 7607s 7607s Traceback (most recent call last): 7607s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 974, in _cluster_factory 7607s s, ws = await start_cluster( 7607s ^^^^^^^^^^^^^^^^^^^^ 7607s ...<9 lines>... 7607s ) 7607s ^ 7607s File "/usr/lib/python3/dist-packages/distributed/utils_test.py", line 791, in start_cluster 7607s await asyncio.gather(*workers) 7607s File "/usr/lib/python3.13/asyncio/tasks.py", line 737, in _wrap_awaitable 7607s return await awaitable 7607s ^^^^^^^^^^^^^^^ 7607s File "/usr/lib/python3/dist-packages/distributed/core.py", line 531, in start 7607s raise asyncio.TimeoutError( 7607s f"{type(self).__name__} start timed out after {timeout}s." 7607s ) from exc 7607s TimeoutError: Nanny start timed out after 0s. 7607s ============================= slowest 20 durations ============================= 7607s 60.01s call tests/test_tls_functional.py::test_retire_workers 7607s 0.00s setup tests/test_tls_functional.py::test_retire_workers 7607s 0.00s teardown tests/test_tls_functional.py::test_retire_workers 7607s =========================== short test summary info ============================ 7607s FAILED tests/test_tls_functional.py::test_retire_workers - TimeoutError 7607s ========== 1 failed, 30 skipped, 3391 deselected in 72.16s (0:01:12) =========== 7608s *** END OF RUN 3: NOT ALL TESTS HAVE YET PASSED/XFAILED *** 7608s *** STARTING RUN 4: python3.13 -m pytest --pyargs distributed --verbose --color=no --timeout-method=signal --timeout=300 -m not avoid_ci -rfE --last-failed --last-failed-no-failures none --ignore=../../../../../usr/lib/python3/dist-packages/distributed/comm/tests/test_comms.py --ignore=../../../../../usr/lib/python3/dist-packages/distributed/comm/tests/test_ws.py --ignore=../../../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_adaptive.py --ignore=../../../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_local.py --ignore=../../../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_slow_adaptive.py --ignore=../../../../../usr/lib/python3/dist-packages/distributed/deploy/tests/test_spec_cluster.py --deselect=cli/tests/test_dask_scheduler.py::test_no_dashboard --deselect=deploy/tests/test_local.py::test_localcluster_get_client --deselect=deploy/tests/test_old_ssh.py::test_cluster --deselect=deploy/tests/test_old_ssh.py::test_old_ssh_nprocs_renamed_to_n_workers --deselect=deploy/tests/test_old_ssh.py::test_nprocs_attribute_is_deprecated --deselect=deploy/tests/test_ssh.py::test_nprocs_attribute_is_deprecated --deselect=http/tests/test_core.py::test_prometheus_api_doc --deselect=tests/test_init.py::test_git_revision --deselect=tests/test_jupyter.py::test_jupyter_idle_timeout --deselect=tests/test_jupyter.py::test_jupyter_idle_timeout_returned --deselect=tests/test_jupyter.py::test_jupyter_server --deselect=tests/test_jupyter.py::test_shutsdown_cleanly --deselect=tests/test_profile.py::test_stack_overflow --deselect=tests/test_pubsub.py::test_client_worker --deselect=tests/test_queues.py::test_queue_in_task --deselect=tests/test_spill.py::test_spillbuffer_oserror --deselect=tests/test_steal.py::test_steal_twice --deselect=tests/test_utils_test.py::test_cluster --deselect=tests/test_variable.py::test_variable_in_task --deselect=tests/test_worker.py::test_process_executor_kills_process --deselect=tests/test_worker_memory.py::test_fail_to_pickle_execute_1 --deselect=tests/test_worker_state_machine.py::test_task_state_instance_are_garbage_collected --deselect=protocol/tests/test_protocol.py::test_deeply_nested_structures --deselect=protocol/tests/test_serialize.py::test_deeply_nested_structures --deselect=cli/tests/test_dask_scheduler.py::test_defaults --deselect=cli/tests/test_dask_scheduler.py::test_hostport --deselect=cli/tests/test_dask_spec.py::test_errors --deselect=cli/tests/test_dask_worker.py::test_scheduler_file --deselect=cli/tests/test_dask_worker.py::test_scheduler_file --deselect=cli/tests/test_dask_worker.py::test_scheduler_file --deselect=dashboard/tests/test_scheduler_bokeh.py::test_counters --deselect=dashboard/tests/test_worker_bokeh.py::test_counters --deselect=deploy/tests/test_local.py::test_adapt_then_manual --deselect=deploy/tests/test_local.py::test_async_with --deselect=deploy/tests/test_local.py::test_close_twice --deselect=deploy/tests/test_local.py::test_cluster_info_sync --deselect=deploy/tests/test_local.py::test_local_tls --deselect=deploy/tests/test_local.py::test_no_dangling_asyncio_tasks --deselect=deploy/tests/test_local.py::test_only_local_access --deselect=deploy/tests/test_local.py::test_remote_access --deselect=diagnostics/tests/test_progress_widgets.py::test_serializers --deselect=diagnostics/tests/test_scheduler_plugin.py::test_lifecycle --deselect=http/scheduler/tests/test_missing_bokeh.py::test_missing_bokeh --deselect=http/scheduler/tests/test_scheduler_http.py::test_metrics_when_prometheus_client_not_installed --deselect=protocol/tests/test_serialize.py::test_errors --deselect=tests/test_batched.py::test_BatchedSend --deselect=tests/test_batched.py::test_close_closed --deselect=tests/test_batched.py::test_close_twice --deselect=tests/test_batched.py::test_send_after_stream_start --deselect=tests/test_batched.py::test_send_before_close --deselect=tests/test_batched.py::test_send_before_start --deselect=tests/test_batched.py::test_sending_traffic_jam --deselect=tests/test_batched.py::test_serializers --deselect=tests/test_client.py::TestClientSecurityLoader::test_security_loader --deselect=tests/test_client.py::TestClientSecurityLoader::test_security_loader_ignored_if_explicit_security_provided --deselect=tests/test_client.py::TestClientSecurityLoader::test_security_loader_ignored_if_returns_none --deselect=tests/test_client.py::test_async_with --deselect=tests/test_client.py::test_client_is_quiet_cluster_close --deselect=tests/test_client.py::test_dashboard_link_cluster --deselect=tests/test_client.py::test_dashboard_link_inproc --deselect=tests/test_client.py::test_file_descriptors_dont_leak --deselect=tests/test_client.py::test_mixing_clients_different_scheduler --deselect=tests/test_client.py::test_quiet_client_close --deselect=tests/test_client.py::test_rebalance_sync --deselect=tests/test_client.py::test_repr_localcluster --deselect=tests/test_client.py::test_security_loader --deselect=tests/test_client.py::test_security_loader_ignored_if_explicit_security_provided --deselect=tests/test_client.py::test_security_loader_ignored_if_returns_none --deselect=tests/test_client.py::test_shutdown --deselect=tests/test_client.py::test_shutdown_is_quiet_with_cluster --deselect=tests/test_client.py::test_shutdown_localcluster --deselect=tests/test_client.py::test_shutdown_stops_callbacks --deselect=tests/test_client_loop.py::test_close_loop_sync_start_new_loop --deselect=tests/test_client_loop.py::test_close_loop_sync_use_running_loop --deselect=tests/test_core.py::test_close_fast_without_active_handlers --deselect=tests/test_core.py::test_close_grace_period_for_handlers --deselect=tests/test_core.py::test_close_properly --deselect=tests/test_core.py::test_compression --deselect=tests/test_core.py::test_connection_pool --deselect=tests/test_core.py::test_connection_pool_close_while_connecting --deselect=tests/test_core.py::test_connection_pool_detects_remote_close --deselect=tests/test_core.py::test_connection_pool_outside_cancellation --deselect=tests/test_core.py::test_connection_pool_remove --deselect=tests/test_core.py::test_connection_pool_respects_limit --deselect=tests/test_core.py::test_connection_pool_tls --deselect=tests/test_core.py::test_counters --deselect=tests/test_core.py::test_deserialize_error --deselect=tests/test_core.py::test_errors --deselect=tests/test_core.py::test_identity_inproc --deselect=tests/test_core.py::test_identity_tcp --deselect=tests/test_core.py::test_large_packets_inproc --deselect=tests/test_core.py::test_messages_are_ordered_bsend --deselect=tests/test_core.py::test_messages_are_ordered_raw --deselect=tests/test_core.py::test_ports --deselect=tests/test_core.py::test_rpc_default --deselect=tests/test_core.py::test_rpc_inproc --deselect=tests/test_core.py::test_rpc_message_lifetime_default --deselect=tests/test_core.py::test_rpc_message_lifetime_inproc --deselect=tests/test_core.py::test_rpc_message_lifetime_tcp --deselect=tests/test_core.py::test_rpc_serialization --deselect=tests/test_core.py::test_rpc_tcp --deselect=tests/test_core.py::test_rpc_tls --deselect=tests/test_core.py::test_rpc_with_many_connections_inproc --deselect=tests/test_core.py::test_rpc_with_many_connections_tcp --deselect=tests/test_core.py::test_send_recv_args --deselect=tests/test_core.py::test_send_recv_cancelled --deselect=tests/test_core.py::test_server --deselect=tests/test_core.py::test_server_comms_mark_active_handlers --deselect=tests/test_core.py::test_server_raises_on_blocked_handlers --deselect=tests/test_jupyter.py::test_jupyter_idle_timeout --deselect=tests/test_jupyter.py::test_jupyter_server --deselect=tests/test_locks.py::test_errors --deselect=tests/test_nanny.py::test_scheduler_file --deselect=tests/test_nanny.py::test_scheduler_file --deselect=tests/test_nanny.py::test_scheduler_file --deselect=tests/test_nanny.py::test_worker_uses_same_host_as_nanny --deselect=tests/test_preload.py::test_failure_doesnt_crash_scheduler --deselect=tests/test_preload.py::test_preload_import_time --deselect=tests/test_preload.py::test_preload_manager_sequence --deselect=tests/test_preload.py::test_worker_preload_text --deselect=tests/test_scheduler.py::test_allowed_failures_config --deselect=tests/test_scheduler.py::test_async_context_manager --deselect=tests/test_scheduler.py::test_dashboard_host --deselect=tests/test_scheduler.py::test_file_descriptors_dont_leak --deselect=tests/test_scheduler.py::test_finished --deselect=tests/test_scheduler.py::test_multiple_listeners --deselect=tests/test_scheduler.py::test_no_dangling_asyncio_tasks --deselect=tests/test_scheduler.py::test_scheduler_file --deselect=tests/test_scheduler.py::test_scheduler_file --deselect=tests/test_scheduler.py::test_scheduler_file --deselect=tests/test_security.py::test_require_encryption --deselect=tests/test_security.py::test_tls_listen_connect --deselect=tests/test_security.py::test_tls_temporary_credentials_functional --deselect=tests/test_semaphore.py::test_threadpoolworkers_pick_correct_ioloop --deselect=tests/test_tls_functional.py::test_security_dict_input_no_security --deselect=tests/test_utils_test.py::test_ensure_no_new_clients --deselect=tests/test_utils_test.py::test_freeze_batched_send --deselect=tests/test_utils_test.py::test_locked_comm_drop_in_replacement --deselect=tests/test_utils_test.py::test_locked_comm_intercept_read --deselect=tests/test_utils_test.py::test_locked_comm_intercept_write --deselect=tests/test_worker.py::test_host_uses_scheduler_protocol --deselect=tests/test_worker.py::test_plugin_exception --deselect=tests/test_worker.py::test_plugin_internal_exception --deselect=tests/test_worker.py::test_plugin_multiple_exceptions --deselect=tests/test_worker.py::test_scheduler_file --deselect=tests/test_worker.py::test_scheduler_file --deselect=tests/test_worker.py::test_scheduler_file --deselect=tests/test_worker_client.py::test_dont_override_default_get 7609s ============================= test session starts ============================== 7609s platform linux -- Python 3.13.2, pytest-8.3.4, pluggy-1.5.0 -- /usr/bin/python3.13 7609s cachedir: .pytest_cache 7609s rootdir: /tmp/autopkgtest.4PKwEm/autopkgtest_tmp/build 7609s configfile: pyproject.toml 7609s plugins: timeout-2.3.1, rerunfailures-15.0, anyio-4.7.0, typeguard-4.4.1 7609s timeout: 300.0s 7609s timeout method: signal 7609s timeout func_only: False 7620s collecting ... collected 3392 items / 3391 deselected / 30 skipped / 1 selected 7620s run-last-failure: rerun previous 1 failure 7620s 7624s tests/test_tls_functional.py::test_retire_workers <- ../../../../usr/lib/python3/dist-packages/distributed/tests/test_tls_functional.py PASSED [100%] 7624s 7624s ============================= slowest 20 durations ============================= 7624s 3.76s call tests/test_tls_functional.py::test_retire_workers 7624s 0.00s setup tests/test_tls_functional.py::test_retire_workers 7624s 0.00s teardown tests/test_tls_functional.py::test_retire_workers 7624s =============== 1 passed, 30 skipped, 3391 deselected in 15.01s ================ 7625s *** END OF RUN 4: ALL TESTS RUN HAVE NOW PASSED/XFAILED *** 7625s autopkgtest [01:33:48]: test pybuild-autopkgtest: -----------------------] 7626s autopkgtest [01:33:49]: test pybuild-autopkgtest: - - - - - - - - - - results - - - - - - - - - - 7626s pybuild-autopkgtest PASS 7626s autopkgtest [01:33:49]: @@@@@@@@@@@@@@@@@@@@ summary 7626s pytest PASS 7626s pybuild-autopkgtest PASS 7642s nova [W] Skipping flock for amd64 7642s Creating nova instance adt-plucky-amd64-dask.distributed-20250220-232642-juju-7f2275-prod-proposed-migration-environment-15-778cec75-8126-4666-82fe-c9464ea2b50b from image adt/ubuntu-plucky-amd64-server-20250220.img (UUID 0ec9a92a-064a-4cac-a94d-46a889669cdf)... 7642s nova [W] Timed out waiting for 54a2624a-1745-4aea-b534-fd7228bc46c9 to get deleted. 7642s nova [W] Skipping flock for amd64 7642s Creating nova instance adt-plucky-amd64-dask.distributed-20250220-232642-juju-7f2275-prod-proposed-migration-environment-15-778cec75-8126-4666-82fe-c9464ea2b50b from image adt/ubuntu-plucky-amd64-server-20250220.img (UUID 0ec9a92a-064a-4cac-a94d-46a889669cdf)... 7642s nova [W] Timed out waiting for c9b2ebfd-e4f2-4978-a546-e3155ec17f98 to get deleted.