Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Timeout reading aria2 RPC #37

Open
rgaudin opened this issue Jul 24, 2024 · 0 comments
Open

Timeout reading aria2 RPC #37

rgaudin opened this issue Jul 24, 2024 · 0 comments
Labels
bug Something isn't working

Comments

@rgaudin
Copy link
Member

rgaudin commented Jul 24, 2024

In Order 669610c190882e0024ee2891

[2024-07-16 16:50:44] :: Downloading content
[2024-07-16 16:50:44]    => Retrieving 29 files totaling 180.57 GiB… 

[2024-07-16 16:50:45]       ✓ Kiwix_vikidia_en_all_maxi.zim 47.89 MiB (cached) (copied)

[2024-07-16 16:50:45]       ✓ kiwix-macos_3.4.0.dmg 5.67 MiB at 14.69 MiB/s md5=062fee1bf71c64a3be63829f00dbf42a

[2024-07-16 16:50:48]       ✓ openZIM_wiktionary_en_simple_all_maxi.zim 60.81 MiB (cached) at 17.75 MiB/s md5=4c13815e576c75140cc2182a2cec4324

[2024-07-16 16:50:50]       ✓ kiwix-3.11.1.apk 93.87 MiB at 17.03 MiB/s md5=6650d4340d87339c59f8d88d2d7d5ae1

[2024-07-16 16:50:51]       ✓ kiwix-desktop_windows_x64_2.3.1-2.zip 120.76 MiB at 18.3 MiB/s md5=adf9b64b5c6906427d7a1c8bdfc31546

[2024-07-16 16:50:52]       ✓ kiwix-desktop_x86_64_2.3.1-4.appimage 139.84 MiB at 18.31 MiB/s md5=899279fb76e357afe33bbdd968750376

[2024-07-16 17:05:18]       ✓ Kiwix_wikipedia_en_all_maxi.zim 102.34 GiB (cached) (copied)

[2024-07-16 17:05:22]       ✓ openZIM_wikipedia_en_for_schools_maxi.zim 1.2 GiB (cached) (copied)

[2024-07-16 17:06:55]       ✓ Kiwix_aimhi_en_-HiSchool Biology_.zim 455.39 MiB (cached) at 5.35 MiB/s md5=f578b5f258eb1856899034c6517eb49c

[2024-07-16 17:06:59]       ✓ Kiwix_aimhi_en_-Science (Website)_.zim 5.75 GiB (cached) (copied)

[2024-07-16 17:07:34]       ✓ Kiwix_aimhi_en_-HiSchool Physics_.zim 691.01 MiB (cached) at 5.79 MiB/s md5=998d81e3bae750f10eee475613a06f30

[2024-07-16 17:08:44]       ✓ Kiwix_aimhi_en_-Geography (Website)_.zim 892.05 MiB (cached) at 5.12 MiB/s md5=556764ad0fcfd9bb446d5cc861074144

[2024-07-16 17:09:18]       ✓ Kiwix_aimhi_en_-HiLights (Website)_.zim 1.2 GiB (cached) at 5.61 MiB/s md5=efc1c21d55ca828257ff92a00399c869

[2024-07-16 17:09:27]       ✓ Kiwix_voa_learning_english-let-s-learn-english_.zim 12.72 GiB (cached) (copied)

[2024-07-16 17:09:34]       ✓ Kiwix_voa_learning_english-let-s-learn-english-level-2_.zim 2.19 GiB (cached) (copied)

[2024-07-16 17:09:36]       ✓ Kiwix_voa_learning_english-let-s-teach-english_.zim 835.84 MiB (cached) (copied)

[2024-07-16 17:10:07]       ✓ Kiwix_aimhi_en_-English (Website)_.zim 1.53 GiB (cached) at 5.56 MiB/s md5=abc6df96e71b1cd2f6ce20613a8b9381

[2024-07-16 17:10:40]       ✓ Kiwix_aimhi_en_-What Is Cancer_.zim 361.31 MiB (cached) at 3.13 MiB/s md5=dea0187b5e54c86bbaa503ad5e6bebec

[2024-07-16 17:11:41]       ✓ openZIM_ted_mul_education_.zim 6.36 GiB (cached) (copied)

[2024-07-16 17:11:42]       ✓ Kiwix_aimhi_en_-Inspiring Guests_.zim 1.25 GiB (cached) at 4.56 MiB/s md5=aa713c5df46e460baacad036800e135e

[2024-07-16 17:12:23]       ✓ Kiwix_aimhi_en_-Philosophy (Website)_.zim 1.48 GiB (cached) at 5.6 MiB/s md5=491d51aba663cd3f77dcc0380fb19861

[2024-07-16 17:12:43]       ✓ Kiwix_voa_learning_english-news-literacy_.zim 425.33 MiB (cached) at 21.11 MiB/s md5=0129a7380c429e7aea3da925cdbadfc4

[2024-07-16 17:13:28]       ✓ Kiwix_voa_learning_english-eim-english-in-a-minute_.zim 1.76 GiB (cached) at 9.13 MiB/s md5=d7b84d5c7faa162429b99fbe31541414

[2024-07-16 17:13:28]       ✓ Kiwix_voa_learning_english-word-of-the-day_.zim 59.48 MiB (cached) at 1.33 MiB/s md5=2aad6934ffc3763da73292688581914e

[2024-07-16 17:14:44]       ✓ africatik-en.offspot.kiwix.org 12.95 GiB (cached) (copied)
[Elapsed Time: 0:00:00]   0.0 B of 36.19 GiB downloaded||  0.0 s/B (ETA:  --:--:--)
[Elapsed Time: 0:00:00]  36.2 GiB of 36.19 GiB downloaded|| 47.8 TiB/s (Time:  0:00:00)
Traceback (most recent call last):
  File "/tmp/onefile_1669401_1721148593_469207/urllib3/connectionpool.py", line 537, in _make_request
  File "/tmp/onefile_1669401_1721148593_469207/urllib3/connection.py", line 466, in getresponse
  File "/tmp/onefile_1669401_1721148593_469207/http/client.py", line 1395, in getresponse
  File "/tmp/onefile_1669401_1721148593_469207/http/client.py", line 325, in begin
  File "/tmp/onefile_1669401_1721148593_469207/http/client.py", line 286, in _read_status
  File "/tmp/onefile_1669401_1721148593_469207/socket.py", line 706, in readinto
TimeoutError: timed out

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/tmp/onefile_1669401_1721148593_469207/requests/adapters.py", line 486, in send
  File "/tmp/onefile_1669401_1721148593_469207/urllib3/connectionpool.py", line 847, in urlopen
  File "/tmp/onefile_1669401_1721148593_469207/urllib3/util/retry.py", line 470, in increment
  File "/tmp/onefile_1669401_1721148593_469207/urllib3/util/util.py", line 39, in reraise
  File "/tmp/onefile_1669401_1721148593_469207/urllib3/connectionpool.py", line 793, in urlopen
  File "/tmp/onefile_1669401_1721148593_469207/urllib3/connectionpool.py", line 539, in _make_request
  File "/tmp/onefile_1669401_1721148593_469207/urllib3/connectionpool.py", line 372, in _raise_timeout
urllib3.exceptions.ReadTimeoutError: HTTPConnectionPool(host='127.0.0.1', port=7266): Read timed out. (read timeout=60.0)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/tmp/onefile_1669401_1721148593_469207/image_creator/entrypoint.py", line 99, in main
  File "/tmp/onefile_1669401_1721148593_469207/image_creator/creator.py", line 59, in run
  File "/tmp/onefile_1669401_1721148593_469207/image_creator/steps/contents.py", line 373, in run
  File "/tmp/onefile_1669401_1721148593_469207/image_creator/steps/contents.py", line 156, in update
  File "/tmp/onefile_1669401_1721148593_469207/image_creator/utils/aria2.py", line 900, in get_feedback
  File "/tmp/onefile_1669401_1721148593_469207/image_creator/utils/aria2.py", line 328, in feedback
  File "/tmp/onefile_1669401_1721148593_469207/image_creator/utils/aria2.py", line 312, in get_progress
  File "/tmp/onefile_1669401_1721148593_469207/image_creator/utils/aria2.py", line 442, in update_all
  File "/tmp/onefile_1669401_1721148593_469207/image_creator/utils/aria2.py", line 397, in update
  File "/tmp/onefile_1669401_1721148593_469207/aria2p/downloads.py", line 245, in update
  File "/tmp/onefile_1669401_1721148593_469207/aria2p/client.py", line 854, in tell_status
  File "/tmp/onefile_1669401_1721148593_469207/aria2p/client.py", line 258, in call
  File "/tmp/onefile_1669401_1721148593_469207/aria2p/client.py", line 351, in post
  File "/tmp/onefile_1669401_1721148593_469207/requests/api.py", line 115, in post
  File "/tmp/onefile_1669401_1721148593_469207/requests/api.py", line 59, in request
  File "/tmp/onefile_1669401_1721148593_469207/requests/sessions.py", line 589, in request
  File "/tmp/onefile_1669401_1721148593_469207/requests/sessions.py", line 703, in send
  File "/tmp/onefile_1669401_1721148593_469207/requests/adapters.py", line 532, in send
requests.exceptions.ReadTimeout: HTTPConnectionPool(host='127.0.0.1', port=7266): Read timed out. (read timeout=60.0)

Error: HTTPConnectionPool(host='127.0.0.1', port=7266): Read timed out. (read timeout=60.0)
[2024-07-16 17:15:56]  Cleaning-up… ...umount: /tmp/part3__oh3b2hy: target is busy.
.umount: /tmp/part3__oh3b2hy: target is busy.
DEBUG: /dev/loop7p1 not removed from fs
DEBUG: Unlinking /dev/loop7p2
DEBUG: Unlinking /dev/loop7p1
DEBUG: Unlinking /dev/loop7p3
..Exception in thread Thread-1 (listen_to_notifications):
Traceback (most recent call last):
  File "/tmp/onefile_1669401_1721148593_469207/threading.py", line 1045, in _bootstrap_inner
  File "/tmp/onefile_1669401_1721148593_469207/threading.py", line 982, in run
  File "/tmp/onefile_1669401_1721148593_469207/aria2p/client.py", line 1708, in listen_to_notifications
  File "/tmp/onefile_1669401_1721148593_469207/image_creator/utils/aria2.py", line 1037, in _cb_on_download_stop
  File "/tmp/onefile_1669401_1721148593_469207/image_creator/steps/contents.py", line 261, in direct_callback
  File "/tmp/onefile_1669401_1721148593_469207/image_creator/utils/aria2.py", line 328, in feedback
  File "/tmp/onefile_1669401_1721148593_469207/image_creator/utils/aria2.py", line 312, in get_progress
  File "/tmp/onefile_1669401_1721148593_469207/image_creator/utils/aria2.py", line 442, in update_all
  File "/tmp/onefile_1669401_1721148593_469207/image_creator/utils/aria2.py", line 397, in update
  File "/tmp/onefile_1669401_1721148593_469207/aria2p/downloads.py", line 245, in update
  File "/tmp/onefile_1669401_1721148593_469207/aria2p/client.py", line 854, in tell_status
  File "/tmp/onefile_1669401_1721148593_469207/aria2p/client.py", line 258, in call
  File "/tmp/onefile_1669401_1721148593_469207/aria2p/client.py", line 380, in res_or_raise
aria2p.client.ClientException: GID 80488935c80acb28 is not found
.........
[2024-07-16 17:16:01]  Cleaning-up… ..............

I'm not sure what happened exactly here. I believe the GID one is due to the teardown of the whole thing due to the timeout.

@rgaudin rgaudin added the bug Something isn't working label Jul 24, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

1 participant