Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Bug]: Internal hashtable error: illegal key supplied! #7830

Closed
1 of 2 tasks
the-snork opened this issue Feb 15, 2025 · 15 comments
Closed
1 of 2 tasks

[Bug]: Internal hashtable error: illegal key supplied! #7830

the-snork opened this issue Feb 15, 2025 · 15 comments
Labels
Bug Something isn't working as it should

Comments

@the-snork
Copy link

What happened?

See https://bugs.launchpad.net/ubuntu/+source/rsync/+bug/2095004

[🐳|🌿] Copying files via rsync to [ / (MOUNT root) ]
[🐳|🔨]
[🐳|🔨] sent 1.68G bytes received 721.86K bytes 197.30M bytes/sec
[🐳|🔨] total size is 1.68G speedup is 1.00
[🐳|🌿] Copying files to [ /boot (MOUNT /boot) ]
[🐳|🔨] Internal hashtable error: illegal key supplied!
[🐳|🔨] rsync error: errors with program diagnostics (code 13) at hashtable.c(88) [generator=3.2.7]
[🐳|🔨] rsync error: received SIGUSR1 (code 19) at main.c(1613) [Receiver=3.2.7]
[🐳|💥] Error 13 occurred in main shell [ at /armbian/lib/functions/logging/runners.sh:211
run_host_command_logged_raw() --> lib/functions/logging/runners.sh:211
run_host_command_logged() --> lib/functions/logging/runners.sh:193
create_image_from_sdcard_rootfs() --> lib/functions/image/rootfs-to-image.sh:80
do_with_logging() --> lib/functions/logging/section-logging.sh:81
build_rootfs_and_image() --> lib/functions/main/rootfs-image.sh:104
full_build_packages_rootfs_and_image() --> lib/functions/main/default-build.sh:36
do_with_default_build() --> lib/functions/main/default-build.sh:42
cli_standard_build_run() --> lib/functions/cli/cli-build.sh:25
armbian_cli_run_command() --> lib/functions/cli/utils-cli.sh:136
cli_entrypoint() --> lib/functions/cli/entrypoint.sh:176
main() --> compile.sh:50
]
[🐳|💥] Cleaning up [ please wait for cleanups to finish ]

How to reproduce?

Build on MacOS using compile.sh which in turn uses docker.

Tested with 1f69720; v24.11 works just fine.

Branch

main (main development branch)

On which host OS are you running the build script and observing this problem?

Other

Are you building on Windows WSL2?

  • Yes, my Ubuntu/Debian/OtherOS is running on WSL2

Relevant log URL

No response

Code of Conduct

  • I agree to follow this project's Code of Conduct
@the-snork the-snork added the Bug Something isn't working as it should label Feb 15, 2025
Copy link
Contributor

Hey @the-snork !

Looks like it's your first time interacting with Armbian here on GitHub.

Welcome and thank you for taking the time to report an issue ❤️.

Don't forget to star ⭐ the repo.

@github-actions github-actions bot added the Good first issue Feel free to contribute :) label Feb 15, 2025
Copy link
Contributor

github-actions bot commented Feb 15, 2025

Jira ticket: AR-2611

@rpardini
Copy link
Member

Duplicate of #7744 -- not our bug -- go upgrade rsync

@the-snork
Copy link
Author

Duplicate of #7744 -- not our bug -- go upgrade rsync

actually it is, i would say

in this case, this is through armbian's docker image

@rpardini
Copy link
Member

this is through armbian's docker image

Oh, then it warrants some investigation -- sorry for the early closure

@rpardini rpardini reopened this Feb 18, 2025
@the-snork
Copy link
Author

but anyway, let me recheck with an updated rsync in my host

rpardini added a commit to rpardini/armbian-docker-armbian-build that referenced this issue Feb 18, 2025
Seems the cache is being hit "too much" and we're shipping a broken version of `rsync` -- See armbian/build#7830

I will send a bigger change later making use of the new arm64 runners (so arm64 builds are not so slow - the main reason the cache was added in the first place)
@rpardini
Copy link
Member

There's indeed too much caching happening in the Docker build - armbian/docker-armbian-build#5 - @igorpecovnik could you either merge or give me permissions there? I've more changes later.

@igorpecovnik
Copy link
Member

added permissions.

rpardini added a commit to armbian/docker-armbian-build that referenced this issue Feb 18, 2025
Seems the cache is being hit "too much" and we're shipping a broken version of `rsync` -- See armbian/build#7830

I will send a bigger change later making use of the new arm64 runners (so arm64 builds are not so slow - the main reason the cache was added in the first place)
@rpardini
Copy link
Member

Heh. Un-cached builds are failing due to arm64-on-amd64 qemu throwing segmentation faults. My guess? GH doesnt want people doing crossbuilds -- I had planned to rewrite those jobs to split over arm64 and amd64 GH runners and then join the resulting Docker images in a separate step "later", but I guess it will have to be "sooner". I'll try to make time ASAP

@rpardini rpardini removed the Good first issue Feel free to contribute :) label Feb 20, 2025
@rpardini
Copy link
Member

I've had to split the Docker build matrix across arch'es (and join images later per-release), but finally we have updated Docker builds for both arches and all releases:

@the-snork can you pull the latest image (docker pull ghcr.io/armbian/docker-armbian-build:armbian-ubuntu-jammy-latest) and retry? We have rsync v 3.2.7-0ubuntu0.22.04.4 now.

@rpardini
Copy link
Member

ps: ./compile.sh auto-pulls the image every day so manual pullng is only necessary if already tried today.

@rpardini
Copy link
Member

My guess? GH doesnt want people doing crossbuilds

No, known problem, I solved by using native arm64 runners.

@rpardini
Copy link
Member

pps: by using native arm64 our docker builds are now 39 minutes -> 6 minutes faster.

@the-snork
Copy link
Author

@rpardini - works for me; thanks.

@the-snork
Copy link
Author

forgot close it.... sorry.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Bug Something isn't working as it should
Development

No branches or pull requests

3 participants