Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add custom boot command that waits for text to appear #178

Open
wants to merge 1 commit into
base: main
Choose a base branch
from

Conversation

torarnv
Copy link
Contributor

@torarnv torarnv commented Jan 10, 2025

Using <wait "string"> or <wait "(some|regex|here)"> allows installing macOS without having to specify hard-coded timeout waits such as <wait10s>.

We now also wait for the first frame, if boot_wait is not specified.

@torarnv
Copy link
Contributor Author

torarnv commented Jan 10, 2025

Missing docs for new wait command, will add after initial feature review

@torarnv
Copy link
Contributor Author

torarnv commented Jan 10, 2025

This allows e.g:

diff --git a/macos/macos.pkrtpl.yaml b/macos/macos.pkrtpl.yaml
index bed5e73..305532e 100644
--- a/macos/macos.pkrtpl.yaml
+++ b/macos/macos.pkrtpl.yaml
@@ -1,14 +1,8 @@
-wait_for_boot:
-  # Wait for VM too boot
-  # FIXME: Ideally there would be some way to wait for the first
-  # non-black frame from the VNC server.
-  - <wait60s>
-
 install_macos:
-  # Hello, Hola, Bonjour, etc.
+  - <wait "Get Started">
   - <spacebar>
-  - <wait5s>
+  - <wait "Language">

@torarnv
Copy link
Contributor Author

torarnv commented Jan 10, 2025

Is the builder not a macOS machine?

@edigaryev
Copy link
Contributor

Hi @torarnv 👋

This is a pretty cool use of Apple's Vision framework.

Have you considered submitting this to packer or packer-plugin-sdk directly?

This way:

  1. Not just Packer Plugin for Tart could benefit from this, but literally all existing packer plugins, assuming that on non-macOS platforms something like github.com/otiai10/gosseract could be used

  2. <wait> syntax could be extended natively, without performing any hacks on Packer Plugin for Tart's side and yielding correct documentation

@torarnv
Copy link
Contributor Author

torarnv commented Jan 13, 2025

Thanks @edigaryev!

I did initially considered building this feature into packer-plugin-sdk's bootcommand package directly, but as this was a quick hackathon project, where my focus was to get something workable for packer-plugin-tart (scratching my own itch), I deferred that approach.

An upstream feature in packer-plugin-sdk would make sense, but one challenge there is that bootcommand has 3 different backends (VNC, USB, and PC-XT), and from what I can tell the boot commands are backend-agnostic. Adding the feature in the SDK would inevitably diverge the feature set, which I'm not sure is acceptable.

Using github.com/otiai10/gosseract would be an option, but would add more dependencies compared to the fairly straight forward use of the built in Vision.framework.

One possible upstream improvement would be to teach bootcommand to extend the grammar, so that we don't need regex-based logic to add new commands, but I sadly won't have time to dive into that.

I'm still testing this feature on my nightly builds, so we can hold on on merging for now. Let me know if you have other concerns though!

The functionality builds on the built in Vision framework on macOS,
and the existing VNC integration, which now has been taught a few
new tricks, including ZLib encoded framebuffer updates and desktop
resize.

A custom VNC driver has been added, that picks up changes to the
VNC framebuffer, and allows custom boot commands without changes
to the packer-sdk bootcommand grammar, by using a simple regex
replacement that uses two symbols from the Unicode Private Use
Area (PUA) as markers.

With the new driver we also have the ability to wait for the first
frame, instead of users specifying an arbitrary boot wait timeout.
@torarnv torarnv force-pushed the vnc-text-recognition branch from d033baf to ecebf0f Compare February 25, 2025 12:26
@torarnv
Copy link
Contributor Author

torarnv commented Feb 25, 2025

I guess we need to move the lint and build to a macos_instance? Are there any predefined Cirrus images or rules that include the golang (lint) toolchain?

@torarnv
Copy link
Contributor Author

torarnv commented Feb 26, 2025

Missing docs for new wait command, will add after initial feature review

Done

@torarnv
Copy link
Contributor Author

torarnv commented Mar 5, 2025

@edigaryev @fkorotkov thoughts? 🙂

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants