Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

indirect PING details to log #72

Open
neopaf opened this issue Mar 1, 2025 · 3 comments
Open

indirect PING details to log #72

neopaf opened this issue Mar 1, 2025 · 3 comments

Comments

@neopaf
Copy link

neopaf commented Mar 1, 2025

Currently indirect PING can cause this message:

            log.info('Could not reach node: %s - %s', uri,
                opts.STATUS_NAMES[opts.SUSPECT]
            )

Which does not contain the reason for fail, all we know is that direct PING failed (if it succeeded, control would not reach this log line).

Please add important through_uri information to this log line. It was that node that failed indirect PING.

We've faced situation where 1 node out of 10 in cluster had some serious network issues.
Seeing that same node in logs would have helped to diagnose those issues much sooner (spent 2 months totally ;)

Only after collating "reach" logs into this pivot table we found out that 01 node is seriously ill:
Image

@neopaf
Copy link
Author

neopaf commented Mar 1, 2025

[09:04]hermes@rd-hmstnt01 ~$ tarantool -v
Tarantool 2.10.6-0-g3990f976b

Not sure if you're working on this branch though...

@neopaf
Copy link
Author

neopaf commented Mar 1, 2025

[09:39]hermes@rd-hmstnt01 hermes_cluster$ tarantoolctl rocks list|grep membership -A1
membership
   2.4.0-1 (installed) - /tarantool_app/hermes_cluster/.rocks/share/tarantool/rocks
[09:39]hermes@rd-hmstnt01 hermes_cluster$ 

@neopaf
Copy link
Author

neopaf commented Mar 1, 2025

2.4.6 is same here, so no use upgrading :(

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant