Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

GH-39863: [C++] Thirdparty: Bump google benchmark to 1.8.3 #39878

Merged
merged 1 commit into from
Feb 12, 2024

Conversation

Cerdore
Copy link
Contributor

@Cerdore Cerdore commented Feb 1, 2024

Rationale for this change

Bump benchmark to 1.8.3

What changes are included in this PR?

Bump benchmark to 1.8.3

Are these changes tested?

Already has testing

Are there any user-facing changes?

no

Copy link

github-actions bot commented Feb 1, 2024

⚠️ GitHub issue #39863 has been automatically assigned in GitHub to PR creator.

@kou
Copy link
Member

kou commented Feb 1, 2024

@ursabot please benchmark lang=C++

@ursabot
Copy link

ursabot commented Feb 1, 2024

Benchmark runs are scheduled for commit 6329711. Watch https://buildkite.com/apache-arrow and https://conbench.ursa.dev for updates. A comment will be posted here when the runs are complete.

Copy link

Thanks for your patience. Conbench analyzed the 1 benchmarking run that has been run so far on PR commit 6329711.

There weren't enough matching historic benchmark results to make a call on whether there were regressions.

The full Conbench report has more details.

@pitrou
Copy link
Member

pitrou commented Feb 1, 2024

@austin3dickey The wording of the conbench summary at https://github.com/apache/arrow/runs/21102698059 is a bit unexpected, might this be due to the changes in this PR?

@austin3dickey
Copy link
Contributor

austin3dickey commented Feb 1, 2024

@pitrou Thanks for bringing that to my attention - that's unrelated to this PR. I recently upgraded conda on the machine that ran your benchmarks, and it seems to have put a break in Conbench history since the -isystem path changed. I will fix this so new benchmarks can be compared to old benchmarks.

In the meantime, you can check this link for comparisons: https://conbench.ursa.dev/compare/runs/fa53528839744c73945c88a71e31353f...e2a595b8ca9d41d4916b309b6c4ec42b/

(Sorry that page takes so long to load; I will fix that problem soon.)

@austin3dickey
Copy link
Contributor

I fixed the broken history in Conbench and manually reviewed the comparison I linked above. It looks good to me. I don't think this change has much of a performance effect on any of the benchmarks.

@kou
Copy link
Member

kou commented Feb 2, 2024

@ursabot please benchmark lang=C++

@ursabot
Copy link

ursabot commented Feb 2, 2024

Commit 6329711 already has scheduled benchmark runs.

@kou
Copy link
Member

kou commented Feb 3, 2024

@Cerdore Could you rebase on main?

Copy link

github-actions bot commented Feb 3, 2024

⚠️ GitHub issue #39863 has been automatically assigned in GitHub to PR creator.

@Cerdore
Copy link
Contributor Author

Cerdore commented Feb 4, 2024

@Cerdore Could you rebase on main?

Already rebased.

@Cerdore
Copy link
Contributor Author

Cerdore commented Feb 4, 2024

@ursabot please benchmark lang=C++

@ursabot
Copy link

ursabot commented Feb 4, 2024

Benchmark runs are scheduled for commit ddeef70. Watch https://buildkite.com/apache-arrow and https://conbench.ursa.dev for updates. A comment will be posted here when the runs are complete.

Copy link

Thanks for your patience. Conbench analyzed the 1 benchmarking run that has been run so far on PR commit ddeef70.

There were 2 benchmark results indicating a performance regression:

The full Conbench report has more details.

@pitrou

This comment was marked as outdated.

This comment was marked as outdated.

@pitrou

This comment was marked as outdated.

This comment was marked as outdated.

@pitrou

This comment was marked as outdated.

This comment was marked as off-topic.

@pitrou
Copy link
Member

pitrou commented Feb 12, 2024

@github-actions crossbow submit -g cpp

Copy link

Revision: 946363c

Submitted crossbow builds: ursacomputing/crossbow @ actions-00241391af

Task Status
test-alpine-linux-cpp GitHub Actions
test-build-cpp-fuzz GitHub Actions
test-conda-cpp GitHub Actions
test-conda-cpp-valgrind Azure
test-cuda-cpp GitHub Actions
test-debian-11-cpp-amd64 GitHub Actions
test-debian-11-cpp-i386 GitHub Actions
test-fedora-38-cpp GitHub Actions
test-ubuntu-20.04-cpp GitHub Actions
test-ubuntu-20.04-cpp-bundled GitHub Actions
test-ubuntu-20.04-cpp-minimal-with-formats GitHub Actions
test-ubuntu-20.04-cpp-thread-sanitizer GitHub Actions
test-ubuntu-22.04-cpp GitHub Actions
test-ubuntu-22.04-cpp-20 GitHub Actions
test-ubuntu-22.04-cpp-no-threading GitHub Actions

Copy link
Member

@pitrou pitrou left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for the PR, @Cerdore ! I'll merge now.

@pitrou pitrou merged commit b6313a7 into apache:main Feb 12, 2024
31 of 32 checks passed
@pitrou pitrou removed the awaiting review Awaiting review label Feb 12, 2024
@github-actions github-actions bot added the awaiting committer review Awaiting committer review label Feb 12, 2024
Copy link

After merging your PR, Conbench analyzed the 6 benchmarking runs that have been run so far on merge-commit b6313a7.

There were no benchmark performance regressions. 🎉

The full Conbench report has more details. It also includes information about 7 possible false positives for unstable benchmarks that are known to sometimes produce them.

dgreiss pushed a commit to dgreiss/arrow that referenced this pull request Feb 19, 2024
…che#39878)

## Rationale for this change
Bump benchmark to 1.8.3

## What changes are included in this PR?
Bump benchmark to 1.8.3

## Are these changes tested?
Already has testing

## Are there any user-facing changes?
no

* Closes: apache#39863

Authored-by: xiansen.chen <[email protected]>
Signed-off-by: Antoine Pitrou <[email protected]>
zanmato1984 pushed a commit to zanmato1984/arrow that referenced this pull request Feb 28, 2024
…che#39878)

## Rationale for this change
Bump benchmark to 1.8.3

## What changes are included in this PR?
Bump benchmark to 1.8.3

## Are these changes tested?
Already has testing

## Are there any user-facing changes?
no

* Closes: apache#39863

Authored-by: xiansen.chen <[email protected]>
Signed-off-by: Antoine Pitrou <[email protected]>
thisisnic pushed a commit to thisisnic/arrow that referenced this pull request Mar 8, 2024
…che#39878)

## Rationale for this change
Bump benchmark to 1.8.3

## What changes are included in this PR?
Bump benchmark to 1.8.3

## Are these changes tested?
Already has testing

## Are there any user-facing changes?
no

* Closes: apache#39863

Authored-by: xiansen.chen <[email protected]>
Signed-off-by: Antoine Pitrou <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

Successfully merging this pull request may close these issues.

[C++] Bump bundled Google benchmark version
5 participants