GH-55440: [C++] Move bundled google-cloud-cpp libraries by tadeja · Pull Request #55319 · apache/arrow

tadeja · 2026-10-29T19:10:50Z

Rationale for this change

Fix #55440. This is a follow-up to #54905. Bundled google-cloud-cpp remained in libarrow_bundled_dependencies.a, which broke static linking of non-GCS consumers such as arrow-example-s3-static.

What changes are included in this PR?

Move bundled google-cloud-cpp into a new libarrow_gcs_bundled_dependencies library, linked via ArrowGcs::arrow_gcs_static and arrow-gcs.pc.
Fix GCS static link dependencies and order.
Update R and Linux packaging.
Add GCS and S3+GCS static-link checks to cpp/examples/minimal_build.
Document arrow_gcs_bundled_dependencies in building.rst

Are these changes tested?

Yes. The new minimal_build static-link checks in CI C++ (ARM64 macOS 26 C++ or 15-intel C++ ...) and C++ Extra (AMD64 Debian SIMD Level NONE or AMD64 Alpine Linux ...) and crossbow test-debian-13-cpp-amd64

Are there any user-facing changes?

Yes. Static builds with bundled google-cloud-cpp install a new libarrow_gcs_bundled_dependencies library.
CMake and pkg-config users get it automatically, others must link it after arrow_gcs.

Was AI used for this PR?

In accordance to the AI generation guidelines, please disclose below whether and how AI was used in this PR.

PR code and description written by:

Human
AI

Reviewed before submission by:

Human
AI
Not reviewed

GitHub Issue: [C++][CI] Static S3 linking test fails after GCS moved out #55440

github-actions · 2026-10-29T19:11:17Z

Thanks for opening a pull request!

This pull request has been automatically converted to a draft because its title doesn't match Arrow's required format.

If this is not a minor PR, could you open an issue for this pull request on GitHub? https://github.com/apache/arrow/issues/new/choose

Opening GitHub issues ahead of time contributes to the Openness of the Apache Arrow project.

Then could you also rename the pull request title in the following format?

GH-${GITHUB_ISSUE_ID}: [${COMPONENT}] ${SUMMARY}

or

MINOR: [${COMPONENT}] ${SUMMARY}

After updating the title, you can mark the pull request as ready for review.

See also:

tadeja · 2026-11-05T12:37:56Z

As found in #55317 (comment), the following PR

GH-54902: [C++] Move GCS and google-cloud-cpp to its own libarrow_gcs.so #54905

caused
C++ Extra job AMD64 Debian SIMD Level NONE to start failing on 28 Oct
https://github.com/apache/arrow/actions/runs/40608463298/job/122553847383#step:6:5030

[100%] Linking CXX executable arrow-example-s3-static
/usr/bin/ld: /usr/local/lib/libarrow_bundled_dependencies.a(log.cc.o): in function `google::cloud::v3_2::(anonymous namespace)::Timestamp::Timestamp(std::chrono::time_point<std::chrono::_V2::system_clock, std::chrono::duration<long, std::ratio<1l, 1000000000l> > > const&)':
/build/cpp/_deps/google_cloud_cpp-src/google/cloud/log.cc:41:(.text+0x29): undefined reference to `absl::debian7::FromChrono(std::chrono::time_point<std::chrono::_V2::system_clock, std::chrono::duration<long, std::ratio<1l, 1000000000l> > > const&)'
/usr/bin/ld: /usr/local/lib/libarrow_bundled_dependencies.a(log.cc.o): in function `google::cloud::v3_2::(anonymous namespace)::operator<<(std::ostream&, google::cloud::v3_2::(anonymous namespace)::Timestamp const&)':
/build/cpp/_deps/google_cloud_cpp-src/google/cloud/log.cc:47:(.text+0x9f): undefined reference to `absl::debian7::FormatTime[abi:cxx11](absl::debian7::string_view, absl::debian7::Time, absl::debian7::TimeZone)'
/usr/bin/ld: /usr/local/lib/libarrow_bundled_dependencies.a(log.cc.o): in function `absl::debian7::UTCTimeZone()':
/usr/include/absl/time/time.h:1277:(.text._ZN4absl7debian711UTCTimeZoneEv[_ZN4absl7debian711UTCTimeZoneEv]+0x9): undefined reference to `absl::debian7::time_internal::cctz::utc_time_zone()'
collect2: error: ld returned 1 exit status
gmake[2]: *** [CMakeFiles/arrow-example-s3-static.dir/build.make:144: arrow-example-s3-static] Error 1
gmake[1]: *** [CMakeFiles/Makefile2:122: CMakeFiles/arrow-example-s3-static.dir/all] Error 2
gmake: *** [Makefile:91: all] Error 2

And also test-debian-13-cpp-amd64 is failing since 29 Oct 2026 the same way:
https://github.com/ursacomputing/crossbow/actions/runs/40825143204/job/123286357741#step:7:5014

[100%] Linking CXX executable arrow-example-s3-static
/usr/bin/ld: /usr/local/lib/libarrow_bundled_dependencies.a(log.cc.o): in function `google::cloud::v3_2::(anonymous namespace)::Timestamp::Timestamp(std::chrono::time_point<std::chrono::_V2::system_clock, std::chrono::duration<long, std::ratio<1l, 1000000000l> > > const&)':
/build/cpp/_deps/google_cloud_cpp-src/google/cloud/log.cc:41:(.text+0x29): undefined reference to `absl::debian7::FromChrono(std::chrono::time_point<std::chrono::_V2::system_clock, std::chrono::duration<long, std::ratio<1l, 1000000000l> > > const&)'
/usr/bin/ld: /usr/local/lib/libarrow_bundled_dependencies.a(log.cc.o): in function `google::cloud::v3_2::(anonymous namespace)::operator<<(std::ostream&, google::cloud::v3_2::(anonymous namespace)::Timestamp const&)':
/build/cpp/_deps/google_cloud_cpp-src/google/cloud/log.cc:47:(.text+0x9f): undefined reference to `absl::debian7::FormatTime[abi:cxx11](absl::debian7::string_view, absl::debian7::Time, absl::debian7::TimeZone)'
/usr/bin/ld: /usr/local/lib/libarrow_bundled_dependencies.a(log.cc.o): in function `absl::debian7::UTCTimeZone()':
/usr/include/absl/time/time.h:1277:(.text._ZN4absl7debian711UTCTimeZoneEv[_ZN4absl7debian711UTCTimeZoneEv]+0x9): undefined reference to `absl::debian7::time_internal::cctz::utc_time_zone()'
collect2: error: ld returned 1 exit status
gmake[2]: *** [CMakeFiles/arrow-example-s3-static.dir/build.make:144: arrow-example-s3-static] Error 1
gmake[1]: *** [CMakeFiles/Makefile2:122: CMakeFiles/arrow-example-s3-static.dir/all] Error 2
gmake: *** [Makefile:91: all] Error 2

tadeja · 2026-11-05T12:38:39Z

@github-actions crossbow submit test-debian-13-cpp-amd64

github-actions · 2026-11-05T12:40:46Z

Revision: 2476a34

Submitted crossbow builds: ursacomputing/crossbow @ actions-1fd9f52c9c

Task	Status
test-debian-13-cpp-amd64

github-actions · 2026-11-07T12:15:03Z

⚠️ GitHub issue #55440 has been automatically assigned in GitHub to PR creator.

raulcd · 2026-11-11T11:37:06Z

@tadeja, I remembered about this issue now and was trying to find whether it was already fixed or not. Can I help with anything?

tadeja · 2026-11-11T18:44:56Z

@github-actions crossbow submit test-debian-13-cpp-amd64

github-actions · 2026-11-11T18:47:36Z

Revision: d152824

Submitted crossbow builds: ursacomputing/crossbow @ actions-b7baa33877

Task	Status
test-debian-13-cpp-amd64

tadeja · 2026-11-11T21:39:52Z

@github-actions crossbow submit r-binary-packages test-r-offline-maximal test-debian-13-cpp-amd64

github-actions · 2026-11-11T21:42:24Z

Revision: 2e189b3

Submitted crossbow builds: ursacomputing/crossbow @ actions-4af363edcb

Task	Status
r-binary-packages
test-debian-13-cpp-amd64
test-r-offline-maximal

tadeja · 2026-11-12T10:08:40Z

@github-actions crossbow submit r-binary-packages test-r-offline-maximal test-debian-13-cpp-amd64

github-actions · 2026-11-12T10:11:57Z

Revision: 04198cf

Submitted crossbow builds: ursacomputing/crossbow @ actions-788d5c7556

Task	Status
r-binary-packages
test-debian-13-cpp-amd64
test-r-offline-maximal

Copilot

🟢 Approval recommended

No active review issues are reported for the GCS static-link dependency changes.

No open issues 🎉

_{Review effort: Balanced}

tadeja · 2026-11-12T11:17:06Z

@github-actions crossbow submit test-r-offline-maximal

github-actions · 2026-11-12T11:18:09Z

Revision: 04198cf

Submitted crossbow builds: ursacomputing/crossbow @ actions-f295c03c10

Task	Status
test-r-offline-maximal

Copilot

🟢 Approval recommended

No active review issues are recorded for the GCS dependency archive separation.

No open issues 🎉

_{Review effort: Balanced}

tadeja · 2026-11-12T12:24:11Z

@github-actions crossbow submit test-debian-13-cpp-amd64

github-actions · 2026-11-12T12:26:29Z

Revision: 57f6da7

Submitted crossbow builds: ursacomputing/crossbow @ actions-8209b2703a

Task	Status
test-debian-13-cpp-amd64

tadeja · 2026-11-12T12:28:04Z

@github-actions crossbow submit test-ubuntu-22.04-cpp-bundled test-ubuntu-24.04-cpp-gcc-13-bundled

github-actions · 2026-11-12T12:30:16Z

Revision: 57f6da7

Submitted crossbow builds: ursacomputing/crossbow @ actions-2f1460b1ff

Task	Status
test-ubuntu-22.04-cpp-bundled
test-ubuntu-24.04-cpp-gcc-13-bundled

tadeja · 2026-11-12T13:52:33Z

@raulcd, @kou this is finally ready for a review now.
All failing 3 C++ jobs and R job look unrelated (appear on other PRs too).

raulcd · 2026-11-12T15:58:48Z

+  set(ARROW_GCS_BUNDLED_STATIC_LIBS
+      google-cloud-cpp::storage google-cloud-cpp::rest_internal google-cloud-cpp::common


I am still trying to get my head around why this is an issue but

list(PREPEND ARROW_BUNDLED_STATIC_LIBS ${AWSSDK_LINK_LIBRARIES})

isn't and we don't seem to require an ARROW_S3_BUNDLED_STATIC_LIBS

ok, as this is green and fixes a real issue I think we should merge. We should probably create ARROW_S3_BUNDLED_STATIC_LIBS as this might be just coincidence that is not currently failing but we can do that afterwards.

Tentatively created this one

[C++] Consider separating bundled AWS SDK libraries from Arrow dependencies #55591

kou

+1

I've opened #55583 to clean up ArrowConfig.cmake.in.

tadeja · 2026-11-13T10:42:52Z

@github-actions crossbow submit test-debian-13-cpp-amd64 test-ubuntu-22.04-cpp-bundled test-ubuntu-24.04-cpp-gcc-13-bundled

Copilot

🟢 Approval recommended

No active review issues were identified for the change separating bundled GCS dependencies from Arrow’s core archive.

No open issues 🎉

_{Review effort: Balanced}

github-actions · 2026-11-13T10:49:37Z

Revision: 3b04d01

Submitted crossbow builds: ursacomputing/crossbow @ actions-b0e1ebe2bb

Task	Status
test-debian-13-cpp-amd64
test-ubuntu-22.04-cpp-bundled
test-ubuntu-24.04-cpp-gcc-13-bundled

github-actions Bot added Component: C++ Component: Documentation awaiting committer review labels Oct 29, 2026

tadeja mentioned this pull request Oct 29, 2026

GH-55316: [CI][FlightRPC][ODBC] Apply ports.patch in Windows build #55317

Merged

3 of 5 tasks

tadeja changed the title ~~EXP: [C++] Move bundled google-cloud-cpp libraries~~ GH-55440: [C++] Move bundled google-cloud-cpp libraries Nov 7, 2026

raulcd removed the awaiting committer review label Nov 10, 2026

tadeja added 3 commits November 11, 2026 17:36

Fix static linking post-apache#54905

34bce67

Abseil order fix

fe52c64

curl/OpenSSL order fix

d152824

tadeja force-pushed the fup-54905-gcs-static-bundle branch from 2476a34 to d152824 Compare November 11, 2026 16:36

Fix R static linking

eb35d63

github-actions Bot added the Component: R label Nov 11, 2026

tadeja added the CI: Extra: C++ Run extra C++ CI label Nov 11, 2026

Fix order of GCS OpenSSL link

2e189b3

tadeja added CI: Extra: C++ Run extra C++ CI and removed CI: Extra: C++ Run extra C++ CI labels Nov 11, 2026

tadeja marked this pull request as ready for review November 11, 2026 23:12

tadeja requested review from assignUser, jonkeane and kou as code owners November 11, 2026 23:12

Copilot AI balanced review requested due to automatic review settings November 12, 2026 10:08

Copilot started reviewing on behalf of tadeja November 12, 2026 10:09

View session

Copilot AI reviewed Nov 12, 2026

View reviewed changes

Single minimal_build config and update building docs

57f6da7

Copilot AI balanced review requested due to automatic review settings November 12, 2026 12:19

Copilot started reviewing on behalf of tadeja November 12, 2026 12:20

View session

Copilot AI reviewed Nov 12, 2026

View reviewed changes

raulcd reviewed Nov 12, 2026

View reviewed changes

kou added the CI: Extra: Package: Linux Run extra Linux Packages CI label Nov 13, 2026

kou approved these changes Nov 13, 2026

View reviewed changes

Comment thread ci/scripts/cpp_test.sh Resolved

raulcd approved these changes Nov 13, 2026

View reviewed changes

Explicit S3 check before target. Reorder fix

3b04d01

Copilot AI balanced review requested due to automatic review settings November 13, 2026 10:36

Copilot started reviewing on behalf of tadeja November 13, 2026 10:40

View session

Copilot AI reviewed Nov 13, 2026

View reviewed changes

tadeja mentioned this pull request Nov 13, 2026

[C++] Consider separating bundled AWS SDK libraries from Arrow dependencies #55591

Open

raulcd approved these changes Nov 13, 2026

View reviewed changes

kou merged commit ab5b422 into apache:main Nov 13, 2026
88 of 92 checks passed

kou mentioned this pull request Nov 13, 2026

[C++][CI] Static S3 linking test fails after GCS moved out #55440

Closed

		set(ARROW_GCS_BUNDLED_STATIC_LIBS
		google-cloud-cpp::storage google-cloud-cpp::rest_internal google-cloud-cpp::common

Conversation

tadeja commented Oct 29, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Rationale for this change

What changes are included in this PR?

Are these changes tested?

Are there any user-facing changes?

Was AI used for this PR?

Uh oh!

github-actions Bot commented Oct 29, 2026

Uh oh!

tadeja commented Nov 5, 2026

Uh oh!

tadeja commented Nov 5, 2026

Uh oh!

github-actions Bot commented Nov 5, 2026

Uh oh!

github-actions Bot commented Nov 7, 2026

Uh oh!

raulcd commented Nov 11, 2026

Uh oh!

tadeja commented Nov 11, 2026

Uh oh!

github-actions Bot commented Nov 11, 2026

Uh oh!

tadeja commented Nov 11, 2026

Uh oh!

github-actions Bot commented Nov 11, 2026

Uh oh!

tadeja commented Nov 12, 2026

Uh oh!

github-actions Bot commented Nov 12, 2026

Uh oh!

Copilot AI left a comment

Choose a reason for hiding this comment

🟢 Approval recommended

Uh oh!

tadeja commented Nov 12, 2026

Uh oh!

github-actions Bot commented Nov 12, 2026

Uh oh!

Copilot AI left a comment

Choose a reason for hiding this comment

🟢 Approval recommended

Uh oh!

tadeja commented Nov 12, 2026

Uh oh!

github-actions Bot commented Nov 12, 2026

Uh oh!

tadeja commented Nov 12, 2026

Uh oh!

github-actions Bot commented Nov 12, 2026

Uh oh!

tadeja commented Nov 12, 2026

Uh oh!

raulcd Nov 12, 2026

Choose a reason for hiding this comment

Uh oh!

raulcd Nov 13, 2026

Choose a reason for hiding this comment

Uh oh!

tadeja Nov 13, 2026

Choose a reason for hiding this comment

Uh oh!

Uh oh!

kou left a comment

Choose a reason for hiding this comment

Uh oh!

Uh oh!

tadeja commented Nov 13, 2026

Uh oh!

Copilot AI left a comment

Choose a reason for hiding this comment

🟢 Approval recommended

Uh oh!

github-actions Bot commented Nov 13, 2026

Uh oh!

Uh oh!

Reviewers

Uh oh!

tadeja commented Oct 29, 2026 •

edited

Loading