Skip to content

support the Arrow PyCapsule Interface without a pyarrow dependency #2118

Open
@tswast

Description

@tswast

Is your feature request related to a problem? Please describe.

The polars community uses the arrow in-memory format without a need for a dependency on the heavy weight pyarrow package, but the easiest way to get arrow out of and into BigQuery with this client requires the use of the pyarrow dependency.

Describe the solution you'd like

Expose the Arrow PyCapsule Interface on RowIterator (returned by QueryJob.result(), Client.query_and_wait(), Client.list_rows()). This functionality should not require pyarrow. See: https://gist.github.com/tswast/99b017b20386e324f5c7d2bd49f21b5f for a related example of how this could be done.

Describe alternatives you've considered

  • Separate package exposing the Arrow PyCapsule Interface
  • Always require pyarrow
  • Directly integrate into polars (in-progress)

Additional context

Metadata

Metadata

Assignees

Labels

api: bigqueryIssues related to the googleapis/python-bigquery API.

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions