Apache Kafka you know, now managed, without the need to worry about version upgrades, rebalancing, and other operational headaches. Apache Kafka for BigQuery is in preview.
Apache Kafka® is a trademark owned by the Apache Software Foundation.
Features
Apache Kafka for BigQuery works with your existing Kafka applications, for both Google Cloud and Google Distributed Cloud. You can easily integrate with existing Kafka clusters for hybrid deployments and migrations with a single service.
Apache Kafka for BigQuery is easy to operate. It handles cluster creation with automatic broker sizing and rebalancing to save time and control costs. It offers automatic version upgrades so it is up to date on a recent version of Apache Kafka, comes with out-of-the-box Cloud Monitoring, Cloud Logging, and Identity and Access Management (IAM), and creates all deployments to be highly available by default.
Apache Kafka for BigQuery is secure out of the box. It is integrated with and supports Google Cloud IAM, customer-managed encryption keys (CMEK), and Virtual Private Cloud (VPC).
How It Works
Apache Kafka for BigQuery is a managed service that operates highly available Apache Kafka clusters. It is compatible with open source versions of Apache Kafka and includes first-party Google Cloud IAM, monitoring, logging, key management, organization policy, networking, and more.
Common Uses
Collect analytics data for streaming into BigQuery
Apache Kafka is a technology that often underlies data and AI platforms. Data engineers often rely on Apache Kafka to build pipelines that stream data into BigQuery and other analytics systems. Apache Kafka for BigQuery can be used for real-time and batch use cases like operational monitoring, fraud detection, payment processing, and product recommendations.
Collect analytics data for streaming into BigQuery
Apache Kafka is a technology that often underlies data and AI platforms. Data engineers often rely on Apache Kafka to build pipelines that stream data into BigQuery and other analytics systems. Apache Kafka for BigQuery can be used for real-time and batch use cases like operational monitoring, fraud detection, payment processing, and product recommendations.
Build event-driven microservices
Build event-driven microservices like:
Build event-driven microservices
Build event-driven microservices like:
Pricing
| Apache Kafka for BigQuery pricing | Apache Kafka pricing is based on pay-as-you-go pricing for compute, storage, and networking. | |
|---|---|---|
| Services and usage | Description | Price (USD) |
Compute | Compute charges will cover VCPU and RAM | Starting at $0.06 per CPU hour |
Storage | Local storage Broker SSD | Starting at $0.17 per GiB per month |
Persistent storage Tiered long term storage | Starting at $0.10 per GiB per month | |
Data transfer | Traffic between zones or regions | Starting at $0.01 per GiB |
For full pricing details, visit the Apache Kafka for BigQuery pricing page.
Apache Kafka for BigQuery pricing
Apache Kafka pricing is based on pay-as-you-go pricing for compute, storage, and networking.
Compute
Compute charges will cover VCPU and RAM
Starting at
$0.06
per CPU hour
Storage
Local storage
Broker SSD
Starting at
$0.17
per GiB per month
Persistent storage
Tiered long term storage
Starting at
$0.10
per GiB per month
Data transfer
Traffic between zones or regions
Starting at
$0.01
per GiB
For full pricing details, visit the Apache Kafka for BigQuery pricing page.
