This website uses Cookies. Click Accept to agree to our website's cookie use as described in our Privacy Policy. Click Preferences to customize your cookie settings.
Accept
Reject
Preferences
Log in to ask a question
Log in to ask a question
amlanroy1980
Bronze 3
Bronze 3
Since ‎03-30-2024
Saturday

My Stats

  • 8 Posts
  • 0 Solutions
  • 3 Likes given
  • 26 Likes received

amlanroy1980's Bio

Badges amlanroy1980 Earned

View all badges

Recent Activity

BigQuery external table limitations

a month ago
I have e-commerce product details stored in CSV format in the GCS bucket. Each file contains the attributes of a single product. The number of such files is approximately 4 billion.I am planning to use a BigQuery external table to query the data.It w...

BigQuery external table limitations

05-09-2024
I have e-commerce product details stored in CSV format in the GCS bucket. Each file contains the attributes of a single product. The number of such files is approximately 4 billion.I am planning to use a BigQuery external table to query the data.It w...

BigQuery external table error

05-06-2024
I have created a BigQuery external table. It refers to a GCP bucket where I have csv files containing e-commerce product details. There are close to 1.5 million files; each file contains a single product detail in the form, .When I try to run a simpl...

Overriding files in GCS bucket

04-30-2024
I am reading product content in JSON format from Kafka and creating files in the GCS bucket. The file content is JSON, one of the fields in the JSON is update time. I am creating one file for each product.I want to make sure that I do not override th...

BigQuery external table using JSON files

03-30-2024
I have e-commerce product data in JSON format. This data is frequently updated. I am planning to load this data into BigQuery. Given that the JSON files are huge (a few hundred attributes) and there are many updates, I found that it is not very cost-...