Cloud Data Fusion - Set up Static IP Address

[aaronpayne]

I am wanting to use Cloud Data Fusion to connect to some SQL databases in my organization. My organization needs to be able whitelist an IP address making the connection request.

I am unsure of the best route in order for my organization to whitelist the Cloud Data Fusion instance to connect to SQL database.

This is the error that I see within the CDF instance.

[ms4446]

To connect to on-premises resources securely, such as SQL Server Instances, you can create a private Cloud Data Fusion instance. This private instance allows connections to be established over a private VPC network in your Google Cloud project. The traffic over this network doesn't pass through the public internet, which increases security. Furthermore, the private instance can connect to your on-premises resources via a connection to the Google Cloud private VPC network through Cloud VPN or Cloud Interconnect, which means you can securely access your on-premises resources over the private network without opening up access to Google Cloud​

To create a private Cloud Data Fusion instance, you can use either the Google Cloud console.  The steps are as follows:

1. Go to the Create Data Fusion instance page.
2. Enter an instance name and description for your instance.
3. Select the Region in which to create the instance.
4. Select a Cloud Data Fusion Version and Edition.
5. Specify the Dataproc service account to use for running your Cloud Data Fusion pipeline in Dataproc. The default Compute Engine account is pre-selected.
6. Expand the Advanced Options menu and click Enable Private IP.
7. In the Network field, choose a network in which to create the instance.
8. Click Create.

Once the private instance is created, you may need to set up VPC Network Peering to connect with the source and sink that you use in your pipeline. Cloud Data Fusion services that you use in your design environment, such as Wrangler, Connection Manager, and Schema Validation, initiate network connections from the tenant project VPC to the source systems. Cloud Data Fusion uses VPC Network Peering to establish network connectivity to the VPC or Shared VPC that contains your instance

For more information please see the following: https://cloud.google.com/data-fusion/docs/how-to/create-private-ip

[kamari89 · Accepted solution]

In my opinion, the response above does not solve the issue, that is, we need also a static private ip address. The solution provides a range of IP addresses but nowhere in the UI I can see how to setup an specific ip address to be allowlisted. Kindly help us with this issue.

[zain216]

I am also facing the same issue. Did you set the public static ip in the NAT?

Also, did you use the cloud vpn?

[kamari89]

Ultimately I could not find a reasonable way to allocate a static IP address, mainly because the service apparently requires a range under the mask of /22 . If you use a public IP then this would have to be a load balancer that points to such range.

Hopefully someone with more information can chip in and clarify. The original answer was automatically generated I am afraid.

[zain216]

i am also stuck in the same issue.

did you use the Cloud Nat with external ip address? also is it mandatory to use the cloud vpn?