BigQuery Sharing

As you explore PAD, you may have encountered BigQuery sharing feature. As a PAD user, you can leverage this tool to access and share datasets safely and securely. CTA also uses BigQuery sharing to share data with all PAD users - more information can be found below!

What is BigQuery sharing (formerly Analytics Hub)?

BigQuery sharing is a data exchange platform within Google Cloud. Users can upload datasets to the platform (within specific guidelines) and share them with other PAD users or the public. However, it is important to note that not all datasets on BigQuery sharing are public, and even some datasets that are listed as public may require you to send an email request to the dataset owner. We recommend exercising caution with any dataset that requires an email request, as you may be asked to pay a subscription fee, or the data may not be public after all.

You can read more about BigQuery sharing here.

How do I add data from BigQuery sharing?

To get to BigQuery sharing from BigQuery, click the  + Add button on the BQ Explorer section.

This will bring up the Add sidebar, where you can scroll down and click on the Sharing section.

This will open up the BigQuery sharing, where you can search for listings by name or add filters on the left side to narrow down to only private listings available within your organization.

How do I subscribe to a dataset?

Once in the BigQuery sharing, you can search and filter listings until you find one you would like to add to your project. Click on the listing to learn more about it and get the option to add the dataset to your project.

To add to your project, click on the Subscribe button.

Add the Project and Dataset Name where you want to create the linked dataset and hit Save.

You should now see the dataset on your BQ Explorer Panel!

How and why should I use BigQuery sharing?

Access the public datasets Google provides (e.g., Census data): When you add the public datasets from BigQuery sharing, you can link them directly in your project, vs. having to navigate to the BigQuery public data project (more on that here). It’s the same data either way, but some folks prefer to have it directly in their project vs. navigating to a different project to access it. 

Access data shared by CTA in BigQuery sharing: We’re happy to offer two free data offerings through CTA’s BigQuery sharing exchange, cta_open_data.

• Clarity Campaign Labs model samples: PAD users can access and explore a 10% random sample of Clarity’s national suite of models. Using this dataset, partners can understand the types of scores available from Clarity and explore how to use the sample data to inform targeting and reporting. You can read more about the sample data here.
  
  
• OpenLabs’ OpenPrecincts Data: PAD users can use this data to measure the effectiveness of their digital programs. The dataset includes a set of ZIP clusters and ZIP clusters-to-precincts matches. With this dataset, PAD users can randomize ZIP clusters in states and send premium digital advertising to the treatment clusters - examining turnout and persuasive impact post-election. You can read more about the data here.

Access other data in BigQuery sharing relevant to your work: You can access all the other public data available in BigQuery sharing and link it to your project at your own discretion. Just keep in mind, as noted previously, that this data can come from many sources, and you should ensure you’re comfortable with where it’s coming from. 

Share your own data across projects: You can upload your own data to the BigQuery sharing and list it to share it with other projects. Keep in mind various security settings available to you when you upload; there are also other options for cross-project data access, such as authorizing datasets, and BigQuery generally supports cross-project querying as long as permissions are set appropriately.

Need help? Contact us! 

You can contact our team at help@techallies.org!