Melacak silsilah data untuk tabel BigQuery
Dokumen ini menjelaskan cara melacak asal-usul data di tabel BigQuery. Silsilah data adalah proses pelacakan asal data, bagaimana data ditransformasi, dan ke mana data berpindah dari waktu ke waktu. Memahami silsilah data sangat penting untuk memastikan kepatuhan, memecahkan masalah data, dan melakukan analisis akar masalah.
Panduan memulai ini menunjukkan cara mulai menggunakan silsilah data untuk tabel BigQuery:
Salin dua tabel dari set data
new_york_taxi_tripsyang tersedia secara publik.Gabungkan jumlah total perjalanan taksi dari kedua tabel ke dalam tabel baru.
Lihat grafik visualisasi silsilah untuk ketiga operasi.
Sebelum memulai
Siapkan project:
- Login ke akun Google Cloud Anda. Jika Anda baru menggunakan Google Cloud, buat akun untuk mengevaluasi performa produk kami dalam skenario dunia nyata. Pelanggan baru juga mendapatkan kredit gratis senilai $300 untuk menjalankan, menguji, dan men-deploy workload.
-
In the Google Cloud console, on the project selector page, select or create a Google Cloud project.
Roles required to select or create a project
- Select a project: Selecting a project doesn't require a specific IAM role—you can select any project that you've been granted a role on.
-
Create a project: To create a project, you need the Project Creator role
(
roles/resourcemanager.projectCreator), which contains theresourcemanager.projects.createpermission. Learn how to grant roles.
-
If you're using an existing project for this guide, verify that you have the permissions required to complete this guide. If you created a new project, then you already have the required permissions.
-
Verify that billing is enabled for your Google Cloud project.
Enable the Dataplex, BigQuery, and Data Lineage APIs.
Roles required to enable APIs
To enable APIs, you need the
serviceusage.services.enablepermission. If you created the project, then you likely already have this permission through the Owner role (roles/owner). Otherwise, you can get this permission through the Service Usage Admin role (roles/serviceusage.serviceUsageAdmin). Learn how to grant roles.-
In the Google Cloud console, on the project selector page, select or create a Google Cloud project.
Roles required to select or create a project
- Select a project: Selecting a project doesn't require a specific IAM role—you can select any project that you've been granted a role on.
-
Create a project: To create a project, you need the Project Creator role
(
roles/resourcemanager.projectCreator), which contains theresourcemanager.projects.createpermission. Learn how to grant roles.
-
If you're using an existing project for this guide, verify that you have the permissions required to complete this guide. If you created a new project, then you already have the required permissions.
-
Verify that billing is enabled for your Google Cloud project.
Enable the Dataplex, BigQuery, and Data Lineage APIs.
Roles required to enable APIs
To enable APIs, you need the
serviceusage.services.enablepermission. If you created the project, then you likely already have this permission through the Owner role (roles/owner). Otherwise, you can get this permission through the Service Usage Admin role (roles/serviceusage.serviceUsageAdmin). Learn how to grant roles.
Peran yang diperlukan
Untuk mendapatkan izin yang Anda perlukan guna melihat grafik visualisasi silsilah, minta administrator untuk memberi Anda peran IAM berikut:
- Pelihat Katalog Dataplex (
roles/dataplex.catalogViewer) di project resource Knowledge Catalog (sebelumnya Dataplex Universal Catalog) - Viewer Silsilah Data (
roles/datalineage.viewer) di project tempat Anda menggunakan BigQuery - BigQuery Data Viewer (
roles/bigquery.dataViewer) di project tempat Anda menggunakan BigQuery
Untuk mengetahui informasi selengkapnya tentang pemberian peran, lihat Mengelola akses ke project, folder, dan organisasi.
Anda mungkin juga bisa mendapatkan izin yang diperlukan melalui peran khusus atau peran bawaan lainnya.