Membuat profil dan memvalidasi kualitas data

Sebelum memulai

Siapkan project:

Login ke akun Google Cloud Anda. Jika Anda baru menggunakan Google Cloud, buat akun untuk mengevaluasi performa produk kami dalam skenario dunia nyata. Pelanggan baru juga mendapatkan kredit gratis senilai $300 untuk menjalankan, menguji, dan men-deploy workload.

In the Google Cloud console, on the project selector page, select or create a Google Cloud project.

Roles required to select or create a project

• Select a project: Selecting a project doesn't require a specific IAM role—you can select any project that you've been granted a role on.
• Create a project: To create a project, you need the Project Creator role (roles/resourcemanager.projectCreator), which contains the resourcemanager.projects.create permission. Learn how to grant roles.

Go to project selector

If you're using an existing project for this guide, verify that you have the permissions required to complete this guide. If you created a new project, then you already have the required permissions.

Verify that billing is enabled for your Google Cloud project.

Enable the Knowledge Catalog and BigQuery APIs.

Roles required to enable APIs

To enable APIs, you need the serviceusage.services.enable permission. If you created the project, then you likely already have this permission through the Owner role (roles/owner). Otherwise, you can get this permission through the Service Usage Admin role (roles/serviceusage.serviceUsageAdmin). Learn how to grant roles.

Enable the APIs

In the Google Cloud console, on the project selector page, select or create a Google Cloud project.

Roles required to select or create a project

• Select a project: Selecting a project doesn't require a specific IAM role—you can select any project that you've been granted a role on.
• Create a project: To create a project, you need the Project Creator role (roles/resourcemanager.projectCreator), which contains the resourcemanager.projects.create permission. Learn how to grant roles.

Go to project selector

If you're using an existing project for this guide, verify that you have the permissions required to complete this guide. If you created a new project, then you already have the required permissions.

Verify that billing is enabled for your Google Cloud project.

Enable the Knowledge Catalog and BigQuery APIs.

Roles required to enable APIs

To enable APIs, you need the serviceusage.services.enable permission. If you created the project, then you likely already have this permission through the Owner role (roles/owner). Otherwise, you can get this permission through the Service Usage Admin role (roles/serviceusage.serviceUsageAdmin). Learn how to grant roles.

Enable the APIs

Peran yang diperlukan

Untuk mendapatkan izin yang diperlukan untuk membuat dan menjalankan pemindaian profil data dan kualitas data, serta mengelola resource BigQuery, minta administrator Anda untuk memberi Anda peran IAM berikut di project:

• Membuat, menjalankan, dan menghapus pemindaian data: Editor Dataplex DataScan (roles/dataplex.dataScanEditor)
• Membuat, mengisi, dan menghapus tabel contoh: BigQuery Data Owner (roles/bigquery.dataOwner)
• Menjalankan kueri SQL di BigQuery: BigQuery Job User (roles/bigquery.jobUser)

Untuk mengetahui informasi selengkapnya tentang pemberian peran, lihat Mengelola akses ke project, folder, dan organisasi.

Anda mungkin juga bisa mendapatkan izin yang diperlukan melalui peran khusus atau peran bawaan lainnya.

Jika memiliki izin yang diperlukan untuk mengelola akses IAM di project, Anda dapat memberikan peran ini ke akun pengguna Anda sendiri dengan menjalankan perintah gcloud berikut:

gcloud projects add-iam-policy-binding PROJECT_ID \
    --member="user:USER_EMAIL" \
    --role="roles/dataplex.dataScanEditor"

gcloud projects add-iam-policy-binding PROJECT_ID \
    --member="user:USER_EMAIL" \
    --role="roles/bigquery.dataOwner"

gcloud projects add-iam-policy-binding PROJECT_ID \
    --member="user:USER_EMAIL" \
    --role="roles/bigquery.jobUser"

Ganti kode berikut:

• PROJECT_ID: Google Cloud Project ID Anda.
• USER_EMAIL: alamat email akun pengguna Anda (misalnya, name@example.com).

Memberikan izin ke agen layanan Knowledge Catalog

Agen layanan adalah akun layanan yang dikelola Google yang digunakan Knowledge Catalog untuk menjalankan kueri pemindaian di BigQuery atas nama Anda.

1. Di konsol Google Cloud , klik Activate Cloud Shell di toolbar. Penyediaan dan koneksi lingkungan memerlukan waktu beberapa saat.

2. Buat agen layanan Knowledge Catalog:

   gcloud beta services identity create --service=dataplex.googleapis.com
   

   Perintah ini membuat agen layanan jika belum disediakan dan menampilkan emailnya. Jika project Anda sudah memiliki agen layanan Knowledge Catalog, perintah akan menampilkan identitas yang ada tanpa melakukan perubahan apa pun.

   Outputnya mirip dengan hal berikut ini:

   serviceAccount:service-PROJECT_NUMBER@gcp-sa-dataplex.iam.gserviceaccount.com
   

   Catat PROJECT_NUMBER di output untuk langkah berikutnya.

3. Berikan peran BigQuery Job User (roles/bigquery.jobUser) agar Knowledge Catalog dapat menjalankan tugas kueri di project Anda:

   gcloud projects add-iam-policy-binding PROJECT_ID \
      --member="serviceAccount:service-PROJECT_NUMBER@gcp-sa-dataplex.iam.gserviceaccount.com" \
      --role="roles/bigquery.jobUser"
   

   Ganti kode berikut:

   • PROJECT_ID: Google Cloud Project ID Anda.
   • PROJECT_NUMBER: nomor project Google Cloud Anda.

4. Berikan peran BigQuery Data Viewer (roles/bigquery.dataViewer) agar agen layanan dapat membaca data dan skema tabel Anda:

   gcloud projects add-iam-policy-binding PROJECT_ID \
      --member="serviceAccount:service-PROJECT_NUMBER@gcp-sa-dataplex.iam.gserviceaccount.com" \
      --role="roles/bigquery.dataViewer"
   

   Ganti kode berikut:

   • PROJECT_ID: Google Cloud Project ID Anda.
   • PROJECT_NUMBER: nomor project Google Cloud Anda.