Skip to content

Connecting Your First Datasource in Kubernetes

Enterprise data discovery begins by registering a corporate database with VDA:

  1. Network Egress Verification: Ensure Kubernetes NetworkPolicies and cloud firewall rules allow pods in the vda namespace to communicate with the target database host and port (e.g., PostgreSQL 5432, Oracle 1521).
  2. Register Datasource via VDA UI:
  3. Navigate to https://vda.company.internal/ > Data Sources > + Add Data Source.
  4. Input connection parameters (Host, Port, Database, User, Password, Schema filters).
  5. Click Test Connection to verify database reachability from the cluster.
  6. Click Save & Ingest.
  7. Temporal Worker Processing:
  8. The job is dispatched to the Temporal task queue.
  9. The metadata-worker deployment processes the pipeline: schema extraction, data profiling, lineage graph construction, and GLiNER PII classification.
  10. Scale workers horizontally for large databases:
    kubectl scale deployment/metadata-worker --replicas=5 -n vda
    
  11. Monitor via Temporal UI:
    kubectl port-forward svc/temporal-ui 8480:8080 -n vda
    
    Open http://localhost:8480 to observe workflow execution details in real time.