SUMMARY.md

Table of contents

• Collibra Data Quality
• Release Notes

Installation

• Standalone
  • Standalone Install
  • Standalone Upgrade
  • Standalone Sizing
• Hadoop
  • Hadoop Install
  • EMR / Dataproc / HDI
• Cloud Native
  • Cloud Native Install
  • Cloud Native Requirements
  • EKS / GKE / AKS
• Agent

Connections

• Supported Connections
  • Connectivity to Athena
  • Connectivity to BigQuery
  • Connectivity to Hive
    • Connecting to CDH 5.16 Hive SSL/TLS/Kerberos Setup
  • Connectivity to Oracle
  • Connectivity to Presto
  • Connectivity to Redshift
  • Connectivity to Snowflake
  • Connectivity to SQL Server
• Add a Connection
• Add Connection to Agent

Features

• Profile (automatic)
• Behavior (automatic)
• Rules (user-defined)
  • Adding a Rule
  • Scores
  • Dimensions
  • Rule Types
    • SQL Based Rules
      • Simple
      • Freeform
        • Cross-Dataset Rules
      • Native
    • Stat Rules
      • Data Type Rules
  • Rule Templates
  • Rule Library
  • Rule Discovery
• More...
  • Explorer (no-code)
  • Schema (automatic)
  • Shapes (automatic)
  • Duplicates (advanced)
  • Outliers (advanced)
  • Patterns (advanced)
  • Records (advanced)
  • Source (advanced)
  • Summary

DQ JOB Examples

• Batch
  • DQ Job JDBC
  • DQ Job BigQuery
  • DQ Job Databricks
  • DQ Job Hive
  • DQ Job Files
  • DQ Job HDFS
  • DQ Job JSON
  • DQ Job MySql
  • DQ Job MongoDB
  • DQ Job S3
  • DQ Job Snowflake
• Pipelines
  • Simple
  • Advanced
  • Rules
    • Global rules
    • SQL based rules
      • Simple rule
      • Freeform SQL
    • Data type based rules
  • Outliers
  • Column Match
  • AWS DataBricks
  • Azure DataBricks
  • Options API
  • FAQs
• Advanced...
  • DQ Job Back Run
  • DQ Job Cron
  • DQ Job Kafka
  • DQ Job LinkId
  • DQ Job Validate Source
  • DQ Job 43M rows
  • Add Date Column
  • AutoProfile
  • Cloudera CLASSPATH
  • Column Matching
  • Date Time Variable Options
  • Deploy Mode
  • Explorer (advanced)
  • File Look Back
  • Filter & Filter Not
  • Multiple Pattern Relationships
  • Nulls in Datasets
  • Transform

Collibra DIC Integration

• DQ Connector
• DQ Workflows

Scorecards

• Overview
  • Scoring
• Page View
• List View

Scheduler

• Schedule a Job
• Schedule Management
  • View/Re-Run Scheduled Jobs

WORKFLOWS / ALERTS

• Email Alerts
• Assignment Queue(s)
  • Internal Assignment
  • External Assignment
  • FAQ

Labeling / Training

• Item Labeling
• Peak vs Off Peak

Catalog

• Overview
• Business Units
• Catalog Bulk Actions

Reports

• Built-In
  • Completeness Report
  • Coverage Report
  • Dataset Report
  • Summary Reports
• Custom

APIs

• REST APIs
  • Find the endpoint
  • Assignment API
  • Export and Import API
  • Export and Import Example
  • Time Zone API
• Swagger
• Notebook/Spark
  • Spark-shell Sample
  • Dupe
  • Load
  • Source
  • Profile
  • Notebook API
    • OwlOptions (base)
  • JWT
  • Cookie

Solutions

• Our Approach
  • Our Story
  • What is OwlDQ
  • DQ is the difference
• Best Practices
  • Prescriptive Personas
• Data Projects
  • Builds a Better DQ Dashboard
  • Ensures CCPA & GDPR
  • Makes your Data Lake better.
  • Speeds Migrations/Enables Replications
  • Assists Data Aggregation
  • Creating a Data Quality Pipeline
• Use Cases
  • Bank Loans
  • Bloomberg Data
  • Cyber Anomalies in Real-Time
  • Financial FxRate Data
  • Healthcare Data Quality
  • Health Insurance Claims Data
  • Intraday Positions
  • Security Reference Data
  • Smart Meter Data
  • Validating Data Movement

Benchmarks

• Performance Settings
• Performance Tests
• Performance Tuning
  • Performance Considerations

Architecture

• Architecture Diagram
  • ERD
• System Requirements
  • Hardware Sizing

Admin

• Overview
• Configuration
  • Multi-Tenancy
  • Time Based Data Retention
  • SMTP Setup
  • Advanced
• Audit
  • Dataset Audit Trail
  • Security Audit Trail
  • User Audit Trail

Security

• Overview
• Configuration
  • Active Directory LDAP
    • AD Group to Owl Role Mapping
  • Connection Security
  • Dataset Security
    • Dataset Masking
  • Local User Store Authentication
    • Adding Local Users
  • Role Based Access Control (RBAC)
  • SAML Authentication
    • Multi-tenancy support through SAML RelayState
  • Securing Passwords
  • SSL Setup (HTTPS)