Job Description
Job Responsibilities: • Collaborate stakeholders to gather requirements for the data catalog. Understand data management needs, user preferences, and organizational objectives for data discovery and governance. • Classify data assets based on business context, sensitivity, and usage patterns. Define metadata attributes such as data types, descriptions, tags, and ownership to enrich data assets and facilitate search and discovery. • Design and implement metadata schemas, taxonomies, and ontologies to organize and categorize data assets within the data catalog. Capture metadata attributes such as data lineage, data quality, data access controls, and usage metrics. • Develop and customize data catalog solutions using tools and platforms such as Apache Atlas, Collibra, Alation, or custom-built solutions. Configure metadata repositories, data connectors, and search capabilities to support data discovery and exploration. • Integrate the data catalog with other data management systems and tools such as data governance, data lineage, data quality, and data integration platforms. Establish data flows and APIs for importing and exporting metadata between systems. • Design intuitive user interfaces and navigation experiences for browsing, searching, and accessing data assets within the data catalog. Implement features such as faceted search, metadata visualization, and collaborative tagging. • Implement data governance policies, standards, and controls within the data catalog. Enforce data access controls, privacy regulations, and data retention policies to ensure compliance with regulatory requirements and organizational policies. • Document data catalog schemas, data dictionaries, and metadata standards in clear and comprehensive documentation. • Perform data profiling, data quality assessments, and metadata validation checks to ensure the accuracy, completeness, and consistency of metadata within the data catalog. Monitor data quality metrics and address issues as needed.
Responsibilities
Required Experience & Skills: • Minimum of 10 years of experience as a data engineer, metadata specialist, or data architect, with specific expertise in designing and implementing data catalogs. • Strong understanding of metadata management concepts, data classification, and data governance principles. • Experience with Databricks Unity data cataloging and snowflake data catalog • Proficiency in metadata modeling, taxonomies, ontologies, and schema design. • Knowledge of data integration, data quality, and data lineage technologies and methodologies. • Excellent analytical, problem-solving, and communication skills.