Job Description

Hi There,

Job Title: Data Engineer/ Power BI Consultant

Location: Houston, TX (Need local Candidate)

Work Mode: Contract / Hybrid

Job Summary:

We are seeking a skilled and motivated Data Engineer with expertise in Python, PySpark, Data Lakes, Synapse Analytics, Azure Data Factory, and Medallion Architecture. The ideal candidate will play a key role in designing, building, and optimizing scalable data pipelines and data platforms in the Azure cloud ecosystem, and delivering insights via Power BI dashboards and reports.

Key Responsibilities:

• Design, develop, and manage scalable data pipelines using Python and PySpark .
• Implement and maintain data lake architectures (Delta Lake / Lakehouse) based on Medallion Architecture (Bronze, Silver, Gold layers).
• Utilize Azure Synapse Analytics to perform big data processing, data integration, and advanced analytics.
• Build and orchestrate ETL/ELT workflows using Azure Data Factory .
• Integrate data from various sources (structured, semi-structured, unstructured) into a centralized Data Warehouse .
• Ensure high data quality and implement robust data validation and monitoring frameworks.
• Work closely with BI developers and analysts to design effective Power BI dashboards and reports.
• Optimize performance of large-scale data solutions for real-time and batch processing workloads.
• Maintain and enforce data security, compliance, and governance across the platform.

Required Skills and Experience:

• Strong programming skills in Python with experience in data engineering tasks.
• Hands-on experience with PySpark for distributed data processing on big data platforms.
• Proficiency in Azure Synapse Analytics , including dedicated and serverless SQL pools.
• Solid understanding of Azure Data Lake Storage Gen2 and data lake design principles .
• Experience in building ETL/ELT pipelines with Azure Data Factory (ADF) .
• Deep knowledge of Medallion Architecture (Bronze, Silver, Gold layers) and Delta Lake format.
• Strong SQL skills for querying and transforming data in Data Warehouses .
• Experience designing, building, and publishing Power BI reports and dashboards.
• Familiarity with data governance, metadata management, and data lineage.
• Excellent communication, documentation, and collaboration skills.

Job Tags

Similar Jobs