Job Description
Job Description
Hi There,
Job Title: Data Engineer/ Power BI Consultant
Location: Houston, TX (Need local Candidate)
Work Mode: Contract / Hybrid
Job Summary:
We are seeking a skilled and motivated Data Engineer with expertise in Python, PySpark, Data Lakes, Synapse Analytics, Azure Data Factory, and Medallion Architecture. The ideal candidate will play a key role in designing, building, and optimizing scalable data pipelines and data platforms in the Azure cloud ecosystem, and delivering insights via Power BI dashboards and reports.
Key Responsibilities:
- Design, develop, and manage scalable data pipelines using Python and PySpark .
- Implement and maintain data lake architectures (Delta Lake / Lakehouse) based on Medallion Architecture (Bronze, Silver, Gold layers).
- Utilize Azure Synapse Analytics to perform big data processing, data integration, and advanced analytics.
- Build and orchestrate ETL/ELT workflows using Azure Data Factory .
- Integrate data from various sources (structured, semi-structured, unstructured) into a centralized Data Warehouse .
- Ensure high data quality and implement robust data validation and monitoring frameworks.
- Work closely with BI developers and analysts to design effective Power BI dashboards and reports.
- Optimize performance of large-scale data solutions for real-time and batch processing workloads.
- Maintain and enforce data security, compliance, and governance across the platform.
Required Skills and Experience:
- Strong programming skills in Python with experience in data engineering tasks.
- Hands-on experience with PySpark for distributed data processing on big data platforms.
- Proficiency in Azure Synapse Analytics , including dedicated and serverless SQL pools.
- Solid understanding of Azure Data Lake Storage Gen2 and data lake design principles .
- Experience in building ETL/ELT pipelines with Azure Data Factory (ADF) .
- Deep knowledge of Medallion Architecture (Bronze, Silver, Gold layers) and Delta Lake format.
- Strong SQL skills for querying and transforming data in Data Warehouses .
- Experience designing, building, and publishing Power BI reports and dashboards.
- Familiarity with data governance, metadata management, and data lineage.
- Excellent communication, documentation, and collaboration skills.
Job Tags
Contract work, Local area,