skilled and experienced Data Consultant to join our team. The ideal candidate will have a strong background in Databricks, PySpark, and Python, with hands-on experience designing and building ETL pipelines, working with big data frameworks, and supporting data analytics and reporting needs. This role involves close collaboration with business stakeholders, data engineers, and analysts to ensure data is properly ingested, transformed, and made accessible for insights.

• Design, develop, and optimize scalable ETL pipelines using Databricks, PySpark, and Python.

• Work with structured and unstructured data sources to enable data ingestion, transformation, and storage.

• Develop and maintain data lake and data warehouse environments.

• Collaborate with data analysts and BI developers to ensure seamless data availability for reporting and dashboards.

• Monitor data quality, reliability, and performance across the platform.

• Support data governance and metadata management initiatives.

• Work with stakeholders to gather requirements and translate them into technical specifications.

• Optimize data workflows for performance and cost-efficiency in cloud environments.

• Provide troubleshooting and support for data-related issues and outages.

Main Technical Skills

• ETL
• data lake
• data warehouse
• PySpark
• Python
• Data Factory
• Databricks
• SQL
• Reporting tool