About Proxima Tech Solutions
Proxima Tech Solutions delivers secure, scalable, and intelligent digital transformation solutions across AI, cybersecurity, cloud infrastructure, and software development. We are looking for a skilled Data Engineer to join our team and take ownership of building and managing robust data infrastructure using Microsoft Azure and Databricks.
Role Overview
As a Data Engineer, you will be responsible for designing, developing, and maintaining scalable data pipelines and architecture within the Azure ecosystem. You will work closely with data analysts, data scientists, and business stakeholders to deliver clean, consistent, and high-quality data across systems.
Key Responsibilities
- Develop, deploy, and manage data pipelines using Azure Data Factory, Databricks, and Azure Functions
- Perform data integration, transformation, and loading (ETL/ELT) across structured and semi-structured data
- Process large volumes of data using Apache Spark, Python, and Databricks Notebooks
- Design and implement scalable data architectures and data models
- Ensure data governance, security, and compliance in all pipelines and storage solutions
- Work with Azure SQL, PostgreSQL, and other cloud-native storage technologies
- Collaborate with analytics and BI teams to deliver trusted data sources for reporting and dashboards
- Monitor pipeline performance, optimize processing, and troubleshoot data flow issues
Required Skills & Experience
- Hands-on experience with Microsoft Azure Data Services, including:
- Azure Data Factory,
- Azure SQL,
- Azure Functions,
- Azure Storage (Blob, Data Lake)
- Advanced knowledge of Databricks, Apache Spark, and Python
- Experience with data modeling, schema design, and data architecture best practices
- Proficiency with SQL and PostgreSQL
- Knowledge of data governance principles and privacy/security regulations
- Familiarity with DevOps and CI/CD for data pipelines is a plus
- Strong problem-solving and communication skills
Nice to Have
- Experience in the healthcare domain and working with clinical or medical datasets
- Experience with dashboarding/visualization tools such as Power BI, Databricks Dashboards, or Looker
- Familiarity with Delta Lake and Data Lakehouse architecture