Azure Data Engineer | Databricks & PySpark
Techforce Group Limited
TechForce is partnering with a leading insurer to support their growing Data & AI team.
Based in Manila, you'll work alongside senior engineering, architecture and analytics teams across Asia and Canada to build scalable data pipelines, reusable data products and enterprise-grade data solutions. This is an opportunity to work on a high-profile cloud data platform using Azure, Databricks and Spark technologies, supporting business, analytics and reporting use cases across a complex regional environment.
ResponsibilitiesDesign, develop and support data pipelines integrating data from multiple source systems into a centralised enterprise data lake.
Build and maintain ETL/ELT solutions using Azure Data Factory, Azure Databricks, Spark/PySpark, Python and SQL.
Develop ingestion, transformation and data quality processes, leveraging established global frameworks, engineering standards and reusable patterns.
Troubleshoot pipeline failures, optimise processing performance and support production issue resolution.
Perform testing, deployment validation and data reconciliation activities to ensure reliable delivery.
Collaborate with architects, analysts, QA teams and engineers across Asia and North America throughout the delivery lifecycle.
Contribute to reusable data products and curated datasets that support reporting, analytics and business consumption.
Maintain technical documentation, operational procedures and knowledge-sharing materials.
Strong hands-on Spark/PySpark, Python and SQL experience , with the ability to build, troubleshoot and optimise data pipelines in a production environment.
Practical Azure and Databricks delivery experience , including Azure Data Factory, Azure Databricks and Azure Data Lake Storage.
Experience delivering end-to-end data engineering solutions , including testing, data quality validation, troubleshooting, documentation and production support.
Experience with ETL/ELT development, data integration, transformation and large-scale data processing.
Strong written and spoken English with the ability to collaborate effectively across distributed regional and global teams.
3+ years of relevant Data Engineering experience within cloud or enterprise data environments.
- ...Frontline Data Solutions provides web-based environmental, health, and safety software... ...chip industrial customers. As a Data Engineer at Frontline Data Solutions, you will... ...Spark: 2+ years of experience with Spark, PySpark, understanding of distributed processing...Remote job
- ...Are you passionate about building scalable data solutions and optimizing data workflows?... ...maintain scalable data pipelines using Databricks and Apache Spark. ✅ Build and manage batch... .... ✅ Experience with Apache Spark/PySpark, ETL/ELT, and SQL query optimization. ✅...
- ...Specializing in IT and software engineering, we drive innovation in... ...8 years of professional data engineering experience, including... ...hands-on experience with Azure and Azure Databricks is required. Strong... ...solutions using Databricks, PySpark, Spark SQL, Delta Lake, and...
- ...Responsibilities: Design, develop, and maintain scalable data architectures, pipelines, and ETL/ELT processes using Azure Databricks, Synapse Analytics, and Microsoft Fabric.... ...~ Bachelor’s degree in Computer Science, Engineering, Mathematics, or a related field; Master’s...
- ...Experience ~8+ years of Data Engineering experience with expertise in ETL/ELT, data pipelines... ...(3/5 or higher). Experience with Databricks , Snowflake , or similar cloud data... ...Hands-on experience with Microsoft Azure services is preferred. Strong understanding...
- ...We are seeking a highly skilled Senior Data Engineer to join our growing Data and AI solutions... ...platforms (preferably GCP, but AWS/Azure acceptable). ~ Proven ability to lead... ..., Azure Synapse , AWS Redshift , Databricks , Fivetran , Confluent , and MongoDB...
- ...Microsoft Fabric & Databricks Developer Location: Cebu... ...and maintaining scalable data solutions using... ...logic using SQL, Python, PySpark, and Spark. Integrate... ...workflows. Collaborate with engineers, architects, analysts,... ...Familiarity with Git, Azure DevOps, Jira (or...
- ...are looking for a highly skilled Lead Sr. Data Engineer to join our team in BGC. In this role,... ...modern cloud data platforms, specifically Databricks ~ Strong exposure to cloud environments, with a preference for Microsoft Azure ~ Exceptional oral and written communication...
- ...Tasks: Design, model and development of whole GCP data ecosystem for one of our Client’s (Cloud Storage, Cloud Functions... ...Spark, especially in GCP environment. Experience with Databricks. Experience with Azure cloud-based infrastructure & systems. Missing one or...
- ...Business Journals list of top places to work. Mission As the Data Engineer you will design, build, and optimize scalable data... ...performance across platforms such as BigQuery, Snowflake, or Azure Synapse to improve query efficiency, scalability, and data accessibility...
- ...Responsibilities: Own data pipeline development: Design, develop, and... ...Lead and mentor a small team: Guide 2-3 engineers, break requirements into actionable tasks... ...Hands-on experience with Apache Spark using PySpark or Scala. Experience with Snowflake...
- ...support business decisions, is growing and is hiring a senior data engineer to help own and scale the data platform underpinning our... ...agentic workflows). Hands-on experience with Snowflake and Databricks. Education ~ BS in Engineering, Computer Science, Information...
- ...Job Summary and Key Accountabilities The Data Operations Specialist serves as a crucial link between marketing data sources and the... ..., data processing, validation, automation and reusable data-engineering workflows. Translate business and reporting requirements into...
- ...to client architects, data leaders and CIOs. Delivery... ...solutions. Deliver Databricks lakehouses, including... ..., prompt/context engineering, cost and latency.... ...Unity Catalog, Spark/PySpark, Lakeflow or Delta Live... ...cost optimisation. Azure/Microsoft: Data Factory...
- ...access controls, including role-based access control (RBAC), secure data sharing, and data governance policies to protect sensitive data... ...data integrity and availability. Collaborate with data engineers to integrate Snowflake with external data sources, data lakes,...
- ...We are looking for an experienced and results-driven Data Engineer to join our dynamic data engineering team. In this role, you will design, build, and optimize high-performance ETL pipelines, manage scalable data warehousing solutions, and support business intelligence...
- ...Job Summary We are looking for an experienced Data Engineer to develop, maintain, and optimize data pipelines and ETL processes that support business data integration, reporting, and analytics requirements. Key Responsibilities Design, develop, and maintain ETL/...
- ...Job Summary The Data Engineer is responsible for designing, building, and maintaining scalable data platforms and pipelines that transform raw data into reliable, accessible information to support enterprise reporting, analytics, and business decision-making. Responsibilities...
- ...Data engineering at J4RVIS means building the foundations that make enterprise data reliable, accessible, and ready to drive business decisions... .... • CI/CD for dbt using GitHub Actions, GitLab CI/CD, Azure DevOps, or equivalent tools. • Data orchestration using Airflow...
- ...Azure API Management (APIM) Developer Location: Cebu or Manila, Philippines (Remote-first, aligned to Australian business hours –... ...stakeholders. Enjoys working in collaborative, outcome-oriented engineering teams. Bonus (Nice to Have) Experience with Azure...
- ...right training to secure their growth and advancement towards their career aspirations. Job Summary We are seeking a Senior Data Engineer to own the ingestion, data model, and reconciliation layers of a financial billing and invoicing data platform built on Google...
- ...As a core member of our Loan Services Data and Reporting team, you will be working with... ...Designing cloud applications using Microsoft Azure/AWS cloud technologies Qualifications... ...strong programming skills: Python, SQL, PySpark etc. Prior experience supporting ETL...
- ...About the role Operate, inspect, and maintain data center electrical infrastructure to support continuous availability, including... ...· Bachelor’s degree, college degree, or diploma in Electrical Engineering or an equivalent electrical qualification. An applicable professional...
- ...markets, improving price discovery, liquidity, and distribution of data, through responsible and innovative solutions. Through our... ...across global OTC markets. We are seeking a Market Data Support Engineer to join our Manila-based team within Parameta Solutions. This...
- ...Description: We are looking for a Data Modeler with 4–7 years of relevant experience... ...business, SAP functional, and data engineering teams to build reliable, scalable data... ...and data lakes, particularly Databricks on AWS, Azure, or Google Cloud. Databricks and SQL...
- ...three days in-office, two days virtual) About the role: As a Cloud Engineer Lead, you will lead the design, delivery, and support of secure, scalable cloud networking solutions across Azure and AWS environments. You will help drive cloud connectivity, network...
- ...Description Design, implement, and maintain data pipelines for seamless data flow. Analyze and interpret complex data sets to... ...Educational Qualifications: Bachelor’s degree in Computer Science, Engineering, or a related field. Experience Level: 2–5 years of...
- ...architecture components • Develop common test data • Configure, build, and test the... ...Computer/Information Sciences, or Electronics Engineering, or Mathematics or any equivalent... ...designing and creating CI/CD pipelines using Azure DevOps to deploy .NET applications At...
120000 - 130000 Php
...Monday-Friday, 8:30 AM-5:30 PM or 9:00 AM-6:00 PM Salary Range: ₱120,000 – ₱130,000 gross per month Qualifications: Data Engineer ~+5 years of relevant work experience with a bachelor’s degree in computer science / computer engineering / information technology...- ...Kroll is hiring a Senior Data Scientist to join its Enterprise... ...partner with business and engineering stakeholders to translate... ...scalable data and ML pipelines in Databricks using PySpark, Delta Lake, and MLflow... ...models in production on Azure (Azure AI Foundry, Azure OpenAI...
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Azure Data Engineer | Databricks & PySpark. Be the first to apply!
