Data Engineer (Azure Databricks & Spark)
Full-time
PT Arbeit Infotech Indonesia
Data Engineer (Azure Databricks & Spark)
Work Setup: Onsite – Taguig, Philippines
Industry: Multinational Company (MNC)
Employment Type: Permanent
Only for local candidates in the Philippines
Arbeit Group is currently looking for an experienced Data Engineer to join a leading multinational company in Taguig, Philippines.
We're looking for candidates with proven production-level experience in Azure Databricks and Spark. Strong expertise in PySpark, SQL, Data Lakes, ETL, and data quality is essential for this role.
Key Responsibilities
- Build, develop, and maintain large-scale data pipelines using Azure Databricks and Spark
- Design and optimize ETL processes and data ingestion workflows
- Develop high-performance Python/PySpark and SQL solutions for TB-scale datasets
- Design and maintain modern Data Lake architectures
- Ensure data quality, validation, integrity, and governance across data platforms
- Utilize Azure data services for analytics, storage, and processing
- Prepare technical documentation, requirements documents, and testing artifacts
- Collaborate with business users, stakeholders, and technical teams to deliver data solutions
- Support production environments and performance optimization initiatives
- Manage source control and code versioning using Git
Requirements
- Minimum 5+ years of hands-on experience with Azure Databricks and Apache Spark
- Strong expertise in Python, PySpark, and SQL
- Proven experience handling and optimizing TB-scale data processing workloads
- Strong knowledge of Data Lake architecture and ETL frameworks
- Experience with Azure Data Analytics services
- Strong understanding of data quality, validation, and governance practices
- Experience creating technical documentation and solution designs
- Excellent communication and stakeholder management skills
- Experience with Git version control
- Ability to work effectively with cross-functional teams
Preferred Qualifications
- Experience supporting enterprise-scale production data platforms
- Strong requirements gathering and testing documentation experience
- Exposure to complex analytics and business intelligence environments
Vacancy posted 17 hours ago
Similar jobs that could be interesting for youBased on the Data Engineer (Azure Databricks & Spark) in Taguig vacancy
- ...Key Responsibilities ● Develop and maintain data ingestion pipelines in Azure Databricks. ● Perform data transformation and preparation tasks. ● Validate... ...● 4–5 years of relevant experience in data engineering, cloud data platforms, or similar roles. ● Strong hands...
- ...Responsibilities: Develop and maintain scalable data pipelines and ETL processes using Azure Databricks and other Azure services. These processes are designed... ...with industry standards. Azure Databricks Engineers actively engage with data scientists, business analysts...
- ...Hiring: Azure Data Engineer Location: Quezon City, Metro Manila Work Setup: Hybrid (2 WFH... ...Azure Data Factory, Azure Synapse, Azure Databricks, Azure Blob Storage, and Azure Data... ...development experience * Experience with Spark and PySpark * Knowledge of CI/CD,...
- ...Summary: As a Data Engineer, you will design, develop, and maintain data solutions that facilitate... ...engineering ● Expert proficiency in Databricks Unified Data Analytics Platform ●... ..., Delta Live Tables, Auto Loader) -Python, Pyspark -SQL -Azure Data Factory...
775000 $ per day
..., develop and maintain data solutions for data generation... .../ELT pipelines using Databricks technologies including... ...platform: AWS, GCP, or Azure. Create modular dbx... ...jobs using Photon engine and serverless compute,... ...data processing (e.g., Spark, Hadoop, Hive,Kafka)...- ...This position designs data products and data pipelines... .... Utilizes software engineering principles to deploy and... ...using Microsoft Azure services (e.g., Azure Data... ..., Azure Synapse, Azure Databricks, Azure Fabric). Utilize... ...data technologies (e.g., Spark). Strong problem-...
- ...updated with the latest technologies and best practices in application support. Qualifications: - Expert proficiency in Microsoft Azure Data Services. (Minimum of 2 years experience) - Strong understanding of cloud computing concepts and architecture. - Experience...
775000 $ per day
...of the listed skills and experiences will help you succeed in this role. An Azure Databricks Engineer is responsible for designing, developing, implementing, and maintaining data solutions within the Azure ecosystem. This role requires close collaboration with various...- ...continuous growth and development. We are looking for a Data Engineer with skills in cloud platforms (GCP/AWS/Azure), SQL and a programming language (python ideally).... ...with big data technologies such as Hadoop, Spark, or Hive. Familiarity with data warehousing and...
- ...# Experience: Proven experience as a Data Engineer or similar role with a focus on data pipelines... ...with major cloud platforms (e.g., AWS, Azure, GCP) and their data-related services (... ...BigQuery, Amazon Redshift, Snowflake, Databricks) # Knowledge of data analytics and...
- ...technology consultancy building AI & data platforms to solve high-... ...science without data. As an Engineering Consultant (Data Engineering)... ...Bonus points if you love MS Azure! ~ Experience working with... ...TensorFlow, Azure Data Factory, Databricks and other similar tools. More...
775000 $ per day
..., develop and maintain data solutions for data generation... ...Seeking a PySpark Data Engineer with at least 2 years... ...logic. Write efficient Spark SQL and Python code for... .... Preferred Skills Databricks. Snowflake, BigQuery, Synapse... ...cloud data warehouses. Azure, AWS, or GCP. Kafka or...- ...Area: Information Technology / Data & Analytics Role:... ...Manager Data Engineer Manager As a Data Engineer... ...technical excellence within Azure-based data platforms, and... ...Azure Data Factory, Data Lake, Databricks, Azure SQL, and SSIS •...
- ...Develop ETL jobs. Enhance an ETL job applying best practices and the spark configuration balancing. Conversion and migration of jobs from one platform to another big data platform. Integration of a job from its ingested source transforming it into various targets...
- ...ingestion, creation, and preparation of data sources • Develop and execute jobs to import... ..., nifi, flume), processing technologies (Spark/Scala) and storage (e.g. HDFS, HBase,... ...data types • Experience in requirements engineering, solution architecture, design, and development...
- ...Job Overview We are looking for a highly skilled Senior Data Engineer to design, build, and maintain scalable data pipelines and architectures... ...of Python and SQL Experience with cloud platforms (AWS, Azure, or GCP) Hands-on experience in ETL/ELT processes and data...
- ...Job Description: Design, develop, and maintain data integration and ETL processes using IBM DataStage based on business and technical... ...Qualifications: At least 3–5 years of experience in Data Engineering, ETL Development, or Data Integration. Strong hands-on...
- ...We’re looking for passionate and experienced Data Engineering Specialists who thrive on solving complex problems and unlocking the full potential... ..., with extensive experience in environments such as AWS, Azure, or Google Cloud. Technical Expertise: Proficient in data...
- ...world for all. EY-GDS Consulting – Senior Data Engineer The opportunity We’re looking for a... ...pipelines using at least 2 of the following: Microsoft Azure Data Factory, Microsoft Synapse, Microsoft Fabric, Databricks, AWS, GCP, Snowflake, or Hadoop. • Hands-...
- ...role-based access control (RBAC), secure data sharing, and data governance policies to... ...availability. • Collaborate with data engineers to integrate Snowflake with external... ...solutions. Must have: Snowflake Infrastructure Good To Have: Terraform, Databricks...
- ...documentation related to system configurations and troubleshooting procedures. Qualifications: - Expert proficiency in Microsoft Azure App Service specifically API Integrations and C# .NET - Azure Devops - Strong understanding of application security principles...
- ...As a Data Platform Engineer, you will engage in the design and implementation of data platform solutions. Your typical day will involve collaborating with various teams to ensure seamless integration of data systems, contributing to the overall architecture, and addressing...
- • Implement request for ingestion, creation, and preparation of data sources • Develop and execute jobs to import data periodically/ (near) real-time from an external source • Setup a streaming data source to ingest data into the platform • Delivers data sourcing approach...
- ...Data Technical Lead plays a pivotal role within our evolving Data organization, leading the solution design, development, and strategic... ...using AWS core data services, driving innovation in Data Engineering, Governance, Integration, and Virtualization. Oversee all technical...
- ...We are looking for a skilled Data Engineer to design, build, and manage our data infrastructure. You will... ...-on experience with big data tools (e.g., Spark, Kafka) and cloud data services (e.g., AWS Glue/Redshift/S3, Azure Data Factory/Synapse, GCP BigQuery). Experience...
- ...Job Overview Our client is seeking an Azure AI Engineer to design, develop, deploy, and support enterprise-grade AI solutions that address... .... Working closely with cross-functional engineering, data, and product teams, the successful candidate will help deliver...
775000 $ per day
...experiences will help you succeed in this role. A Microsoft Azure AI Engineer is responsible for designing, developing, and deploying... ...Collaboration & Business Alignment Work closely with data engineers, analysts, and business stakeholders to translate business...- ...The Data Architect strategically leads the creation and maintenance of an organization's master data blueprint. This role defines data structure, governance, and integration across systems, ensuring effective use for business goals and stakeholder needs. RESPONSIBILITIES...
- ...IT Business Solutions Analyst (Data Engineer) The IT Business Solutions Analyst... ...pipelines and ETL/ELT processes using Azure technologies Support data ingestion... ...: Azure Data Factory (ADF) Azure Databricks Azure Data Lake (ADLS) Experience...
- ...communities we live in. Our Team The Data and Analytics team are a progressive... ...As a Senior Data & Analytics Consultant/Engineer, you will lead the technical delivery of... ...modern data platforms Advanced skills in Azure, Fabric, and Snowflake pipelines, with experience...
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Data Engineer (Azure Databricks & Spark). Be the first to apply!
