Data Engineer (Azure Databricks & Spark)
Full-time
PT Arbeit Infotech Indonesia
Data Engineer (Azure Databricks & Spark)
Work Setup: Onsite – Taguig, Philippines
Industry: Multinational Company (MNC)
Employment Type: Permanent
Only for local candidates in the Philippines
Arbeit Group is currently looking for an experienced Data Engineer to join a leading multinational company in Taguig, Philippines.
We're looking for candidates with proven production-level experience in Azure Databricks and Spark. Strong expertise in PySpark, SQL, Data Lakes, ETL, and data quality is essential for this role.
Key Responsibilities
- Build, develop, and maintain large-scale data pipelines using Azure Databricks and Spark
- Design and optimize ETL processes and data ingestion workflows
- Develop high-performance Python/PySpark and SQL solutions for TB-scale datasets
- Design and maintain modern Data Lake architectures
- Ensure data quality, validation, integrity, and governance across data platforms
- Utilize Azure data services for analytics, storage, and processing
- Prepare technical documentation, requirements documents, and testing artifacts
- Collaborate with business users, stakeholders, and technical teams to deliver data solutions
- Support production environments and performance optimization initiatives
- Manage source control and code versioning using Git
Requirements
- Minimum 5+ years of hands-on experience with Azure Databricks and Apache Spark
- Strong expertise in Python, PySpark, and SQL
- Proven experience handling and optimizing TB-scale data processing workloads
- Strong knowledge of Data Lake architecture and ETL frameworks
- Experience with Azure Data Analytics services
- Strong understanding of data quality, validation, and governance practices
- Experience creating technical documentation and solution designs
- Excellent communication and stakeholder management skills
- Experience with Git version control
- Ability to work effectively with cross-functional teams
Preferred Qualifications
- Experience supporting enterprise-scale production data platforms
- Strong requirements gathering and testing documentation experience
- Exposure to complex analytics and business intelligence environments
Vacancy posted 21 days ago
Similar jobs that could be interesting for youBased on the Data Engineer (Azure Databricks & Spark) in Taguig vacancy
- ...Key Responsibilities ● Develop and maintain data ingestion pipelines in Azure Databricks. ● Perform data transformation and preparation tasks. ● Validate... ...● 4–5 years of relevant experience in data engineering, cloud data platforms, or similar roles. ● Strong hands...
- ...Responsibilities: Develop and maintain scalable data pipelines and ETL processes using Azure Databricks and other Azure services. These processes are designed... ...with industry standards. Azure Databricks Engineers actively engage with data scientists, business analysts...
- ...Summary: As a Data Engineer, you will design, develop, and maintain data solutions that facilitate... ...engineering ● Expert proficiency in Databricks Unified Data Analytics Platform ●... ..., Delta Live Tables, Auto Loader) -Python, Pyspark -SQL -Azure Data Factory...
775000 $ per day
..., develop and maintain data solutions for data generation... .../ELT pipelines using Databricks technologies including... ...platform: AWS, GCP, or Azure. • Create modular dbx... ...jobs using Photon engine and serverless compute,... ...data processing (e.g., Spark, Hadoop, Hive,Kafka) 4...- ...This position designs data products and data pipelines... .... Utilizes software engineering principles to deploy and... ...using Microsoft Azure services (e.g., Azure Data... ..., Azure Synapse, Azure Databricks, Azure Fabric). Utilize... ...data technologies (e.g., Spark). Strong problem-...
- ...updated with the latest technologies and best practices in application support. Qualifications: - Expert proficiency in Microsoft Azure Data Services. (Minimum of 2 years experience) - Strong understanding of cloud computing concepts and architecture. - Experience...
775000 $ per day
...of the listed skills and experiences will help you succeed in this role. An Azure Databricks Engineer is responsible for designing, developing, implementing, and maintaining data solutions within the Azure ecosystem. This role requires close collaboration with various...- ...technology consultancy building AI & data platforms to solve high-... ...science without data. As an Engineering Consultant (Data Engineering)... ...Bonus points if you love MS Azure! ~ Experience working with... ...TensorFlow, Azure Data Factory, Databricks and other similar tools. More...
775000 $ per day
..., develop and maintain data solutions for data generation... ...Seeking a PySpark Data Engineer with at least 2 years... ...logic. Write efficient Spark SQL and Python code for... .... Preferred Skills Databricks. Snowflake, BigQuery, Synapse... ...cloud data warehouses. Azure, AWS, or GCP. Kafka or...- ...continuous growth and development. We are looking for a Data Engineer with skills in cloud platforms (GCP/AWS/Azure), SQL and a programming language (python ideally).... ...with big data technologies such as Hadoop, Spark, or Hive. Familiarity with data warehousing and...
- ...# Experience: Proven experience as a Data Engineer or similar role with a focus on data pipelines... ...with major cloud platforms (e.g., AWS, Azure, GCP) and their data-related services (... ...BigQuery, Amazon Redshift, Snowflake, Databricks) # Knowledge of data analytics and...
- ...Develop ETL jobs. Enhance an ETL job applying best practices and the spark configuration balancing. Conversion and migration of jobs from one platform to another big data platform. Integration of a job from its ingested source transforming it into various targets...
- ...Area: Information Technology / Data & Analytics Role:... ...Manager Data Engineer Manager As a Data Engineer... ...technical excellence within Azure-based data platforms, and... ...Azure Data Factory, Data Lake, Databricks, Azure SQL, and SSIS •...
- ...ingestion, creation, and preparation of data sources • Develop and execute jobs to import... ..., nifi, flume), processing technologies (Spark/Scala) and storage (e.g. HDFS, HBase,... ...data types • Experience in requirements engineering, solution architecture, design, and development...
- ...world for all. EY-GDS Consulting – Senior Data Engineer The opportunity We’re looking for a... ...pipelines using at least 2 of the following: Microsoft Azure Data Factory, Microsoft Synapse, Microsoft Fabric, Databricks, AWS, GCP, Snowflake, or Hadoop. • Hands-...
- ...Job Overview We are looking for a highly skilled Senior Data Engineer to design, build, and maintain scalable data pipelines and architectures... ...of Python and SQL Experience with cloud platforms (AWS, Azure, or GCP) Hands-on experience in ETL/ELT processes and data...
- ...documentation related to system configurations and troubleshooting procedures. Qualifications: - Expert proficiency in Microsoft Azure App Service specifically API Integrations and C# .NET - Azure Devops - Strong understanding of application security principles...
- ...Job Description: Design, develop, and maintain data integration and ETL processes using IBM DataStage based on business and technical... ...Qualifications: At least 3–5 years of experience in Data Engineering, ETL Development, or Data Integration. Strong hands-on...
- ...We’re looking for passionate and experienced Data Engineering Specialists who thrive on solving complex problems and unlocking the full potential... ..., with extensive experience in environments such as AWS, Azure, or Google Cloud. Technical Expertise: Proficient in data...
- ...We are looking for a skilled Data Engineer to design, build, and manage our data infrastructure. You will... ...-on experience with big data tools (e.g., Spark, Kafka) and cloud data services (e.g., AWS Glue/Redshift/S3, Azure Data Factory/Synapse, GCP BigQuery). Experience...
775000 $ per day
...experiences will help you succeed in this role. A Microsoft Azure AI Engineer is responsible for designing, developing, and deploying... ...Collaboration & Business Alignment Work closely with data engineers, analysts, and business stakeholders to translate business...- ...Data Technical Lead plays a pivotal role within our evolving Data organization, leading the solution design, development, and strategic... ...using AWS core data services, driving innovation in Data Engineering, Governance, Integration, and Virtualization. Oversee all technical...
- ...role-based access control (RBAC), secure data sharing, and data governance policies to... ...availability. • Collaborate with data engineers to integrate Snowflake with external... ...solutions. Must have: Snowflake Infrastructure Good To Have: Terraform, Databricks...
- ...The Data Architect strategically leads the creation and maintenance of an organization's master data blueprint. This role defines data structure, governance, and integration across systems, ensuring effective use for business goals and stakeholder needs. RESPONSIBILITIES...
- ...As a Data Platform Engineer, you will engage in the design and implementation of data platform solutions. Your typical day will involve collaborating with various teams to ensure seamless integration of data systems, contributing to the overall architecture, and addressing...
- • Implement request for ingestion, creation, and preparation of data sources • Develop and execute jobs to import data periodically/ (near) real-time from an external source • Setup a streaming data source to ingest data into the platform • Delivers data sourcing approach...
775000 $ per day
Design, develop and maintain data solutions for data... ...systems. Cognitive Engineering Job Summary: Modern Data... ...using cloud-native services (Azure, AWS, GCP) including lakehouses... ...adoption of modern data stacks: Spark, Databricks, Snowflake, Synapse,...- ...Software Engineering - Application Lead | Microsoft Azure DevOps Qualifications Bachelor's Degree in any relevant field At least 3 years of experience in Microsoft Azure DevOps. Experience with ASP.NET MVC. Strong understanding of cloud computing principles...
775000 $ per day
Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality... ...and deploy data across systems. Summary: As a Data Engineer, you will engage in designing, developing, and maintaining comprehensive...775000 $ per day
...As a Data Engineer, you will design, develop, and maintain data solutions that facilitate data generation, collection, and processing. Your typical day will involve creating data pipelines, ensuring data quality, and implementing ETL processes to migrate and deploy data...
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Data Engineer (Azure Databricks & Spark). Be the first to apply!
