Data Engineer (Databricks)
Temporary
Xurpas Enterprise
Summary:
As a Data Engineer, you will design, develop, and maintain data solutions that facilitate data generation, collection, and processing. Your typical day will involve creating data pipelines, ensuring data quality, and implementing ETL processes to migrate and deploy data across various systems. You will collaborate with cross-functional teams to enhance data accessibility and usability, contributing to the overall data strategy of the organization.
Roles & Responsibilities:
● Expected to be an SME.
● Collaborate and manage the team to perform.
● Responsible for team decisions.
● Engage with multiple teams and contribute on key decisions.
● Provide solutions to problems for their immediate team and across multiple teams.
● Develop and optimize data pipelines to ensure efficient data flow and processing.
● Monitor and troubleshoot data quality issues, implementing corrective actions as necessary.
● Document data processes and workflows to ensure clarity and compliance with best practices
Professional & Technical Skills:
● Must have 4+ years of experience in data engineering
● Expert proficiency in Databricks Unified Data Analytics Platform
● Experience with Python (Programming Language)
● Strong understanding of data modeling and database design principles.
● Experience with ETL tools and data integration techniques.
● Familiarity with cloud platforms and services related to data engineering.
● Proficient in data warehousing concepts and practices.
Must have skills: Databricks (Unity Catalog, Delta Live Tables, Auto Loader) -Python, Pyspark -SQL -Azure Data Factory
Vacancy posted 21 days ago
Similar jobs that could be interesting for youBased on the Data Engineer (Databricks) in Taguig vacancy
- ...multiple teams. Develop and optimize data pipelines to ensure efficient data flow... ...Qualifications: Expert proficiency in Databricks Unified Data Analytics Platform. Experience... ...platforms and services related to data engineering. Proficient in data warehousing...
- ...Data Engineer (Azure Databricks & Spark) Work Setup: Onsite – Taguig, Philippines Industry: Multinational Company (MNC) Employment Type: Permanent Only for local candidates in the Philippines Arbeit Group is currently looking for an experienced Data Engineer...
- ...Key Responsibilities ● Develop and maintain data ingestion pipelines in Azure Databricks. ● Perform data transformation and preparation tasks. ● Validate... ...● 4–5 years of relevant experience in data engineering, cloud data platforms, or similar roles. ● Strong hands...
- ...Responsibilities: Develop and maintain scalable data pipelines and ETL processes using Azure Databricks and other Azure services. These processes are designed... ...with industry standards. Azure Databricks Engineers actively engage with data scientists, business analysts...
775000 $ per day
...Design, develop and maintain data solutions for data generation, collection, and processing... ..., scalable ETL/ELT pipelines using Databricks technologies including Delta Lake, Auto Loader... ..., tune, and optimize jobs using Photon engine and serverless compute, ensuring cost...- ...This position designs data products and data pipelines that are resilient to change,... ..., and cost effective. Utilizes software engineering principles to deploy and maintain fully... ...Azure Data Factory, Azure Synapse, Azure Databricks, Azure Fabric). Utilize Azure data storage...
- ...a technology consultancy building AI & data platforms to solve high-impact problems... ...ain’t data science without data. As an Engineering Consultant (Data Engineering), you will... ...Dataflow, TensorFlow, Azure Data Factory, Databricks and other similar tools. More bonus points...
- ...Requirements: # Experience: Proven experience as a Data Engineer or similar role with a focus on data pipelines, cloud infrastructure... ...(e.g., Google BigQuery, Amazon Redshift, Snowflake, Databricks) # Knowledge of data analytics and machine learning concepts...
- ...Job Description: Design, develop, and maintain data integration and ETL processes using IBM DataStage based on business and technical... ...Qualifications: At least 3–5 years of experience in Data Engineering, ETL Development, or Data Integration. Strong hands-on...
- ...Data Technical Lead plays a pivotal role within our evolving Data organization, leading the solution design, development, and strategic... ...using AWS core data services, driving innovation in Data Engineering, Governance, Integration, and Virtualization. Oversee all technical...
- ...Professional Area: Information Technology / Data & Analytics Role: Permanent... ...Data Team Manager Data Engineer Manager As a Data Engineer Manager... ...Azure Data Factory, Data Lake, Databricks, Azure SQL, and SSIS • Proven experience...
- ...better working world for all. EY-GDS Consulting – Senior Data Engineer The opportunity We’re looking for a Cloud Senior... ...Microsoft Azure Data Factory, Microsoft Synapse, Microsoft Fabric, Databricks, AWS, GCP, Snowflake, or Hadoop. • Hands-on experience...
- ...role-based access control (RBAC), secure data sharing, and data governance policies to... ...availability. • Collaborate with data engineers to integrate Snowflake with external... ...solutions. Must have: Snowflake Infrastructure Good To Have: Terraform, Databricks...
- ...The Data Architect strategically leads the creation and maintenance of an organization's master data blueprint. This role defines data structure, governance, and integration across systems, ensuring effective use for business goals and stakeholder needs. RESPONSIBILITIES...
- ...As a Data Platform Engineer, you will engage in the design and implementation of data platform solutions. Your typical day will involve collaborating with various teams to ensure seamless integration of data systems, contributing to the overall architecture, and addressing...
- • Implement request for ingestion, creation, and preparation of data sources • Develop and execute jobs to import data periodically/ (near) real-time from an external source • Setup a streaming data source to ingest data into the platform • Delivers data sourcing approach...
- ...applying best practices and the spark configuration balancing. Conversion and migration of jobs from one platform to another big data platform. Integration of a job from its ingested source transforming it into various targets like databases, extracts files, and...
- ...Job Overview We are looking for a highly skilled Senior Data Engineer to design, build, and maintain scalable data pipelines and architectures. You will play a key role in transforming raw data into actionable insights, supporting data-driven decision-making across...
- ...Implement request for ingestion, creation, and preparation of data sources • Develop and execute jobs to import data periodically/... ...structured and unstructured data types • Experience in requirements engineering, solution architecture, design, and development / deployment...
775000 $ per day
Design, develop and maintain data solutions for data generation, collection, and processing... ...systems. Summary: As a Data Engineer, you will design, develop, and maintain... ...pipelines using Apache Spark within Databricks. Build batch and streaming data workflows...775000 $ per day
Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality... ...and deploy data across systems. Summary: As a Data Engineer, you will engage in designing, developing, and maintaining comprehensive...- ...We’re looking for passionate and experienced Data Engineering Specialists who thrive on solving complex problems and unlocking the full potential of data for our customers. If you have a strong technical background in AI, machine learning, and cloud-based analytics platforms...
- ...your skills will evolve at the frontier of innovation and AI, ensuring continuous growth and development. We are looking for a Data Engineer with skills in cloud platforms (GCP/AWS/Azure), SQL and a programming language (python ideally). We look for people who...
775000 $ per day
...As a Data Engineer, you will design, develop, and maintain data solutions that facilitate data generation, collection, and processing. Your typical day will involve creating data pipelines, ensuring data quality, and implementing ETL processes to migrate and deploy data...- ...Result Areas) ~ Work with business subject matter experts and data developers to create data testing strategies ~ Develop automated... ...timeliness, integrity, and accuracy ~ Collaborate with data engineers, application developers, business owners, business subject...
- ...Work closely with the delivery teams, Google, and customer engineering teams to: Understand and use repeatable and consistent technology... ...or fixes as needed to resolve any issues relating to their data platform. Investigate issues in and maintain data models to...
- ...Summarized Purpose: We are offering an opportunity for a Mid-Level Data Engineer to design, build, test, tune, and support production data... ...as code such as Terraform or CloudFormation, plus Databricks, Snowflake, streaming, observability, or DevOps practices...Remote job
- ...We are looking for a skilled Data Engineer to design, build, and manage our data infrastructure. You will be responsible for constructing robust data pipelines that collect, process, and store data from various sources, enabling data-driven decision-making for our business...
- ~ Implement and manage tools and applications that enhance productivity and user experience on enterprise data platforms such as data access management tools, metadata management tools (including data catalogs and lineage tracking), and data quality monitoring tools...
- ...Business Solutions Manager IT Business Solutions Analyst (Data Engineer) The IT Business Solutions Analyst is a hybrid role... ...services , such as: Azure Data Factory (ADF) Azure Databricks Azure Data Lake (ADLS) Experience working with cross-functional...
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Data Engineer (Databricks). Be the first to apply!
