Data Engineer
Data Engineer
India - Hyderabad Apply NowWhat you will do
At Amgen, we work to serve patients by discovering, developing, manufacturing, and delivering innovative medicines. In this role, you will help turn data into a trusted resource for the teams and decisions that support this work. You will design, build, and maintain data solutions that make information accessible, reliable, and useful for analysis and decision-making.
You will work with large and complex datasets, develop data pipelines and integrations, support data governance, and collaborate with teams across the business. The ideal candidate brings strong data engineering skills and a solid understanding of data architecture, ETL processes, and cloud data platforms.
Roles and responsibilities
- Design, develop, and maintain data solutions for data generation, collection, processing, and analysis.
- Contribute to the design and development of data pipelines, ETL/ELT processes, and data integration solutions.
- Build pipelines that move and transform data across systems while maintaining data quality and reliability.
- Develop automated workflows for data ingestion, transformation, and deployment using Databricks Jobs, notebooks, or similar orchestration tools.
- Work with structured and unstructured data from sources such as SQL databases, APIs, and cloud storage.
- Monitor and troubleshoot pipelines, and apply performance optimization techniques such as Spark tuning, caching, and partitioning.
- Develop and maintain data models, data dictionaries, and technical documentation to support data accuracy and consistent use.
- Apply data governance, security, and privacy practices when designing and maintaining data solutions.
- Partner with Data Architects, Business SMEs, Data Scientists, product teams, and other stakeholders to understand requirements and deliver solutions.
- Take ownership of assigned data engineering work from design through deployment, including scope, estimates, timelines, risks, and ongoing support.
- Identify and resolve complex data challenges; follow best practices for coding, testing, and reusable components.
- Participate in sprint planning and communicate technical progress, estimates, risks, and dependencies.
- Evaluate tools and approaches that could improve the performance, scalability, or reliability of data solutions.
- Collaborate effectively with colleagues across teams, regions, and time zones.
What we expect of you
We are all different, yet we all use our unique contributions to serve patients.
Basic qualifications
- Bachelor’s or master’s degree in Computer Science, Information Technology, or a related field.
- 4-6 years of relevant experience in data engineering, computer science, IT, or a related field.
- Hands-on experience with Databricks and Apache Spark, including PySpark or Spark SQL.
- Proficiency in SQL and experience working with large, complex datasets.
- Experience designing, building, or supporting data pipelines and ETL/ELT processes.
- Experience with workflow orchestration and performance tuning for big data processing.
- Understanding of data governance frameworks, data quality practices, and secure data handling.
- Strong critical-thinking and problem-solving skills.
- Strong communication and collaboration skills, including the ability to explain technical concepts to different audiences.
Preferred qualifications
- Experience with cloud platforms, especially AWS, and services such as SageMaker.
- Experience with Python or R and packages used for data processing or machine learning.
- Understanding of data modeling, data warehousing, and data integration concepts.
- Experience with data visualization tools.
- Familiarity with data protection regulations and compliance requirements, such as GDPR or CCPA.
- Experience implementing pipeline orchestration and monitoring with Databricks Jobs, Apache Airflow, or similar tools.
- Exposure to AI technologies such as large language models, retrieval-augmented generation, vector search, tokenization, or prompt engineering.
- Familiarity with AI-assisted development tools such as OpenAI Codex, GitHub Copilot, or equivalent platforms.
- Databricks or cloud data engineering certifications.