- Bangalore - - Indien
Data Analysis and Simulation Professional-PL08
Do you want to help create the future of healthcare? Our name, Siemens Healthineers, was selected to honor our people who dedicate their energy and passion to this cause. It reflects their pioneering spirit combined with our long history of engineering in the ever-evolving healthcare industry.
We offer you a flexible and dynamic environment with opportunities to go beyond your comfort zone in order to grow personally and professionally. Sound interesting?
Then come and join our global team as Data Engineer (f/m/d) for Big Data and Databricks based Data products development.
Your tasks and responsibilities:
- You design, build, and optimize scalable batch and streaming data pipelines using Spark 3.x with RDDs, DataFrames, Spark SQL, and Structured Streaming.
- You develop and maintain robust Lakehouse solutions based on Medallion Architecture using Parquet and Delta formats.
- You work with Databricks capabilities such as Workflows, SQL Warehouses/Endpoints, Delta Live Tables, Pipelines, Unity Catalog, and Auto Loader.
- You analyze and improve platform performance by applying knowledge of Spark internals such as Catalyst, Tungsten, and Photon.
- You design data storage and partitioning strategies considering distribution, data skew, compaction, and overall big data storage efficiency.
- You contribute to development using Python and functional programming principles and collaborate effectively with engineering teams using IntelliJ, PyCharm, Git, Azure DevOps, and GitHub Copilot.
- You implement data quality and test strategies using pytest and Great Expectations.
- You build and maintain CI/CD pipelines using Azure Pipelines YAML, ensuring continuous delivery and acceptance testing.
- You collaborate with architects, analysts, and product teams to define scalable data models and reliable data processing solutions.
- You support modern data platform evolution by contributing to best practices in data governance, storage design, and platform standardization.
To find out more about the specific business, have a look at Magnetic Resonance Imaging
Your qualifications and experience:
- You have successfully completed a university degree (Bachelor/Master's/Diploma/PhD) in Computer Science, Data Engineering, Data Science, Information Technology, or a similar field
- You have 7 to 10 years of professional experience in big data engineering, distributed data processing, and cloud-based data platform development.
- You have strong hands-on experience with Spark 3.x, including batch and streaming workloads using RDDs, DataFrames, and SQL.
- You have solid experience with Databricks, including Workflows, SQL Warehouses, DLT, Pipelines, Unity Catalog, and Auto Loader.
- You have strong knowledge of Lakehouse and Medallion Architecture, Delta/Parquet formats, partitioning, distribution, compaction, and performance tuning.
- You are proficient in Python and have a good understanding of functional programming concepts.
- You have strong SQL skills, including Spark SQL, HiveQL, and T-SQL.
- You have practical experience in CI/CD, Azure Pipelines YAML, continuous delivery, and testing practices for data platforms.
- You have experience with data validation and testing frameworks such as pytest and Great Expectations.
- It is beneficial if you also have exposure to ADF, Synapse Pipelines, Airflow, Oozie, Scala, Java, NoSQL databases, Hadoop ecosystem components, data catalog tools, or cube technologies such as SSAS/AAS/Tabular.
Your attributes and skills:
- Since the development teams are spread internationally across multiple locations, communication in English is not a problem for you.
- You are proactive in solving complex engineering problems and delivering reliable, high-quality data solutions.
- You present your ideas and technical results confidently and convincingly in cross-functional development teams.
- Personally, you are characterized by strong teamwork and cooperation skills, analytical thinking, and a structured way of working.
- You are passionate about scalable data systems, engineering excellence, and continuous improvement.
- The highest quality standards in product development are a matter of course for you.
Our global team:
Siemens Healthineers is a leading global medical technology company. 66,000 dedicated colleagues in over 70 countries are driven to shape the future of healthcare. An estimated 5 million patients across the globe benefit every day from our innovative technologies and services in the areas of diagnostic and therapeutic imaging, laboratory diagnostics and molecular medicine, as well as digital health and enterprise services.
Our culture:
Our culture embraces different perspectives, open debate, and the will to challenge convention. Change is a constant aspect of our work. We aspire to lead the change in our industry rather than just react to it. That’s why we invite you to take on new challenges, test your ideas, and celebrate success.
Check our Careers Site at Jobs & Careers - Siemens Healthineers India As an equal opportunity employer, we welcome applications from individuals with disabilities.