> Experience building and optimizing ‘big data’ data pipelines, architectures and data sets.
> 1 year contract (renewable)
> Global Pharmaceutical MNC, at West
Create and maintain optimal data pipeline architecture, assemble large, complex data sets that meet functional / non-functional business requirements.
Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.
Apply architecture and system design theories and principles, perform complex work in research, design and development of new or existing products, tools and processes required for the operation, maintenance and testing of products.
Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL and AWS Azure ‘big data’ technologies.
Build analytics tools that utilize the data pipeline to provide actionable insights into customer acquisition, operational efficiency and other key business performance metrics.
Embed DevOps processes in delivery – ensure usability is front of mind in Tech Product development.
Keep data separated and secure across national boundaries through multiple data centers and Azure platforms.
Create data tools for analytics and data scientist team members that assist them in building and optimizing our product into an innovative industry leader.
Work with data and analytics experts to strive for greater functionality in our data systems.
Experience with big data tools: Hadoop, Hive, Kafka, ELK (ECE), etc.
Experience with relational SQL and NoSQL databases such as MSSQL, Postgres, Cassandra, MongoDB, TimeScaleDB
Experience with mission-critical production development in following languages and frameworks a plus
Languages: Java, Python, Web (HTML5, CSS, JS, XML, TS), Golang, VBA
Frameworks: Angular, .NET, SciKitLearn, SciPy, NumPy, etc
Experience with data pipeline and workflow management tools: Airflow, Apache NiFi, Redis, Microsoft Office, Sharepoint, etc
Experience with Azure cloud services: Blob Storage, Power BI, Logic Apps, Flow Apps, MSSQL Data Warehouse
Experience with stream-processing systems: Storm, Spark, etc.
Experience in Microsoft PowerBI implementation (Custom components, DAX, M)
To apply, please visit www.gmprecruit.com and search for Job Reference: 15693
To learn more about this opportunity, please contact Yi Fang at email@example.com
We regret that only shortlisted candidates will be notified.
GMP Technologies (S) Pte Ltd | EA Licence: 11C3793 | EA Personnel: Law Yi Fang | Registration No: R1113115