Be part of a product team of 8-10 Platform Engineers that are the crux for developing and maintaining Big Data (Data Lake, Data Warehouse, and Data Integration) and Machine Learning /advanced analytics platforms on Lyve Cloud
Apply your hands-on subject matter expertise in the Architecture and administration of Big Data platforms - Data Warehouse Appliances, Hadoop (AWS EMR, HortonWorks), Data Lake Technologies (AWS S3/GCS/Other), and experience with ML and Data Science platforms (Spark ML, H2O, KNIME)
Develop and manage SPARK ETL Frameworks, Data orchestration with Airflow, and support building PRESTO queries for the key stakeholders
Design, scale and deploy Machine Learning pipelines
Collaborate with Application Architects and Business SMEs to design and develop end-to-end data pipelines and supporting infrastructure
Work with customers and business stakeholders to understand the needs and deliver on their highest priority features and requirements incrementally
Your experience includes:
Very Good technical skills with a proven and successful history working with data at scale and empowering organizations through data
Big data processing frameworks: Spark, Hadoop, Hive, Kafka, EMR
Advanced experience and hands-on architecture and administration experience on big data platforms
Data Warehouse Appliances, Hadoop (AWS EMR, HortonWorks), Data Lake Technologies (AWS S3/GCS/Other), and experience with ML and Data Science platforms (Spark ML, H2O, KNIME )
Python, Java, Scala
Architecting and developing big data solutions on cloud (AWS or Other)
DevOps, Continuous Delivery, and Agile development
Creating a culture of technical excellence by leading code and design reviews, promoting mentorship, and identifying and promoting educational opportunities for engineers
You might also have:
Strong understanding of Micro-services and container-based development using Docker and Kubernetes ecosystem is a BIG plus
Experience working in a Software Product Development environment is a BIG plus
If you are interested in applying, you can do it directly through Seagate's career site on this link:
