Job Description:
• To be part of Data Engineering team on-site
• Required to design, develop, and manage Data Pipelines & Data warehouse.
• Assemble large, complex data sets that meet functional / non-functional business requirements.
• Designing and optimizing data storage solutions
• Monitoring data infrastructure for performance and reliability to address issues promptly.
• Documenting data pipelines, processes, and best practices for knowledge sharing.
• Knowledge of data governance principles, ensuring data quality, security, and compliance.
• Working with Bigdata platform is must have.
• Strong knowledge and experience in Data Modelling, Advanced SQL.
Skills Required:
• Build Data Pipelines, Data Analytics
• Experience working with Structured and Semi-structured data ingestion.
• Experience in Streaming data platform & analytics
• Experience working with Star/ Dimensional data modelling.
• Bigdata Stack –Scala, Hadoop, Spark, Hive, Shell Script, EMR, Step Function, Lambda, Glue, Sqoop, Flume/Kafka
• Databases – Amazon Redshift, Oracle , SQL Server