Grazing Minds

Career Genie For Professionals

Select Your Favourite
Category And Start Learning.

Big Data Engineer

Job Category: IT
Job Type: Full Time
Job Location: Navi Mumbai

At Grazing Minds, work is more than a job – it’s a passion: To build. To innovate. To be a leader. To consult.
Not just to do something better, but to attempt things that have never been done. If you have the fire to learn and lead in this new era of technology and solve some of the world’s most challenging problems – we should talk.

KEY RESPONSIBILITIES

  • Software Engineering:
    • Write clean, concise, maintainable big data jobs
    • Comfortable authoring code on a distributed compute platform
    • Author clear and purposeful stories
    • Drive automation at every step from code to deploy
    • Problem Solving Capabilities using Data Structures and Algorithms
    • Promote best practices in development and operations
    • Ability to work in Agile environment
  • Testing:
    • Author unit, integration, and end-to-end tests
    • Perform load, scale, and performance tests
  • Architecture:
    • Understand and critique the overall platform architecture
    • Implement reusable algorithmic code
    • Offer constructive feedback on design documents from other team members
    • Bring a strong focus on innovation and the use of open source technologies

QUALIFICATIONS

  • Technologies
    • Cloud: AWS
    • Workflow Orchestration: Airflow, Oozie
    • Containerization: Docker
    • Container Orchestration: Kubernetes, Swarm
    • Programming Languages: Scala(Preferable), Python(Preferable)
    • Big Data Frameworks: Spark, Hive, Flink, Hadoop, Map-Reduce
    • Persistence: PostgreSQL, MySQ

• Responsible for assessing feasibility of migrating customer solutions and/or integrating with 3rd party systems both Microsoft and non-Microsoft platforms
• Designing and developing Data Pipelines for Data Ingestion or Transformation using Python (PySpark)/Spark SQL
• Work with version control GitHub and CI/CD pipelines using Azure DevOps

Required Technical and Professional Expertise:
• Total Years of Experience 5+ years in IT industry
• 2+ years current and deep experience with Azure Data platform implementation.
• Proven experience managing projects through the entire project lifecycle.
• Relevant years of experience 2+ years in Azure Data Factory, Azure Data Lake, Azure DevOps, Azure DataBricks, AzureSQL

Willing to work in shift timings 2PM to 11PM
Job Location : Navi Mumbai
Notice Period : 60 days
Salary: INR 13-15 Lpa

Apply for this position

Allowed Type(s): .pdf, .doc, .docx