Big Data Engineer

This role is for one of the Weekday's clients Salary range: Rs 600000 - Rs 1900000 (ie INR 6-19 LPA)

Min Experience: 4 years JobType: full-time

We are looking for an experienced Big Data Engineer with strong expertise in real-time streaming systems and large-scale data processing. This role focuses on building high-performance, low-latency streaming pipelines using Java and modern big data technologies. You will work on complex, scalable systems in a high-velocity engineering environment. Key Responsibilities Design, build, and optimize large-scale real-time streaming data pipelines. Develop robust data ingestion and processing frameworks using Apache Spark Streaming or Hadoop streaming tools. Use Java to implement performant, production-ready distributed systems. Ensure low latency, high throughput, scalability, and fault tolerance across streaming workflows. Collaborate with product, data, and engineering teams to integrate streaming pipelines into core platforms. Diagnose, troubleshoot, and improve streaming system performance and reliability. Required Skills & Qualifications 4+ years of experience as a Big Data Engineer. Strong command of real-time streaming technologies (Kafka, Spark Streaming, Flink, or similar). Advanced proficiency in Java for core development. Hands-on experience with Hadoop or Apache Spark (streaming use cases only). Solid understanding of distributed systems and scalable architecture patterns. Experience in monitoring, tuning, and debugging streaming pipelines. Background working in high-scale or big-tech engineering environments. Nice to Have Experience with cloud ecosystems (AWS, GCP, or Azure). Knowledge of microservices, Docker, Kubernetes, or container orchestration. Familiarity with CI/CD pipelines and DevOps workflows.