Senior Java Engineer (Spark / Impala)
Duration : months plus (possible extension or conversion)
Location : HYBRID W / ONSITE REQUIREMENT days onsite
Jersey City, NJ
Role Summary : A senior java engineer with very strong java understanding along with subject matter expertise in big data .
The role demands for Java, any flavor of Spark, Hadoop, Linux, Bash, NoSQL, MPP Databases and Columnar file formats, CI / CD, DevOps understanding, and Containerization hands on.
Responsibilities :
- Implement application features / function using Java, Spring, Big Data technologies .
- Tune and optimize JAVA processes using various techniques such as JVM tuning like heap dumps, thread dumps and JDK dynamic monitoring .
- Tune various Big Data processes for egress / ingress optimization, monitoring, scaling .
- Participate in daily scrums and application roadmap meetings . Present ideas to improve application framework and own the execution.
- Ensure the application development standards are maintained and enhanced related to readability, testability and continuous integration.
Required Skills & Experience :
- Minimum of years of hands on development experience .
- At least years of working as a lead developer on Java backends .
- At least years of working as a Big Data Developer .
- Must have worked as an architect on multi-tier applications, has design experience, and hands on coding skills.
- Must have strong understanding of the big data framework and understands Spark, Hive, HDFS, Impala, Presto and can query and tune those systems .
- Must have understanding of latest java versions along with Spring Framework, Executor patterns, and Lambda. Deep understanding of data structures also required along with basic principles of Java.
- Must have understanding of Linux, Bash and basic scripting along basics like Unix group, host group etc.
- Must have basic understanding of RDBMS vs NO SQL vs Columnar Databases. Understanding of the file formats like Parquet, AVRO, ORC, and Iceberg also required .
- Must have basic understanding of basics of Microservice Architecture, Containerization, and Orchestration .
- Must have basic understanding of Helm, Jenkins, Bitbucket, Gradle, and Maven.
- Must have basic understanding of the telemetry specifically open telemetry, ELK, Grafana, and Prometheus.
4 hours ago