Job Description
Job Description
Job Title: Senior Hadoop Developer
Location: Jacksonville, FL (Hybrid – 2 days/week onsite)
Rate: $60–$65/hr on W-2 (No C2C)
Position Overview:
We are seeking a Senior Hadoop Developer to design, build, and support scalable big data solutions, focusing on ingestion pattern development and Spark-based orchestration. You’ll play a critical role in managing large-scale data workflows, collaborating across teams to ensure efficient data ingestion, processing, and validation.
Key Responsibilities:
- Design and implement modern ingestion patterns using Spark, ensuring scalability and performance
- Build and maintain JARs for file parsing (CSV, JSON, Avro, Parquet) and writing to Iceberg
- Integrate ingestion frameworks with Recon and CDC tools for seamless data validation and real-time processing
- Collaborate with engineers, data scientists, and business teams to align ingestion solutions with broader architecture
- Perform code reviews, maintain quality standards, and lead troubleshooting and optimization efforts
- Participate in unit testing, documentation, deployment, and lifecycle management
Must-Have Skills & Experience:
- 5+ years working within the Hadoop ecosystem (HDFS, Spark, Hive)
- Strong hands-on experience with Spark (Scala/Java)
- Proficiency in Java and/or Scala
- Experience with Apache Iceberg and data warehousing concepts
- Familiarity with Change Data Capture (CDC) tools and Recon frameworks
- Experience building and deploying JARs
- Strong understanding of ingestion patterns, data validation, and quality processes
Additional Requirements:
- Strong analytical, problem-solving, and debugging skills
- Familiarity with SDLC and Agile environments
- Excellent verbal and written communication
- Ability to work independently and within a cross-functional team
- Proficiency with tools like Git, Visio, and MS Office Suite
Preferred Technical Stack:
- Languages/Tools: Spark, Scala, Python, Java
- Frameworks: Iceberg, CDC tools, Recon Frameworks
- Platforms: Hadoop (HDFS), Hive
Education:
- Bachelor’s degree in Computer Science, Information Systems, or related field — or equivalent work experience