Hadoop Developer Job at Neshent Technologies, Charlotte, NC

OVhKcmJWK3F5cWwxd1ZPTXhFamdFbTR6d0E9PQ==
  • Neshent Technologies
  • Charlotte, NC

Job Description

We are looking for an experienced Senior Hadoop Developer with strong expertise in Big Data Engineering, Hadoop ecosystem, PySpark, Python, and Apache Kafka. The candidate will be responsible for designing and developing scalable data platforms, distributed data processing solutions, ETL pipelines, and real-time streaming applications.

The role requires strong technical and architectural capabilities, along with experience in data engineering, system integration, performance optimization, and cloud-native technologies.

Roles & Responsibilities
  • Design and develop scalable Big Data solutions using Hadoop, HDFS, Hive, Spark, PySpark, and Python.
  • Architect and implement end-to-end data ingestion, transformation, and processing pipelines.
  • Develop and optimize ETL workflows for large-scale batch and real-time data processing.
  • Implement Apache Kafka-based streaming solutions and event-driven data architectures.
  • Design high-performance, scalable, secure, and reliable data platforms aligned with enterprise standards.
  • Work on system integration, microservices, API design, and cloud-native architecture.
  • Optimize distributed data processing jobs and troubleshoot performance-related issues.
  • Collaborate with Product Owners, Business Analysts, DevOps teams, and cross-functional engineering teams.
  • Participate in Agile ceremonies, technical design discussions, code reviews, and solution architecture reviews.
  • Mentor junior developers and data engineers and drive engineering best practices.
  • Evaluate emerging technologies and recommend improvements to existing data platforms.
  • Support CI/CD implementation, containerization, and cloud-based data engineering initiatives.
Required Technical Skills
  • Minimum 10 years of experience in Big Data Development / Data Engineering.
  • Strong hands-on experience with the Hadoop ecosystem:
    • HDFS
    • Hive
    • Apache Spark
    • PySpark
  • Advanced programming experience in Python.
  • Hands-on experience with Apache Kafka and real-time data streaming.
  • Strong experience in ETL development, data ingestion, transformation, and distributed data processing.
  • Experience designing scalable and high-performance data architectures.
  • Strong understanding of data pipelines, event-driven architecture, and system integration.
Preferred Skills
  • Knowledge of microservices architecture and API design.
  • Experience with CI/CD pipelines and DevOps practices.
  • Exposure to Docker and Kubernetes.
  • Experience with cloud platforms such as AWS, Azure, or GCP.
  • Understanding of cloud-native architecture and enterprise security standards.
Required Qualifications
  • 9–12 years of relevant IT experience, with a minimum of 10 years preferred.
  • Strong analytical and problem-solving skills.
  • Excellent communication and technical leadership abilities.
  • Experience mentoring junior developers and collaborating with global teams.
  • Ability to work in a fast-paced Agile development environment.

Job Tags

Full time

Similar Jobs

notifyMD

Call Center Representative Job at notifyMD

 ...Job Description Job Description OvernightCall Center Representative Location: Chesapeake, VA At notifyMD, you will provide professional and comprehensive support to a diverse range of companies that include medical offices, apartment complexes, professional... 

LocumTenens.com

Locum Physician (MD/DO) - Oncology - Radiation in Astoria, OR Job at LocumTenens.com

 ...Doctor of Medicine | Oncology - Radiation Location: Astoria, OR Employer: LocumTenens.com Pay: Competitive weekly pay (inquire for details) Start Date: ASAP About the Position This Job at a Glance Job Reference Id: ORD-224299-MD-OR Title... 

Horizon House Inc

Certified Nursing Assistant (CNA) - Part Time Job at Horizon House Inc

 ...compensation and a comprehensive benefit package including medical and dental, (9) nine paid holidays and generous time off, tax shelter annuity, retirement saving plan, tuition reimbursement and the opportunity for advancement. To be considered for this position... 

General Dynamics

FPGA Intern Engineer Job at General Dynamics

 ...Responsibilities for this Position FPGA Intern Engineer ID: 2026-75125US-VA-Manassas Required Clearance: Secret Posted Date: 9/28/2026 Category: Engineering-Systems Employment Type: Intern Hiring Company: General Dynamics Mission Systems, Inc. Basic... 

Jobgether

Customer Service Administrator Job at Jobgether

 ...all applications and next steps. Our partner is looking for a Customer Service Administrator based in United States. As a Customer Service...  ...in customer service, call handling, appointment scheduling, virtual assistance, or administrative support. - Excellent written and...