Kafka, Redis And Hadoop Developer Job at PB consulting, Addison, TX

OUhSbGExbXZ6cTkxejFlRXdVbmxFV3N6eHc9PQ==
  • PB consulting
  • Addison, TX

Job Description

We are seeking an experienced Kafka, Redis, and Hadoop Developer with strong expertise in big data technologies, real-time data processing, and distributed systems. The ideal candidate will have hands-on experience with Apache Kafka, Redis, Hadoop, PySpark, and Python to design, develop, and maintain scalable, high-performance data processing solutions.

Key Responsibilities

  • Design, develop, and maintain real-time data streaming applications using Apache Kafka, including KStreams and KTable.
  • Develop scalable big data processing solutions using Hadoop and PySpark.
  • Implement and optimize data storage and retrieval using NoSQL databases such as Redis, MongoDB, and HBase.
  • Develop data processing and integration pipelines using Python, Scala, Java, and Bash/Shell scripting.
  • Build reliable distributed systems with efficient data partitioning, fault tolerance, and high availability.
  • Work with streaming technologies such as Apache Flink and Apache Storm.
  • Leverage cloud platforms such as AWS, Azure, or GCP for big data processing and deployment.
  • Apply data security and integration best practices, including Kerberos authentication.
  • Perform data analysis and support predictive modeling using statistical techniques and machine learning algorithms.
  • Develop and maintain visual analytics and reporting solutions using Tableau.
  • Troubleshoot performance issues, optimize data pipelines, and ensure data quality and reliability.
  • Collaborate with cross-functional teams to deliver business-critical data solutions.

Required Skills and Qualifications

  • Bachelor's or Master's degree in Science, Engineering, Computer Science, or a related field.
  • 9–12 years of overall professional experience in software development and data engineering.
  • Strong hands-on experience with Apache Kafka, Redis, Hadoop, and PySpark.
  • Proficiency in Python and familiarity with Scala, Java, and Bash/Shell scripting.
  • Strong understanding of real-time streaming, distributed computing, and big data architecture.
  • Experience with NoSQL databases and cloud-based data processing platforms.
  • Knowledge of data security, data integration, and visualization tools such as Tableau.
  • Excellent problem-solving, analytical, and communication skills.

Job Tags

Full time

Similar Jobs

US Government Jobs

ARCHIVIST Job at US Government Jobs

 ...Archivist Position You will serve as an Archivist in the Archives Branch of NAVAL HISTORY AND HERITAGE COMMAND. This announcement uses the NDAA non-competitive authority to recruit and appoint qualified candidates to positions in the competitive service for a period... 

Methodist Health System

Emergency Department Registered Nurse Job at Methodist Health System

Methodist Health System seeks a compassionate Registered Nurse for our fast-paced Emergency Department. The RN delivers high-quality, evidence-based care to diverse patient populations, performing triage, assessments, medication administration, and critical interventions... 

Performance Foodservice

Delivery Driver Job at Performance Foodservice

 ...License Required ~ Pay: Once fully trained, drivers average $100,000 a year annually!~...  ...person who has worked for a Performance Food Group (PFG) owned company within the last...  ...Position Purpose: Food and food service delivery drivers fulfill a critical role in the... 

Peak Performance Team

Finance Manager - Hanford, Ca Job at Peak Performance Team

 ...Job Description Job Description Finance and Insurance (F&I) Manager Automotive This is an incredible opportunity for an experienced professional who is excited by automotive F&I and passionate about customer service. We are currently seeking an F&I manager to... 

Mandarin Oriental Hotel Group

Security Supervisor Job at Mandarin Oriental Hotel Group

 ...Security Supervisor Mandarin Oriental New York is looking for a Security Supervisor to join our Security team. Are you a master...  ...invite you to become a fan of the exceptional. Mandarin Oriental Hotel Group is the award-winning owner and operator of some of the...