Big Data Developer: Visa sponsorship

Elite IT Consultancies Ltd

#### *Job Summary:*

The Big Data Developer is responsible for designing, developing, and maintaining large-scale data processing systems. This role involves working with big data technologies to manage and analyze vast amounts of data, ensuring efficient data storage, retrieval, and processing. The Big Data Developer will collaborate with data scientists, analysts, and other IT professionals to build robust data solutions that support business objectives.

#### *Key Responsibilities:*

– *Data Pipeline Development:*

– Design, develop, and implement scalable and efficient data pipelines.

– Integrate data from various sources, including databases, APIs, and streaming platforms.

– Ensure data is processed and transformed accurately and efficiently.

– *Big Data Platform Management:*

– Manage and optimize big data platforms such as Hadoop, Spark, and related technologies.

– Monitor and troubleshoot performance issues within big data environments.

– Implement data storage solutions such as HDFS, NoSQL databases, and cloud storage services.

– *Data Processing and Analysis:*

– Develop and maintain ETL processes to ensure data quality and consistency.

– Implement real-time data processing solutions using stream processing frameworks like Apache Kafka or Flink.

– Perform complex data analysis to support business needs and drive decision-making.

– *Collaboration and Integration:*

– Work closely with data scientists and analysts to understand data requirements and deliver appropriate solutions.

– Collaborate with other IT teams to integrate big data solutions with existing systems.

– Ensure data security and compliance with relevant data protection regulations.

– *Documentation and Best Practices:*

– Document data workflows, pipelines, and processes clearly and comprehensively.

– Follow industry best practices for coding, testing, and deploying big data solutions.

– Stay updated with the latest trends and advancements in big data technologies.

#### *Qualifications:*

– *Education:*

– Bachelor’s degree in Computer Science, Information Technology, Data Engineering, or a related field. Master’s degree preferred.

– *Experience:*

– Minimum of 3-5 years of experience in big data development and engineering.

– Proven experience with big data technologies such as Hadoop, Spark, Kafka, and NoSQL databases.

– Experience with cloud platforms (e.g., AWS, Azure, Google Cloud) for big data solutions.

– *Skills:*

– Strong programming skills in languages such as Java, Scala, or Python.

– Proficiency in SQL and experience with database management.

– Knowledge of data modeling, data warehousing, and ETL processes.

– Excellent problem-solving and analytical skills.

– Strong communication and teamwork abilities.

– *Certifications (Preferred):*

– Relevant certifications such as Cloudera Certified Professional (CCP), Hortonworks Data Platform (HDP) Certified Developer, or AWS Certified Big Data – Specialty.

#### *Competencies:*

– *Technical Proficiency:*

– Deep understanding of distributed computing and big data architectures.

– Familiarity with data serialization formats like Avro, Parquet, or ORC.

– *Business Acumen:*

– Ability to translate business requirements into technical specifications.

– Understanding of business intelligence and data analytics concepts.

– *Project Management:*

– Ability to manage multiple tasks and projects simultaneously.

– Strong organizational skills and attention to detail.

– *Interpersonal Skills:*

– Ability to collaborate effectively with cross-functional teams.

– Strong client-facing and communication skills.

*Application Process:*

Interested candidates should submit their resume, cover letter, and references to

Please include “Big Data Developer Application” in the subject line.

*Equal Opportunity Employer:*

Elite IT Consultancies is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, or disability status.

This job description is intended to outline the general responsibilities and qualifications for the Big Data Developer position. It is not exhaustive and may be subject to change based on the company’s needs.

Job Types: Full-time, Permanent

Pay: £45,000.00-£50,000.00 per year


  • Additional leave
  • Childcare
  • Company pension
  • Employee discount
  • Employee mentoring programme
  • Free parking
  • Health & wellbeing programme
  • Life insurance
  • On-site parking
  • Private medical insurance
  • Relocation assistance
  • Sick pay
  • UK visa sponsorship
  • Work from home


  • 8 hour shift
  • Day shift
  • Holidays
  • Monday to Friday

Work Location: Hybrid remote in Reading

Expected start date: 15/07/2024

To apply for this job please visit