Data Engineer - Python and R

Share only 2 profiles

Local candidates only

LinkedIn is must

Data Engineer On Site in Boca Raton, FL.

Requirements:

• 5+ years of experience with programming languages such as Python, Java, R
• 5+ years data engineering experience with ETL, SQL, NoSQL Apache Hadoop
• Bachelor’s degree required
  
  

Preferred:

• Experience with structured and unstructured data and using ML to solve problems with unstructured data sets and relational database
  
  

Data Engineer - Python and R

Job Description: We are seeking a talented and experienced Senior Data Pipeline Developer to join our dynamic team. The successful candidate will be responsible for designing, developing, and maintaining robust data pipelines for our eCommerce clients using Python and R. The ideal candidate will have a strong background in data engineering, with expertise in building scalable and efficient data processing solutions.

Responsibilities:

• Design, develop, and deploy data pipelines to extract, transform, and load (ETL) large volumes of data from various sources.
• Collaborate with cross-functional teams to gather requirements and understand business needs for data processing and analysis.
• Architect scalable and efficient data processing solutions that meet performance, reliability, and scalability requirements.
• Implement data quality checks and validation procedures to ensure the integrity and accuracy of data throughout the pipeline.
• Optimize data pipelines for performance, efficiency, and cost-effectiveness, utilizing best practices and modern technologies.
• Troubleshoot and debug issues with data pipelines, identifying root causes and implementing solutions in a timely manner.
• Stay updated on emerging technologies and trends in data engineering and apply them to improve existing processes and methodologies.
  
  

Requirements:

• Bachelor's or Master's degree in Computer Science, Engineering, or a related field.
• 5+ years of experience in software development, with a focus on building data pipelines and ETL processes.
• Proficiency in Python and R programming languages, with hands-on experience in developing data processing scripts and workflows.
• Strong understanding of data engineering concepts, including data modeling, schema design, and optimization techniques.
• Experience working with big data technologies such as Apache Spark, Hadoop, or similar frameworks.
• Knowledge of database systems and NoSQL, with the ability to write complex queries for data extraction and manipulation.
• Excellent problem-solving skills and attention to detail, with a focus on delivering high-quality solutions in a fast-paced environment.
• Strong communication and interpersonal skills, with the ability to collaborate effectively with cross-functional teams and stakeholders.
  
  

Preferred Qualifications:

• Experience working in the eCommerce industry or related domains.
• Familiarity with cloud platforms such as AWS, Google Cloud Platform, or Azure.
• Knowledge of distributed computing and parallel processing techniques.
• Experience with data visualization tools such as Tableau, Power BI, or matplotlib/seaborn.
• Certifications in relevant technologies or methodologies (e.g., AWS Certified Big Data Specialty, Google Professional Data Engineer, etc.).