middot warning cancel success information linkedin google twitter facebook whatsapp user-stroke rss yacht-silhouette library user ship tel email print share lock spyglass arrow--down arrow--up arrow--left arrow--right coins city yacht warranty pin

Data Engineer

Data Engineer

  • Job ID #1188824
  • Posted: 13th Aug 2024 by Crypto.com

View all Crypto.com jobs

Summary

Role Information

As a Data Engineer at Crypto.com, you will be a valued member of our talented data engineering team. You will play a critical role in designing, building, and maintaining our robust data infrastructure. You will collaborate with data analysts, scientists, and business stakeholders to develop and implement data solutions that drive informed decision-making. By adhering to industry best practices, you will ensure the efficient and cost-effective operation of our big data platform, empowering data-driven insights and innovation across the organization.Responsibilities Design, develop, and maintain scalable data pipelines and ETL processes to efficiently extract, transform, and load high volume of data from various sources into our data lake.Develop and implement data quality checks and monitoring processes to ensure data integrity and accuracy.Leverage AWS services (e.g., EKS, EMR, S3, Glue, Lambda) to build and maintain cloud-based data infrastructure.Implement CI/CD pipelines for data engineering processes.Utilize Infrastructure as Code (IaC) tools like CloudFormation and Terraform to manage AWS resources.Stay up-to-date with the latest data engineering technologies and trends.Qualifications Bachelor's degree in Computer Science, Engineering, or a related field.Minimum of 3 years of experience as a Data Engineer.Strong proficiency in SQL, Python, and Spark.Familiarity with relational databases like PostgreSQL.Hands-on experience with AWS cloud services (EKS, EMR, S3, Athena, Lambda, etc).Experience with Kafka and real-time data processing.Experience with Tableau and knows about the setup and maintenance.Experience with data lake and lake house architecture.Experience with Databricks and Delta Lake.Proficiency in Apache Airflow for workflow orchestration.Proficiency in Kubernetes and Docker for containerization and orchestration.Experience with CI/CD pipelines and tools.Experience with Infrastructure as Code (IaC) tools like CloudFormation and Terraform.Excellent problem-solving and analytical skills.Strong attention to detail and ability to work independently.Excellent communication and collaboration skills#LI-SF1

LI-MidSenior

LI-Hybrid

Overview

  • Posted 13th Aug 2024 by Crypto.com

Interested?

Applying for this position is really simple, but you need to login first...

Login to Apply