Data Engineer

Job Description

We are ideally looking for 2-5 years of experience, in as much of the tech stack as possible. If you love startups or have experience working with startups, we would be a match made in tech heaven.

Job Responsibilities


  • Build, automate, and maintain reliable, and efficient data pipelines and workflows

  • Develop and maintain data models and database schemas that support our data-driven applications

  • Build and maintain ETL processes to extract, transform, and load data from various sources into our data warehouse

  • Ensure data quality and integrity by implementing data validation and cleansing routines

  • Optimize data storage and retrieval for performance and cost

  • Develop and maintain data documentation and metadata

  • Collaborate with data scientists, software engineers, and other stakeholders to understand data requirements and ensure that our data architecture meets those needs

  • Participate in code reviews, testing, and deployment processes

  • Initially, you will be working with the backend engineering team to execute ongoing/planned migrations and eventually move on to building pipelines to automate the data ingestion/migration processes

Job Requirements


  • Strong programming skills in at least one of the major languages (e.g.Python (preferred), Java, Scala

  • Hands-on experience in batch/real-time data integration & processing

  • Strong proficiency in SQL and experience with at least one of the major database systems (e.g. PostgreSQL, MySQL, Oracle, SQL Server)

  • Experience in handling asynchronous tasks using Celery

  • Experience/familiarity with ETL tools and frameworks (e.g. Apache Airflow, Apache NiFi, Talend, Informatica)

  • Familiarity with big data technologies and platforms (e.g. Hadoop, Spark, Kafka) cloud platforms such as AWS, Azure, or GCP and associated services like S3, EC2, Redshift, Dataflow or BigQuery

  • Experience with version control systems (e.g. Git)

  • Good problem-solving skills, communication and interpersonal skills and ability to work independently as well as in a team

  • Ability to thrive in a dynamic and fast-changing environment. Results-oriented, proactive, and ownership-driven attitude

Good to have:


  • Experience in creating REST APIs using Django Rest Framework, in building web applications and services using Django

  • Proficiency in a relational database such as PostgreSQL

  • Experience in building solutions using ElasticSearch is a big plus

  • Exposure to a NoSQL database such as MongoDB is a plus

  • Hands-on exposure to AWS and understanding of data security, and encryption is a plus

Interview Process


  • Online Assesment

  • Technical Round 1

  • Technical Round 2

python

Apply Now
Job Type

Full time payroll

Category

Machne learning developer



Other Jobs at Certa

Certa

Senior Frontend Engineer

We are ideally looking for 5+ years of experience, in as much of the tech stack as possible. If you love startups or have had experience working in start-ups, we would be a match made in tech heaven.

javascript react-js typescript redux

Certa

Senior Devops Engineer

Location: Hires Remotely Everywhere

Job Type: Full Time

Experience: 3+ Years

Preferred Skill Set: Leadership, AWS/EC2/ELB/S3/DynamoDB, Docker, DataDog, Terraform, DEVOPS tools Git, ansible, chef, bash scripting, AWS Fargate, AWS services, Linux, CI/CD tools, Jenkins, scripting language (python, bash)

Bash ansible python aws jenkins docker datadog

Certa
Certa

USA

Website
https://www.getcerta.com/
Company Size

142



⭐⭐⭐⭐⭐
ultraGenius: a fresh start

Ultragenius has given me a new start in my life. I always wanted to start my gig and work as a freelancer for good clients, and these guys have helped me accomplish my long term goal in only 3rd year of my career. They are highly supportive and helpful. I am grateful that I got a chance to work with them.

Mahesh Inder, Reactjs Dev

⭐⭐⭐⭐⭐
Excellent guys

Shailesh is excellent person to work with if your startup or organisation is finding talent for your web3 product and he is also helping developers and builders in web3 to find great team to work remotely. so he is creating win-win situation for both.

Mitul Gajera, web3