Data Engineer
TechBiz Global · Remote – worldwide
- Salary
- Not stated
- Posted
- 4d ago
- Source
- Himalayas
Job description
At TechBiz Global , we are providing recruitment service to our TOP clients from our portfolio. We are currently seeking an Data Engineer to join one of our clients ' teams. If you're looking for an exciting opportunity to grow in a innovative environment, this could be the perfect fit for you.
Requirements
Key Responsibilities:
• Design, develop, and maintain data ingestion pipelines using Kafka Connect and
Debezium for real-time and batch data integration.
• Ingest data from MySQL and PostgreSQL databases into AWS S3, Google Cloud
Storage (GCS), and BigQuery.
• Implement best practices for data modeling, schema evolution, and efficient partitioning
in the Bronze Layer.
• Ensure reliability, scalability, and monitoring of Kafka Connect clusters and connectors.
• Collaborate with cross-functional teams to understand source systems and downstream
data requirements.
• Optimize data ingestion processes for performance and cost efficiency.
• Contribute to automation and deployment scripts using Python and cloud-native tools.
• Stay updated with emerging data lake technologies such as Apache Hudi or Apache
Iceberg.
Required Skills and Qualifications:
• 5+ years of hands-on experience as a Data Engineer or similar role.
• Strong experience with Apache Kafka and Kafka Connect (sink and source
connectors).
• Experience with Debezium for change data capture (CDC) from RDBMS.
• Proficiency in working with MySQL and PostgreSQL.
• Hands-on experience with AWS S3, GCP BigQuery, and GCS.
• Proficiency in Python for automation, data handling, and scripting.
• Understanding of data lake architectures and ingestion patterns.
• Solid understanding of ETL/ELT pipelines, data quality, and observability practices.
Good to Have:
• Experience with containerization (Docker, Kubernetes).
• Familiarity with workflow orchestration tools (Airflow, Dagster, etc.).
• Exposure to infrastructure-as-code tools (Terraform, CloudFormation).
• Familiarity with data versioning and table
Originally posted on Himalayas
Saffa.global isn't the employer or recruiter. Never pay anyone for a job offer, visa or "processing fee".
Similar jobs
Backend, Frontend, and Fullstack Engineering Expression of Interest Form
GitLab · Remote – worldwide
GitLab is an open-core software company that develops the most comprehensive AI-powered DevSecOps Platform, used by more than 100,000 organizations.
Director, Global GTM Strategy & Operations
Wrike · Remote – Anywhere in the World
Headquarters: US - Remote Wrike is the most powerful work management platform. Built for teams and organizations looking to collaborate, create, and exceed every day, Wrike brings everyone and all work into a single place to remove complexity, increase productivity, and free people up to focus on their most purposeful work. Wrike is our people, not a place. As a distributed team, we own our…
Business Systems Security Analyst
Wrike · Remote – Anywhere in the World
Headquarters: Estonia - Remote Wrike is the most powerful work management platform. Built for teams and organizations looking to collaborate, create, and exceed every day, Wrike brings everyone and all work into a single place to remove complexity, increase productivity, and free people up to focus on their most purposeful work. Wrike is our people, not a place. As a distributed team, we own our…
Enterprise Sales Engineer - FED
Datadog · Remote – Anywhere in the World
Headquarters: District of Columbia, USA, Remote; Maryland, USA, Remote; Virginia, USA, Remote As an Enterprise Sales Engineer, you'll partner with Sales to help customers understand the value of Datadog and how it solves their most important technical and business challenges. You'll lead technical evaluations, deliver compelling demos, and guide customers through the journey from discovery to…
Backend Engineer, Control Plane
Tailscale · Remote – Anywhere in the World
Headquarters: Remote (Canada) Thank you for considering Tailscale. If this job description resonates with you, please apply. Frequently cited statistics show that people who identify with historically marginalized groups are likely to apply to jobs only if they meet 100% of the qualifications. We encourage you to help us break that statistic! About Tailscale Tailscale is making safe connection…
Engineering Manager Expression of Interest Form
GitLab · Remote – worldwide
GitLab is an open-core software company that develops the most comprehensive AI-powered DevSecOps Platform, used by more than 100,000 organizations.