JR-161735 Data Engineer Middle
Job Description:
- Design, implement, and support a data solution in the AWS cloud
- Develop scalable data pipelines (using AWS native services) that meet data integration, ingestion, and processing requirements and common patterns
- Maintain and develop data quality, ensuring consistency and integrity across multiple sources
- Maintain and develop DBT models for data processing and business transformations
- Optimize S3 storage, ETL pipelines, and DBT models for performance enhancements, query tuning, and efficient data partition management
- Orchestrate existing pipelines and develop new ones with AWS Step Functions, automate pipeline monitoring
- Collaborate with multiple Dev and BA teams to solve complex data challenges, align on integration and processing patterns, and business result expectations
- Must have Skill set: DBT, Databricks, SQL, Python, AWS
Locations:
- Bangalore- India
Requirements:
- 3+ years of hands-on experience in data engineering: Datalake, Lakehouse, DWH
- Minimum 1 year of experience developing data solutions in AWS
- Real production experience working with AWS services: Step Function, Lambda, Glue Jobs / Catalog, Redshift (Spectrum), Athena
- Experience implementing processing and transformations with DBT: incremental strategies, macros, tests
- Proficiency in Python (PySpark, Pandas), SQL, Jinja
Will be a plus:
- Databricks experience/certifications
Other skills:
- English – upper intermediate
- Good communication skills (both verbal and written)
- Ability to work in a global, multi-cultural, and multi-national company
- Ability to lead conversations with both technical and business representatives
- Proven ability to work both independently and as a part of an international project team
- Work in the CET time zone
What We Offer:
- Competitive salary;
- 100% remote opportunity;
- Opportunities for professional growth and advancement;
- A collaborative and innovative work environment;
- Support for participation in professional development opportunities (webinars, conferences, trainings, etc.);
- Benefits may vary depending on your location and position. Full details will be provided during the interview process.
Job ID: JR-161735