About the Company: A leading organization focused on innovative data solutions, committed to fostering a collaborative and inclusive work environment.

About the Role: The role involves developing and maintaining data pipelines and ETL/ELT/analytics engineering workflows, including vectorization workflows to support advanced search and retrieval capabilities.

Responsibilities:

• Develop and maintain data pipelines and ETL/ELT/analytics engineering workflows, including vectorization workflows to support advanced search and retrieval capabilities.
• Collaborate with data teams to understand requirements and automate deployment and monitoring.
• Optimize data storage and troubleshoot issues to enhance performance.

Qualifications:

• At least 8 years in software or data engineering with proficiency in Python.

Required Skills:

• Strong experience in unit and integration testing.
• Familiarity with DevOps practices and Agile methodologies.

Preferred Skills:

• Experience with AWS and Kubernetes (K8s).
• Familiarity with data platforms such as Snowflake, Databricks, Apache Spark, Apache Hive, open table formats (Delta Lake, Apache Iceberg), and vector databases.
• Experience with orchestration tools such as Apache Airflow, Dagster, Prefect, and Temporal.
• Familiarity with GitHub workflows and Datadog.

Pay range and compensation package: Competitive salary based on experience and qualifications.

Equal Opportunity Statement: We are committed to diversity and inclusivity in our hiring practices and encourage applications from all qualified individuals.