Senior AI Data Engineer

Overview

We are seeking a highly skilled and motivated Senior AI Data Engineer to join our innovative data team. In this role, you will lead the development and management of large-scale data systems, enabling advanced artificial intelligence (AI) and machine learning (ML) initiatives. Your expertise will drive the design, implementation, and optimization of data pipelines and architectures that support cutting-edge AI models and analytics. This is an exciting opportunity to work at the forefront of data engineering, leveraging cloud platforms and big data technologies to transform complex data into actionable insights.

Duties

• Design, develop, and maintain scalable ETL (Extract, Transform, Load) pipelines using tools like Informatica, Talend, Spark, and Python to process vast datasets efficiently.
• Architect and optimize data storage solutions in cloud environments such as AWS, Azure Data Lake, and other public cloud platforms to support high-performance analytics.
• Collaborate with data scientists and AI teams to facilitate model training by providing clean, well-structured data from diverse sources including SQL databases like Microsoft SQL Server, Oracle, and cloud databases.
• Develop robust data models and schemas utilizing dimensional modeling principles for data warehousing systems that enable business intelligence tools like Looker.
• Manage big data systems such as Hadoop, Apache Hive, and Spark clusters to ensure reliable processing of large datasets across distributed environments.
• Implement best practices for data management integration, query management, and database design to enhance system efficiency and accuracy.
• Support agile development processes by participating in sprint planning, code reviews, and continuous improvement initiatives for data engineering workflows.

Skills

• Extensive experience with cloud-based data platforms including AWS services (e.g., S3, Redshift), Azure Data Lake, and other public cloud solutions.
• Strong proficiency in programming languages such as Python and Java for software development and automation tasks.
• Deep understanding of big data systems like Hadoop, Spark, Apache Hive, and related technologies for large-scale data processing.
• Expertise in SQL databases including Microsoft SQL Server, Oracle, and cloud-based SQL solutions; skilled in database design and query management.
• Proven ability to develop ETL pipelines using tools like Talend or Informatica; experience with shell scripting (Bash/Unix shell) for automation.
• Knowledge of data modeling techniques including dimensional modeling for designing efficient data warehouses.
• Familiarity with business intelligence tools such as Looker for creating dashboards and reports that drive strategic decision-making.
• Experience with RESTful APIs for integrating various systems; understanding of model training processes within AI/ML workflows.
• Strong analysis skills to interpret complex datasets; ability to translate business needs into technical solutions effectively.
• Excellent communication skills combined with a collaborative mindset to work seamlessly across cross-functional teams in an Agile environment.

Join us as a Senior AI Data Engineer to shape the future of intelligent systems by transforming raw data into powerful insights!

Pay: $150,000.00 - $200,000.00 per year

Benefits

• 401(k)
• Flexible schedule
• Health insurance
• Health savings account
• Life insurance
• Paid time off
• Professional development assistance
• Referral program

Work Location: Remote