Gm Jobs – DataOps Specialist

Job Description:

We are looking for a dedicated and passionate DataOps Specialist who will become part of a new Data capabilities Engineering team. This team is focused on providing in-vehicle, edge, and cloud-based app and service software to provide performance insights of GM’s next-generation Connected Vehicle, Automated Driving (L2+) and Autonomous (L4) technologies. The role requires expertise in building modern, cloud-native, DataOps-first systems for standardizing our data analytics pipeline. DataOps Specialists take full ownership of delivering high-performing, high-impact DataOps products and services, from concept to final delivery (and ongoing monitoring and operations) of our analytics pipeline and all associated automation. You are a standard-bearer for software engineering and quality coding practices within the team. You devise useful metrics to ensure analytics services are meeting requirements and iterating to improve on those metrics in an agile fashion. We are looking for a highly energetic and creative thinker who is addicted to an attention to detail. If you love the idea of shared accountability and have a passion for changing the world, we are looking for you! Come and join the team that is shaping the landscape in the automotive industry!

Job Responsibilities:

• Conduct complex data analysis and report on results
• Automate the orchestration of data platforms, building streaming (NRT, RT and micro batches) and ELT / ETL data pipelines
• Identify, design, and implement DataOps process improvements: automate manual processes, optimizing data delivery, redesigning infrastructure for greater scalability, etc
• Implement automated data quality and integrity checks to identify and resolve data issues within the pipeline
• Develop the analytics CI/CD infrastructure and change management methodology
• Develop data operations monitors such as pipeline visualizations, alerts, and issue logs
• Build the infrastructure required for optimal extraction, analysis, organization, transformation, and loading of data from a wide variety of data sources
• Analyze complex data schemas and relationships to implement information models
• Collaborate with ML Specialists to “featurize” the insights models and deploy Machine Learning models
• Implement automated analytics software quality checks prior to pipeline integration

Job Requirements:

• Advanced working SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of cloud native datastores
• A successful history of manipulating, processing and extracting value from large disconnected datasets
• Bachelor’s in computer science with a focus in Data Engineering, DataOps, DevOps, MLOps, Software Engineering or related field
• Demonstrated experience with common distributed data tools in a production setting (Spark, Kafka, etc)
• 4+ years of DataOps experience
• Demonstrated experience with CI/CD tools and concepts (e.g. Jira, GitLabs, and/orAzure DevOps, )
• Experience building and optimizing ‘big data’ data pipelines, architectures and data sets
• Working knowledge of message queuing, stream processing, and highly scalable ‘big data’ data stores
• Experience in the physical and logical design of database architecture for relational databases and data warehouses
• Demonstrated experience with software engineering (testing, documentation, software development lifecycle, and source control)

Qualification & Experience:

• Experience with vehicle ECU/module integration
• Experience with Automotive SW platforms (E.g. Classic/Adaptive AutoSAR, Google Automotive Services, Automotive Linux)
• Experience with edge, cloud, IoT technologies, virtualization technologies, containerization/container development, Android App development
• Scaled Agile Framework (SAFe) certification
• Experience with network engineering, telecommunications, network development and testing
• Advanced degree in a related technical field
• Experience with Vehicle Telematics & Communications

Job Details:

Company: General Motors

Vacancy Type:  Full Time

Job Location: Markham, ON, CA

Application Deadline: N/A

Apply Here

Careersvilla.com