AI COE Manager

Career Area:

Technology, Digital and Data

Job Description:

Your Work Shapes the World at Caterpillar Inc.

When you join Caterpillar, you're joining a global team who cares not just about the work we do – but also about each other.  We are the makers, problem solvers, and future world builders who are creating stronger, more sustainable communities. We don't just talk about progress and innovation here – we make it happen, with our customers, where we work and live. Together, we are building a better world, so we can all enjoy living in it.

Join the Caterpillar IT’s AI Center of Excellence team and take charge of leading and coordinating a team dedicated to building advanced generative AI solutions—including intelligent agents, digital assistants, and other innovative capabilities. You will shape the development of cutting-edge products that redefine how our internal customers interact with technology through AI-driven experiences. 
 

 What You Will Do:

• Providing strong technical support and clear direction to ensure the team is aligned with company goals and capable of delivering advanced AI projects.
• Managing resources efficiently to ensure projects are completed on schedule and to a high standard. 
• Overseeing the performance of both individual team members and the team as a whole, fostering a culture of learning by identifying and addressing training and development needs. 
• Establishing and supervising the implementation of engineering best practices to maintain consistency and excellence in development processes. 
• Taking ownership of the quality of engineering products, making sure all solutions are robust, reliable, and meet high standards. 

 

What You Have:

• Software Development: Expert knowledge of software development tools and activities; ability to produce software products or systems in line with product requirements. 
• Software Integration Engineering: Extensive knowledge of software integration processes and functions; ability to design, develop and maintain interfaces and linkage to alternative platforms and software packages. 
• Software Quality Assurance and Testing: Extensive knowledge of software quality assurance and testing; ability to apply appropriate processes, tools, and techniques for assuring a high level of quality in computer software products and systems. 
• Organizational Leadership: Extensive knowledge of leadership concepts and ability to use strategies and skills to enlist others in setting, embracing and achieving objectives. 

 

Considerations For Top Candidates: 

• Extensive software engineering leadership experience with leading AI and software teams in agile, matrixed organizations 
• Demonstrated track record of delivering GenAI solutions and enterprise-scale products across hybrid cloud and embedded/edge environments. 
• Experience delivering complex cross-functional projects in matrixed organizations. 
• Proven experience with project management concepts including project charters, scheduling and planning projects and successful completion.  
• Excellent interpersonal skills are required to deal with sensitive issues, develop others, or influence others inside and outside the department to take specific actions. 
• Should have strong project management skills, team leadership skills, excellent communication skills, strong analytical and organizational skills. 
• Extensive experience with delivering software solutions at scale and complete grasp of fundamental concepts such as CI/CD, unit testing, integration testing, blue/green deployments, canary deployments; experience with incident management 
• Solid software engineering and distributed systems knowledge; understanding of scalable system design, APIs, microservices, and cloud/edge architectures, enabling effective integration of AI components into production-grade applications. 
• Working knowledge of major cloud platforms such as Azure, AWS, or GCP, including on-prem AI Clusters. 
• Experience with Snowflake, including AI compute capabilities such as Cortex. 
• Deep knowledge of GenAI system design, including prompt engineering patterns such as system prompts, few-shot, chain-of-thought, and structured output; agentic system concepts including tool use, planning, multi-agent orchestration, memory, guardrails; vector databases concepts such as chunking, embeddings; patterns such as RAG (sparse, dense, hybrid); fine-tuning approaches such as LoRA. 
• Deep knowledge of GenAI model types, including LLMs, SLMs, speech, multimodal, and real-time models 
• Experience with agentic orchestration frameworks such as LangChain, LangGraph 
• Familiarity with MCP and A2A protocols 
• Strong expertise in AI evaluation, model selection, benchmarking, and optimization across open-source and commercial model ecosystems. 

• Strong foundation in AI products evaluation and performance measurement, with deep familiarity with evaluation methodologies, including GenAI-specific metrics (e.g., RAG quality, output reliability), A/B testing, and human-in-the-loop validation to ensure robustness and consistency in production systems.

 

Additional Info:

•       The required location for this role is East Peoria-IL, Irving-TX

 

About Caterpillar –

For more than a century, Caterpillar has helped build a better, more sustainable world. With 2025 sales and revenues of $67.6 billion, Caterpillar Inc. is shaping the future as the world’s leading manufacturer of construction and mining equipment, off-highway diesel and natural gas engines, industrial gas turbines and diesel-electric locomotives. Backed by one of the largest independent global dealer networks and financing services through Cat Financial, the company’s primary business segments: Power & Energy, Construction Industries and Resource Industries are solving customers’ toughest challenges through commercial excellence and advanced technology, driven by a highly skilled, dedicated global team. Learn more at www.caterpillar.com. 

 

 

Summary Pay Range:

$159,120.00 - $258,570.00

Compensation and benefits offered may vary depending on multiple individualized factors, job level, market location, job-related knowledge, skills, individual performance and experience. Please note that salary is only one component of total compensation at Caterpillar. 

Benefits:

Subject to plan eligibility, terms, and guidelines. This is a summary list of benefits.

• Medical, dental, and vision benefits*

• Paid time off plan (Vacation, Holidays, Volunteer, etc.)*

• 401(k) savings plans*

• Health Savings Account (HSA)*

• Flexible Spending Accounts (FSAs)*

• Health Lifestyle Programs*

• Employee Assistance Program*

• Voluntary Benefits and Employee Discounts*

• Career Development*

• Incentive bonus*

• Disability benefits

• Life Insurance

• Parental leave

• Adoption benefits

• Tuition Reimbursement

       

* These benefits also apply to part-time employees

 

 

This position requires working onsite five days a week.

 

 

 

 

Visa Sponsorship is not available for this position.

 

 

Posting Dates:

October 5, 2026 - October 14, 2026

Any offer of employment is conditioned upon the successful completion of a drug screen.

Caterpillar is an Equal Opportunity Employer, Including Veterans and Individuals with Disabilities.  Qualified applicants of any age are encouraged to apply.

Not ready to apply? Join our Talent Community.