Centers of Competence
Purpose
Centers of Competence (CoC) are organizational units that concentrate expertise in specific technical areas of AI. They ensure delivery quality, knowledge accumulation, and standardization of approaches.
Types of centers of competence
Data Science CoC
- Expertise in machine learning, statistical modeling, and data analysis
- Development and validation of ML models
- Methodologies for running experiments and assessing model quality
MLOps / Platform CoC
- Tools and infrastructure for developing, testing, and deploying models
- CI/CD for ML pipelines, monitoring models in production
- Managing the ML Platform as an AI product
NLP / LLM CoC
- Expertise in natural language processing and large language models
- Developing the Knowledge Assistant (RAG), AI Copilot, and other LLM products
- Evaluating and testing LLM solutions, prompt engineering, fine-tuning
Functions of centers of competence
Regardless of specialization, each CoC performs the following functions:
- Developing standards and best practices — unified approaches to experiments, code review, testing, and documentation
- Expert support for working groups — assigning specialists to initiative working groups, consultations
- Developing AI products and platforms — technical ownership of products, their development and support
- Architecture reviews — taking part in reviewing technical solutions before they go to production
- Accumulating and transferring knowledge — maintaining a knowledge base, internal training, retrospectives, a catalog of delivered solutions
- Research and innovation — tracking new technologies, running PoCs to assess applicability
CoC versus the AI Office
Centers of competence and the AI Office perform different functions:
| AI Office | Centers of Competence | |
|---|---|---|
| Focus | Portfolio, methodology, governance | Technical expertise, delivery |
| Responsible for | What to do and when | How to do it |
| Decisions | Prioritization, stage gates, resources | Technical approaches, architecture |
| Artifacts | Portfolio reporting, process standards | Code, models, platforms, technical standards |
The AI Office coordinates the work of CoCs but does not manage their technical decisions. CoCs are autonomous in choosing tools and approaches within corporate standards.
Scaling
- In small organizations, the functions of several CoCs may be combined into a single team
- As the practice grows, CoCs are spun off as expertise and workload accumulate
- Each CoC has a leader who works with the AI Office Lead
Related sections
- Roles in the AI Operating Model — the roles of specialists from CoCs
- Project Managers — how an initiative leader assembles a working group and brings in CoC experts