L2 Senior Engineer — Technology Guild Criteria

These criteria define the Technology Guild’s expectations for a Senior Engineer (L2). They are authored and governed by the Technology Guild and aggregated into the L2 Senior Engineer Evaluation Workbook by the HR Management practice. The Skill column maps each criterion to a skill and level in the Calab Skills Registry.

Criteria by Capability Area

Software Engineering

IDCriterionSkill
L2-SEM01Designs and delivers production-ready changes spanning multiple components, with minimal rework after review.SFIA-PROG-3
L2-SEM02Designs automated test coverage — unit, integration, regression — for features they own, and closes coverage gaps they find.SFIA-TEST-3
L2-SEM03Performs constructive code reviews that catch real defects and coach L0–L1 engineers on standards.SFIA-PROG-3
L2-SEM04Refactors and pays down technical debt within their workstream, keeping changes safe through tests and incremental delivery.SFIA-SWDN-3

Platform Architecture

IDCriterionSkill
L2-PAM01Makes sound component-level design decisions — libraries, data stores, service boundaries — within platform guardrails, documenting trade-offs.SFIA-DESN-3
L2-PAM02Contributes improvements to shared platform assets — templates, reference implementations, IaC modules — used beyond their own project.SFIA-DESN-3
L2-PAM03Evaluates emerging tools or services relevant to their workstream and presents findings with a recommendation.SFIA-METL-3
L2-PAM04Designs and maintains the infrastructure-as-code for the solutions they own — modular, reviewed, and reproducible across environments.SFIA-ITOP-3

Application Architecture

IDCriterionSkill
L2-AAM01Designs improvements to Calab’s internal application architecture — integrations, automations, data flows across PM, service, accounting, and document systems — documenting trade-offs.SFIA-DESN-3
L2-AAM02Owns an internal system integration end-to-end: keeps it reliable, monitored, and documented so others can operate it.SFIA-SINT-3

Agentic Engineering

IDCriterionSkill
L2-AIE01Decomposes feature work into well-scoped tasks for coding agents, runs them effectively — context, guardrails, iteration — and critically reviews output before merge.CALAB-AGE-2
L2-AIE02Builds and maintains reusable context assets — prompts, instruction files, skills, MCP configs — that raise the whole team’s agent effectiveness.CALAB-CTX-2
L2-AIE03Designs lightweight evaluations — test harnesses, spot-check protocols, regression suites — to verify the quality of AI-generated output.CALAB-EVL-2
L2-AIE04Integrates LLM capabilities — APIs, retrieval, structured output — into solution features, handling non-determinism, cost, and failure modes.SFIA-MLNG-3

Security Engineering

IDCriterionSkill
L2-SEC01Threat-models the features they design — attack surfaces, data exposure, authentication and authorisation needs — before building.SFIA-SCTY-3
L2-SEC02Remediates vulnerabilities across their workstream — dependencies, misconfigurations, code flaws — verifying fixes and preventing recurrence.SFIA-VUAS-3
L2-SEC03Configures pipeline security tooling — SAST, dependency scanning, secret scanning — for repos they own, keeping the signal actionable.SFIA-SCTY-3

Data Engineering

IDCriterionSkill
L2-DAT01Builds reliable data pipelines and transformations for their workstream, with idempotency, error handling, and monitoring.SFIA-DENG-3
L2-DAT02Designs fit-for-purpose data models for features they own, documenting structure and trade-offs.SFIA-DTAN-3
L2-DAT03Implements data-quality checks — validation rules, reconciliation, alerts — so bad data is caught before it reaches consumers.SFIA-DENG-3

DevOps Management

IDCriterionSkill
L2-DVO01Maintains and improves CI/CD pipelines for repos they own — adds stages, speeds up feedback, keeps them green.SFIA-DEPL-3
L2-DVO02Implements observability for features they ship — logging, metrics, alerts — sufficient for someone else to diagnose issues.SFIA-ITOP-3
L2-DVO03Leads diagnosis and resolution of incidents in their workstream, communicating status and following up with prevention actions.SFIA-USUP-3