Network Operations Center Technician (Tier 1)
AiNet · Laurel, MD
Apr 2025 – Present
- Operate production infrastructure across a fleet of 13+ KVM hypervisors and 40+ Cisco/Juniper switches.
- Discovered a certificate-distribution host publishing every domain's TLS private key over unauthenticated public HTTPS: verified seven wildcard keys downloadable from off-network, established a roughly 19-month exposure window, and wrote the remediation plan (keys regenerated, not just reissued, since the ACME client reuses them across renewals).
- Built a 6-GPU inference rig from decommissioned datacenter hardware into a 48 GB VRAM pool serving a 35B-parameter model at ~33 tok/s, the compute base for an internal ops agent; handed off for agent bring-up.
- Diagnosed a fleet-wide monitoring blind spot where a local disk check pasted one host's result across 84 hosts, hiding real full disks; remediated across the fleet so genuine alerts fire again.
- Authored the VM fleet backup strategy: changed-block incremental capture pushed to OpenStack Swift object storage with dedup, encryption, and retention, every job monitored in Nagios; piloted on a production host.
- Planned and executed live RAID 0 to RAID 5 migrations with zero guest downtime, including a 3-drive rebuild on the largest host.
- Live-migrated 9+ production VMs across hypervisors over shared NFS, resolving cache-mode and snapshot edge cases without service interruption.
- Migrated a production BGP peering session from an aging 3750 to a 6500-class switch, documenting neighbor, prefix-list, and route-map config before a clean cutover.
- Restored a 10G DWDM circuit to a remote site that had been unreachable for about 10 months across four prior attempts: moved the /30, MTU, and OSPF point-to-point config onto the newly lit channel, then cleared an asymmetric MTU mismatch that had left the adjacency stuck in EXSTART.
- Ended a recurring multi-tenant out-of-disk ticket by tracing it to monthly ZFS snapshots on a parent dataset pinning everything a 12-hour cleanup cron deleted; reclaimed 2.72 TB on a dry-run-verified destroy and fixed the recurrence at the config layer, taking the pool from 94% to about 21% used.
- Mapped OSPF route preservation for three transit-switch decommissions, re-homing every live link so traffic through the boxes survived removal.
- Deployed an OpenVAS scanner in a dedicated VM with custom profiles aligned to the asset inventory; ran the recurring monthly scan and documented findings.
- Remediated a customer site with a broken TLS chain: installed intermediates, enforced HTTPS, and added HSTS, CSP, and hardening headers, verified end-to-end.