# Reliability & Backups

> Selected Engineer ApS work demonstrating Reliability & Backups — the achievements that prove it.

- [Developed and launched the company's first observability dashboard, providing real‑time system performance insights and data visualization on the large office TV.](https://engineer.company/portfolio/developed-and-launched-the-company-s-first-observability-9/)
- [Architected, created, and managed 100 PostgreSQL, MS SQL, and Google BigQuery data warehouse databases with primarily GIS and time‑series data, optimizing performance and scalability.](https://engineer.company/portfolio/architected-created-and-managed-100-postgresql-ms-sql-12/)
- [Designed, deployed, and maintained 10 PostgreSQL and MS SQL servers on Ubuntu Linux VPS, ensuring optimal server performance and reliability.](https://engineer.company/portfolio/designed-deployed-and-maintained-10-postgresql-and-ms-13/)
- [Automated GIS SaaS application deployment, data processing, and reporting system using GitHub Actions CI/CD, Python, Bash, and SQL.](https://engineer.company/portfolio/automated-gis-saas-application-deployment-data-processing-and-16/)
- [Automated delivery of 20 GIS data pipelines and app data ETL processes, streamlining infrastructure automation and reporting.](https://engineer.company/portfolio/automated-delivery-of-20-gis-data-pipelines-and-17/)
- [Automated 100 critical data backups using Barman, Google Cloud, Bash, and Python, ensuring data integrity across databases.](https://engineer.company/portfolio/automated-100-critical-data-backups-using-barman-google-18/)
- [Deployed and maintained 20 Docker containerized applications, troubleshooting with Podman and Kubernetes, and managing R‑based apps on Google Cloud and AWS.](https://engineer.company/portfolio/deployed-and-maintained-20-docker-containerized-applications-troubleshooting-19/)
- [Managed 30 Ubuntu Linux VPS instances, implementing disaster recovery strategies and ensuring optimal network configurations.](https://engineer.company/portfolio/managed-30-ubuntu-linux-vps-instances-implementing-disaster-20/)
- [Mitigated operational risks by implementing a monitoring dashboard using Grafana and Prometheus, improving system reliability.](https://engineer.company/portfolio/mitigated-operational-risks-by-implementing-a-monitoring-dashboard-22/)
- [Managed and troubleshooted 8 WireGuard VPN and IPSEC VPN connections, ensuring secure communication across Google Cloud and Linux systems.](https://engineer.company/portfolio/managed-and-troubleshooted-8-wireguard-vpn-and-ipsec-23/)
- [Led the software development of a GIS map application, driving revenue growth by 10x and positioning the product as a primary data asset.](https://engineer.company/portfolio/led-the-software-development-of-a-gis-map-24/)
- [Led the development, deployment, and support of over 30 GIS projects, demonstrating expertise in PostgreSQL, Bash, Python, JavaScript, GDAL, ArcGIS, PostGIS, and Mapbox technologies.](https://engineer.company/portfolio/led-the-development-deployment-and-support-of-over-35/)
- [Administered network infrastructure for over 1,000 servers, ensuring optimal system deployment, security, and troubleshooting.](https://engineer.company/portfolio/administered-network-infrastructure-for-over-1-000-servers-39/)
- [Automated SSL/TLS certificate creation for 100 Docker applications, ensuring secure connections across Ubuntu Linux hosts.](https://engineer.company/portfolio/automated-ssl-tls-certificate-creation-for-100-docker-41/)
- [Streamlined CI/CD processes, saving 4,000 hours by introducing automation in software development pipelines.](https://engineer.company/portfolio/streamlined-ci-cd-processes-saving-4-000-hours-42/)
- [Configured and deployed 1,000 Wi‑Fi routers, improving network accessibility and performance for clients.](https://engineer.company/portfolio/configured-and-deployed-1-000-wi-fi-routers-48/)
- [Administered 100 Bare Bone servers, physical networks, and IP telephony systems, ensuring robust infrastructure for company growth.](https://engineer.company/portfolio/administered-100-bare-bone-servers-physical-networks-and-50/)
- [Administered 40 websites on Ubuntu Linux hosting servers with Apache and Nginx, ensuring high availability and performance.](https://engineer.company/portfolio/administered-40-websites-on-ubuntu-linux-hosting-servers-53/)
- [Architected, developed, implemented, supported infrastructure, data processing, and the map application for 2 years non‑stop without any weekends, holidays, or vacations, 10–14 hours a day.](https://engineer.company/portfolio/architected-developed-implemented-supported-infrastructure-data-processing-and-55/)
- [Generated the API contract outward from the database — OpenAPI, a 44,076‑line typed TypeScript client, 61 mock handlers and the limits the UI enforces — with a guard at every hop that fails on drift.](https://engineer.company/portfolio/built-a-request-schema-validation-contract-with-automated-61/)
- [Built email as a platform capability — three providers with failover, delivery webhooks, send and delivery logging, templating and campaigns — behind a startup check that will not boot without one.](https://engineer.company/portfolio/built-email-as-a-platform-capability-with-failover-62/)
- [Provisioned Azure infrastructure as code with Bicep — Container Apps, PostgreSQL Flexible Server, Front Door/WAF and networking — across the development, staging and production environments.](https://engineer.company/portfolio/provisioned-azure-infrastructure-as-code-with-bicep-container-68/)
- [Built GitHub Actions CI/CD pipelines with a distroless production frontend image and multi‑environment promotion.](https://engineer.company/portfolio/built-github-actions-ci-cd-pipelines-with-a-69/)
- [Owned end‑to‑end deployments of the platform to Azure, managing releases across development, staging and production environments.](https://engineer.company/portfolio/owned-end-to-end-deployments-of-the-platform-71/)
- [Configured database backup retention as infrastructure‑as‑code, then audited the recovery position and documented the restore procedure — naming the remaining gaps rather than leaving them to be found during an incident.](https://engineer.company/portfolio/configured-database-backup-retention-as-infrastructure-as-code-72/)
- [Delivered full Progressive Web App support — installable and offline‑capable — with Workbox runtime caching via next‑pwa.](https://engineer.company/portfolio/delivered-full-progressive-web-app-support-installable-and-74/)
- [Provided round‑the‑clock 24/7 infrastructure support for an IPTV/OTT streaming platform, administering ~1,000 servers plus client‑owned systems for global customers in China, the US and Germany.](https://engineer.company/portfolio/provided-round-the-clock-24-7-infrastructure-support-82/)
- [Ensured uninterrupted delivery of IPTV streaming signals between suppliers and clients, monitoring and maintaining the streaming network and IP telephony around the clock.](https://engineer.company/portfolio/ensured-uninterrupted-delivery-of-iptv-streaming-signals-between-83/)
- [Planned and implemented new infrastructure functionality for internal and external systems, building solutions durable enough to still run years later with minimal change.](https://engineer.company/portfolio/planned-and-implemented-new-infrastructure-functionality-for-internal-85/)
- [Performed data recovery across a wide range of media — SD cards, HDDs, SSDs, RAID arrays, external drives and Mac systems.](https://engineer.company/portfolio/performed-data-recovery-across-a-wide-range-of-92/)
- [Diagnosed and repaired laptop hardware — screens, hinges, keyboards, trackpads, motherboards and power — and resolved software issues across Linux, Windows and Mac.](https://engineer.company/portfolio/diagnosed-and-repaired-laptop-hardware-screens-hinges-keyboards-93/)
- [Built a layered automated test suite — 981 Go tests, 543 frontend and browser specs, 494 SQL behavioural tests — with mutation testing, property‑based tests and an accessibility gate.](https://engineer.company/portfolio/built-a-layered-automated-test-suite-across-four-layers-94/)
- [Moved slow work off the request path onto a River job queue — 15 worker modules, 8 scheduled tasks and 20 pg_cron jobs — so a request returns while the work behind it carries on.](https://engineer.company/portfolio/moved-slow-work-onto-a-river-job-queue-97/)
- [Built first‑party error monitoring and OpenTelemetry tracing rather than buying them — payload sanitising, spike and regression detection, symbolication and a synthetic heartbeat — behind 11 operator views.](https://engineer.company/portfolio/built-first-party-error-monitoring-and-tracing-98/)
- [Kept the schema honest across 1,022 migrations with a CI gate that builds the database both ways — a fresh install, and an install plus every migration — and fails when the two disagree.](https://engineer.company/portfolio/kept-the-schema-honest-across-1022-migrations-99/)
- [Built fail‑closed abuse controls — 22 Redis‑backed rate limiters, Cloudflare Turnstile, request idempotency and an origin lock — so the platform sheds bots and floods instead of trusting its callers.](https://engineer.company/portfolio/built-fail-closed-abuse-controls-and-rate-limiting-100/)
- [Established a continuous security programme — code scanning, DAST, dependency and vulnerability checks, SBOM generation, secret scanning and SHA‑pinned actions — alongside 21 written security audits.](https://engineer.company/portfolio/established-a-continuous-security-programme-104/)
- [Built the company's own infrastructure as 19 Ansible playbooks and 34 roles across 12,065 lines of YAML, converging a live host to a declared state with every play idempotent.](https://engineer.company/portfolio/built-the-companys-infrastructure-as-code-108/)
- [Ran the whole company on one 512 MB single‑core host — a git forge, a web server serving seven domains, Tor, two alternate‑protocol servers, backups and intrusion banning — by treating 464 MB of usable memory as the binding architectural constraint.](https://engineer.company/portfolio/ran-the-whole-company-on-one-512mb-host-109/)
- [Proved the intrusion‑banning path end to end on every hardening run by banning a reserved test address, reading the resulting kernel rule and unbanning in a guaranteed cleanup block, so a jail that stops working fails a run instead of reporting healthy.](https://engineer.company/portfolio/proved-the-intrusion-banning-path-on-every-converge-112/)
- [Built encrypted off‑host backups on restic with retention pruning, an integrity check and a monthly automated restore drill, then audited the recovery position and wrote down the gaps rather than leaving them to be found during an incident.](https://engineer.company/portfolio/built-encrypted-backups-with-a-monthly-restore-drill-114/)
- [Built dead‑man's‑switch monitoring that pings only while memory and disk are healthy, so a degraded host raises an alert by going silent — and caught six variable names saying "free" where the check correctly measured "available", an order of magnitude apart on a 464 MB box.](https://engineer.company/portfolio/built-dead-mans-switch-monitoring-115/)
- [Made check mode tell the truth across the whole platform after finding six probes deciding on a value the host never gave, because Ansible's command module reports success under --check while skipping the command entirely.](https://engineer.company/portfolio/made-ansible-check-mode-tell-the-truth-116/)
- [Added a preflight play that runs the same code as the converge against operator‑local secrets in about a second, after a half‑applied production run died on its ninth task with the swap settings already written to the live host.](https://engineer.company/portfolio/added-a-preflight-play-for-secrets-117/)
- [Split the four per‑host operational secrets after establishing that two hosts sharing one dead‑man's switch alert less than two switches, not more, and that a shared backup passphrase makes two hosts one repository.](https://engineer.company/portfolio/split-every-operational-secret-per-host-125/)
- [Held the generator to 981 test cases at a 92% branch‑coverage floor with warnings treated as failures, and asserted idempotence by running the whole build pipeline twice from an empty file and requiring the second pass to change nothing.](https://engineer.company/portfolio/held-the-generator-to-964-tests-and-a-coverage-floor-145/)
- [Stopped an application filling memory at 41 MB a second — a recorded 111 GB of compressed pages on a 36 GB machine — by bounding every event stream, subscribing by event type and putting a rate budget on logging, taking 610,996 log lines down to 1,411.](https://engineer.company/portfolio/stopped-an-application-filling-memory-at-41mb-a-second-155/)
- [Adopted Swift 6 complete strict concurrency with no actors, bridging a blocking C event loop to the main actor through one producer, one consumer and one ordering — after establishing that a task per event loses the ordering the interface depends on.](https://engineer.company/portfolio/adopted-swift-6-strict-concurrency-over-a-c-event-loop-156/)
- [Reached the half of the messaging core the application had never used — backup transfer, disappearing messages, message editing and resending, verified invitations, proxies and encryption policy — driving every test against the real library with no mocks.](https://engineer.company/portfolio/reached-the-unused-half-of-the-messaging-core-161/)

<https://engineer.company/categories/reliability/>
